[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-121108-en":3,"doc-seo-121108-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},121108,8796095461564,"Liam","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","Multimodal Machine Learning for Information Retrieval - A Vision and Language Perspective","This thesis investigates multimodal machine learning methods for information retrieval with a strong focus on how visual and linguistic signals can be jointly modeled. It centers on representing vision-language content in a way that improves ranking and relevance estimation, leveraging the complementary information carried by images and text. The research is developed through experiments within the Information Retrieval Lab at the University of Amsterdam, supported by industry and academic collaboration, and aims to establish clearer perspectives on how vision and language interact in retrieval systems.","UvA-DARE (Digital Academic Repository)  \nMultimodal machine learning for information retrieval  \nA vision and language perspective Hendriksen, M.Y.  \nPublication date  \n2024  \nDocument Version  \nFinal published version  \nLink to publication  \nCitation for published version (APA):  \nHendriksen, M. Y. (2024) . Multimodal machine learning for information retrieval: A vision and language perspective. [Thesis, fully internal, Universiteit van Amsterdam] .  \nGeneral rights  \nIt is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), other than for strictly personal, individual use, unless the work is under an open content license (like Creative Commons) .  \nDisclaimer/Complaints regulations  \nIf you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library: [https://uba.uva.nl/en/contact](https://uba.uva.nl/en/contact), or a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.  \nUvA-DARE is a service provided by the library of the University of Amsterdam ( [http](https://dare. uva. nl)[s](https://dare. uva. nl)[://dare. uva. nl](https://dare. uva. nl))  \nDownload date:13 Jan 2025  \nMultimodal Machine Learning for Informat ion Retrieval Mar iya Y . Hendriksen 2024  \nMultimodal Machine Learning for Information Retrieval A Vision and Language Perspective  \nMariya Y. Hendriksen  \nMultimodal Machine Learning for Information Retrieval  \nA Vision and Language Perspective  \nAcademisch Proefschrift  \nter verkrijging van de graad van doctor aan de Universiteit van Amsterdam op gezag van de Rector Magnificus  \n[prof. dr. ir. P.P.C.C. Verbeek](prof. dr. ir. P.P.C.C. Verbeek)[ ](prof. dr. ir. P.P.C.C. Verbeek)ten overstaan van een door het College voor Promoties  \ningestelde commissie,  \nin het openbaar te verdedigen in de Aula der Universiteitop vrijdag 13 december 2024, te 14:00 uur  \ndoor  \nMariya Yurievna Hendriksen  \ngeboren te Goebkinski  \nii   \npromotiecommiss ie  \nPromotor:  \nprof. dr. M. de Rijke Universiteit van Amsterdam  \nCopromotor:  \nprof. dr. P.T. Groth Universiteit van Amsterdam  \nOverige leden:  \nprof. dr. E. Kanoulas Universiteit van Amsterdam  \nprof. dr. M.A. Larson Radboud Universiteit  \nprof. dr. M.-F. Moens Katholieke Universiteit Leuven  \nprof. dr. M. Worring Universiteit van Amsterdam  \ndr. A.C. Yates Universiteit van Amsterdam  \nFaculteit der Natuurwetenschappen, Wiskunde en Informatica  \nThe work described in this thesis has primarily been carried out at the Information Retrieval Lab of the University of Amsterdam and in part during an internship at Bloomberg AI. The research carried out at the University of Amsterdam was funded by Ahold Delhaize.  \nCopyright © 2024 by Mariya Yurievna Hendriksen, Amsterdam, The Netherlands.  \nCover design adapted from “All Your Colours” by Simone Boon.  \nPrinted by Ridderprint, The Netherlands.  \nISBN: 978-94-6506-438-3  \nto my grandparents, Raqiyah and Yuriy.  \nAC K NOW L E DG EM E NTS  \nPursuing a PhD was never part of my original plan. I have always been interested in linguistics, mathematics, and computer science. This led me to a bachelor’s in computational linguistics, where I discovered that it was the computational aspect of the field that fascinated me the most. From there, I pursued a master’s in artificial intelligence, where I had an opportunity to engage in extracurricular research at ETH Zurich and KU Leuven. These experiences motivated me to commence a PhD journey – one that I am now close to completing.  \nThe path I have taken has spanned six countries and helped me to grow both professionally and personally. What made the biggest difference were the ","cbCaigmX2rybROzF","https://ap.wps.com/l/cbCaigmX2rybROzF","pdf",12906816,1,184,"English","en",105,"# Acknowledgements\n## Background and motivation\n## Supervisors and committee","[{\"question\":\"What is the thesis topic?\",\"answer\":\"The thesis focuses on multimodal machine learning for information retrieval, specifically framed as a vision and language perspective.\"},{\"question\":\"Where was the research primarily conducted?\",\"answer\":\"The work was primarily carried out at the Information Retrieval Lab of the University of Amsterdam.\"},{\"question\":\"Who supervised and supported the thesis?\",\"answer\":\"The thesis lists a promotor and copromotor from the University of Amsterdam, along with committee members from multiple institutions.\"}]","Multimodal Machine Learning for Information Retrieval - A Vision and Language Perspective | PDF",1785733774,464,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"multimodal-machine-learning-for-information-retrieval-a-vision-and-language-perspective","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/multimodal-machine-learning-for-information-retrieval-a-vision-and-language-perspective/121108/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the thesis topic?","Question",{"text":75,"@type":76},"The thesis focuses on multimodal machine learning for information retrieval, specifically framed as a vision and language perspective.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Where was the research primarily conducted?",{"text":80,"@type":76},"The work was primarily carried out at the Information Retrieval Lab of the University of Amsterdam.",{"name":82,"@type":73,"acceptedAnswer":83},"Who supervised and supported the thesis?",{"text":84,"@type":76},"The thesis lists a promotor and copromotor from the University of Amsterdam, along with committee members from multiple institutions.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]