[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-127868-en":3,"doc-seo-127868-105":31,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},127868,2336474466712,"Maeve","https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd",8,"Research & Report","Fairness and Bias of Machine Learning in Search and Ranking - Dissertation - 2024","Recent advancements in information retrieval and machine learning improve ranking and search performance, yet training-data bias can cause unfair treatment of demographic groups and fuel systematic discrimination by race, gender, or geography. This research proposes frameworks to mitigate data bias and promote equitable representation and exposure in ranking and search outcomes. It introduces Meta-learning based Fair Ranking (MFR) and Meta Curriculum-based Fair Ranking (MCFR) using weighted loss and curriculum strategies, evaluates LLM text-ranking fairness, and studies selection bias in multi-stage recommendation with MUDA.","Santa Clara University  \nScholar Commons  \n\n| Engineering Ph. D. Theses | Student Scholarship |\n| --- | --- |\n\n5-2024  \nFairness and Bias of Machine Learning in Search and Ranking Yuan Wang  \nFollow this and additional works at: [https://scholarcommons.scu.edu/eng_phd_theses](https://scholarcommons.scu.edu/eng_phd_theses)  \nFairness and Bias of Machine Learning in Search and Ranking  \nby  \nYuan Wang  \nDissertation  \nSubmitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy  \nin Computer Science & Engineering  \nin the School of Engineering at Santa Clara University, 2024  \nSanta Clara, California  \nDedicated to my family    \niii  \nAcknowledgements  \nFirst and foremost, I extend my deepest gratitude to my advisor, Professor Yi Fang, whose unwavering guidance and support have been instrumental to my doctoral journey. Professor Fang not only believed in my potential but also supported me with patience, kindness, and an unmatched dedication to excellence. His mentorship transcended academic instruction, offering personal support and invaluable life lessons that have shaped me both as a scholar and as an individual. He teaches me to keep trying, to be curious, and to work hard. I want to keep doing these things in my job too. Learning from him has been a really special chance for me, and I’m so thankful for it.  \nI would like to thank my doctoral committee consisting of Prof. Zhiqiang Tao, Prof. David Anastasiu, Prof. Sean Choi, and Prof. Haibing Lu for their time and suggestions to make my thesis better.  \nI would like to thank my lab mates Travis Ebesu, Xuyang Wu, Zhiyuan Peng, and Suthee Chaidaroon, who supported me through different parts of this journey.  \nLastly, I would like to thank my family. My parents and my brother have given me endless love and support throughout this entire journey. I also want to thank my  \nfiancée, Yijia, for her love and patience.  \nFairness and Bias of Machine Learning in Search and Ranking  \nYuan Wang  \nDepartment of Computer Science & Engineering  \nSanta Clara University  \nSanta Clara, California  \n2024  \nABSTRACT  \nRecent advancements in Information Retrieval (IR) and machine learning have significantly improved ranking and search system performance. However, these data-driven approaches often suffer from inherent biases present in training datasets, leading to unfair treatment of certain demographic groups and contributing to systematic discrimination based on race, gender, or geographic location. This research aims to address the fairness and bias issue in ranking and search systems by proposing innovative frameworks that mitigate data bias and ensure equitable representation and exposure across diverse groups.  \nWe introduce two novel frameworks: the Meta-learning based Fair Ranking (MFR) model and the Meta Curriculum-based Fair Ranking (MCFR) framework, both designed to alleviate dataset bias through automatically-weighted loss functions and curriculum learning strategies, respectively. These approaches utilize meta-learning to adjust ranking loss, focusing particularly on improving the fairness metrics for minority groups while maintaining competitive ranking performance. Additionally, we conduct an empirical evaluation of Large Language Models (LLMs) in text-ranking tasks, revealing  \nbiases in handling queries and documents related to binary protected attributes. Our analysis offers a benchmark for assessing LLMs’ fairness and highlights the necessity for equitable representation in search outcomes.  \nFurthermore, we explore the challenge of data selection bias in multi-stage recommendation systems, particularly in online advertising contexts like Pinterest’s multi-cascade ads ranking system. Through comprehensive experiments, we assess various state-ofthe-art methods, and our findings demonstrate the effectiveness of a modified version of unsupervised domain adaptation (MUDA) in mitigating selection bias.  \nCollectively, our work contributes to the development of","cbCaib69PCevToMF","https://ap.wps.com/l/cbCaib69PCevToMF","pdf",2353060,4,1,143,"English","en",105,"# Introduction\n## Motivation\n## Overview\n## Contributions\n## Outline\n# Related Work\n## Fairness on Ranking\n## Meta-Learning on Fairness\n## Fairness in LLMs\n## Selection Bias\n# A Meta-learning Approach to Fair Ranking\n## Introduction\n## Meta-learning Based Fair Ranking\n## Experiments\n## Conclusion\n# A Unified Meta-learning Framework for Fair Ranking with Curriculum Learning\n## Introduction\n## Meta Curriculum-based Fair Ranking\n## Experiments","[{\"question\":\"What problem does the dissertation address in search and ranking systems?\",\"answer\":\"It addresses inherent bias in training data that can lead to unfair treatment of demographic groups and discrimination in ranking and search outcomes.\"},{\"question\":\"What are the two main fairness frameworks proposed by the research?\",\"answer\":\"The dissertation proposes Meta-learning based Fair Ranking (MFR) and Meta Curriculum-based Fair Ranking (MCFR). MFR uses automatically weighted loss via meta-learning, while MCFR incorporates curriculum learning strategies.\"},{\"question\":\"How does the dissertation evaluate bias beyond traditional ranking models?\",\"answer\":\"It conducts empirical evaluation of large language models in text-ranking tasks, analyzing biases in handling queries and documents related to protected attributes.\"}]","Fairness and Bias of Machine Learning in Search and Ranking - Dissertation - 2024 | PDF",1785942429,360,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":29},"fairness-and-bias-of-machine-learning-in-search-and-ranking-dissertation-2024","",{"@graph":37,"@context":86},[38,54,69],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,49,52],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":48},"https://docshare.wps.com/document/","Document",2,{"item":50,"name":12,"@type":44,"position":51},"https://docshare.wps.com/document/research-report/",3,{"item":53,"name":13,"@type":44,"position":20},"https://docshare.wps.com/document/fairness-and-bias-of-machine-learning-in-search-and-ranking-dissertation-2024/127868/",{"url":53,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":42,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-25","2026-08-05",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What problem does the dissertation address in search and ranking systems?","Question",{"text":76,"@type":77},"It addresses inherent bias in training data that can lead to unfair treatment of demographic groups and discrimination in ranking and search outcomes.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"What are the two main fairness frameworks proposed by the research?",{"text":81,"@type":77},"The dissertation proposes Meta-learning based Fair Ranking (MFR) and Meta Curriculum-based Fair Ranking (MCFR). MFR uses automatically weighted loss via meta-learning, while MCFR incorporates curriculum learning strategies.",{"name":83,"@type":74,"acceptedAnswer":84},"How does the dissertation evaluate bias beyond traditional ranking models?",{"text":85,"@type":77},"It conducts empirical evaluation of large language models in text-ranking tasks, analyzing biases in handling queries and documents related to protected attributes.","https://schema.org",{"og:url":53,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":53},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":48,"doc_module":4,"doc_module_name":47,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":47,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":47,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]