[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-83846-en":3,"doc-seo-83846-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},83846,8796095462418,"Noah","https://ap-avatar.wpscdn.com/avatar/80000253c1241d02b47?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778826106357471780",8,"Research & Report","Integrated Altruistic and Fairness Preference Induces Advanced Mutual Cooperation in Sequential Social Dilemmas","Inducing cooperation among distributed agents remains a central challenge in multi-agent reinforcement learning, especially in sequential social dilemma settings where self-interest conflicts with collective welfare. Humans achieve cooperation through social preferences, inspiring a new approach that integrates altruistic preferences and fairness preferences into a single AFP utility and reward-sharing mechanism. Comparative experiments against standard RL and inequity aversion agents show AFP achieves mutual cooperation with stronger collective rewards and improved equity. Training analysis further indicates altruism promotes public-good contribution while fairness shapes mutual behavior.","Integrated Altruistic and Fairness Preference Induces Advanced Mutual Cooperation in Sequential Social Dilemmas  \nYu Wei The University of Tokyo  \nTokyo, Japan [weiyu@isi.imi.i.u-tokyo.ac.jp](weiyu@isi.imi.i.u-tokyo.ac.jp)  \nYukiko Ogura The University of Tokyo  \nTokyo, Japan [ogura@isi.imi.i.u-tokyo.ac.jp](ogura@isi.imi.i.u-tokyo.ac.jp)  \nYoshiyuki Ohmura The University of Tokyo  \nTokyo, Japan [ohmura@isi.imi.i.u-tokyo.ac.jp](ohmura@isi.imi.i.u-tokyo.ac.jp)  \nIldefons Magrans de Abril The University of Tokyo  \nTokyo, Japan [ildefons@isi.imi.i.u-tokyo.ac.jp](ildefons@isi.imi.i.u-tokyo.ac.jp)  \nHoshinori Kanazawa The University of Tokyo  \nTokyo, Japan [kanazawa@isi.imi.i.u-tokyo.ac.jp](kanazawa@isi.imi.i.u-tokyo.ac.jp)  \nYasuo Kuniyoshi The University of Tokyo  \nTokyo, Japan [kuniyosh@isi.imi.i.u-tokyo.ac.jp](kuniyosh@isi.imi.i.u-tokyo.ac.jp)  \narXiv :2607 .047 10v 1 [ cs .AI] 6 Jul 2026  \nABSTRACT  \nInducing cooperation among distributed agents is still a difficult problem in the field of multi-agent reinforcement learning (MARL), particularly in social dilemma situations. There, individual interests are misaligned with the common good and individual rationality leads to suboptimal group outcomes. In contrast, humans are able to achieve cooperation with one another in such situations. A common explanation for such cooperative behavior is that individuals have social preferences. In order to achieve cooperation in MARL, we design a new utility function integrating altruistic preferences (incentive for other’s reward) and fairness preferences (incentive for equality) from social psychology and behavioral economics, namely, Altruistic and Fairness Preference (AFP), a reward-sharing mechanism which converts one’s own and other’s rewards to incentives for cooperative behavior. We performed comparative experiments with standard RL and inequity aversion agents in two challenging sequential social dilemma games, and showed that AFP agents successfully achieved mutual cooperation with more collective rewardsand higher equity than the baselines. To further understand the progression of AFP during training, we subsequently explore the effects of altruistic preferences and fairness preferences on agents’behavior. The results suggest that altruistic preferences encourage agents to contribute to the public goods, and fairness preferences induce mutual behavior between agents.  \nKEYWORDS  \nmulti-agent reinforcement learning, social dilemma, cooperation, altruistic preferences, fairness preferences  \nACM Reference Format:  \nYu Wei, Yukiko Ogura, Yoshiyuki Ohmura, Ildefons Magrans deAbril, Hoshinori Kanazawa, and Yasuo Kuniyoshi. 2022. Integrated Altruistic and Fairness Preference Induces Advanced Mutual Cooperation in Sequential Social Dilemmas. In Proc. of the 21st International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2022), Auckland, New Zealand, May 9–13, 2022, IFAAMAS, 9 pages.  \nProc. of the 21st International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2022), P. Faliszewski, V. Mascardi, C. Pelachaud, M.E. Taylor (eds.), May 9–13, 2022, Auckland, New Zealand. © 2022 International Foundation for Autonomous Agents and Multiagent Systems ([www.ifaamas.org](www.ifaamas.org)). All rights reserved.  \n1 INTRODUCTION  \nMulti-agent systems can be used to address problems in various applications, such as decentralized control, simulations in economics or sociology, and robotics. Multi-agent reinforcement learning (MARL) is a promising approach for addressing complex tasks without the need for preprogrammed agent behaviors. Recently, the evolution of cooperation among agents has become an important problem in MARL. Due to the difficulty in designing rewards for multi-agent systems, individual rewards are often intertwined with each other and create unexpected social dilemmas at the group level. This occurs because individual actions are taken to obtain higher individual rewards, and this can lead to suboptim","cbCaihKAy2Impumq","https://ap.wps.com/l/cbCaihKAy2Impumq","pdf",1377183,1,9,"English","en",105,"# Abstract\n# Introduction\n## Cooperation in MARL and social dilemmas\n## Reward design challenges\n## Limitations of centralized training\n## Preference-based mechanisms for cooperation","[{\"question\":\"What problem does the paper address in multi-agent reinforcement learning?\",\"answer\":\"It addresses how to induce cooperation among distributed agents in sequential social dilemma situations where individual incentives conflict with collective outcomes.\"},{\"question\":\"How does the proposed AFP method work?\",\"answer\":\"AFP integrates altruistic preferences (reward incentives for others’ returns) and fairness preferences (incentives for equality) into a unified utility function via a reward-sharing mechanism to promote cooperative behavior.\"},{\"question\":\"What do the experiments show about AFP compared with baseline methods?\",\"answer\":\"AFP agents achieve mutual cooperation with higher collective rewards and greater equity than standard RL and inequity aversion agents in challenging sequential social dilemma games.\"}]",1784190941,23,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"integrated-altruistic-and-fairness-preference-induces-advanced-mutual-cooperation-in-sequential-social-dilemmas","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/integrated-altruistic-and-fairness-preference-induces-advanced-mutual-cooperation-in-sequential-social-dilemmas/83846/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the paper address in multi-agent reinforcement learning?","Question",{"text":75,"@type":76},"It addresses how to induce cooperation among distributed agents in sequential social dilemma situations where individual incentives conflict with collective outcomes.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the proposed AFP method work?",{"text":80,"@type":76},"AFP integrates altruistic preferences (reward incentives for others’ returns) and fairness preferences (incentives for equality) into a unified utility function via a reward-sharing mechanism to promote cooperative behavior.",{"name":82,"@type":73,"acceptedAnswer":83},"What do the experiments show about AFP compared with baseline methods?",{"text":84,"@type":76},"AFP agents achieve mutual cooperation with higher collective rewards and greater equity than standard RL and inequity aversion agents in challenging sequential social dilemma games.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":21,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]