[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-160373-en":3,"doc-seo-160373-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},160373,687197100911,"Himbo","https://ap-avatar.wpscdn.com/avatar/a000239b6f1da00475?x-image-process=image/resize,m_fixed,w_180,h_180&k=1785132997149421697",8,"Research & Report","From LSAT - The Progress and Challenges of Complex Reasoning - arXiv 2108.00648v1","Complex reasoning focuses on drawing correct inferences by mastering complex rules and their interactions. This paper advances complex reasoning on the Law School Admission Test by systematically studying three challenging, domain-general tasks: analytical reasoning, logical reasoning, and reading comprehension. A hybrid reasoning system integrates these tasks to obtain strong overall LSAT performance. Experiments highlight gains in reading comprehension and logical reasoning, and analysis shows that combining pre-trained models with task-specific reasoning modules and incorporating symbolic knowledge into interpretable steps improves effectiveness.","From LSAT: The Progress and Challenges of  \nComplex Reasoning  \nSiyuan Wang, Student Member, IEEE, Zhongkun Liu, Wanjun Zhong, Ming Zhou, Member, IEEE, Zhongyu Wei, Member, IEEE, Zhumin Chen, and Nan Duan, Member, IEEE,  \narXiv :2108 .00648v 1 [ cs .CL] 2 Aug 2021  \nAbstract—Complex reasoning aims to draw a correct inference based on complex rules. As a hallmark of human intelligence, it involves a degree of explicit reading comprehension, interpretation of logical knowledge and complex rule application. In this paper, we take a step forward in complex reasoning by systematically studying the three challenging and domain-general tasks of the Law School Admission Test (LSAT), including analytical reasoning, logical reasoning and reading comprehension. We propose a hybrid reasoning system to integrate these three tasks and achieve impressive overall performance on the LSATtests. The experimental results demonstrate that our system endows itself a certain complex reasoning ability, especially the fundamental reading comprehension and challenging logical reasoning capacities. Further analysis also shows the effectiveness of combining the pre-trained models with the task-specific reasoning module, and integrating symbolic knowledge into discrete interpretable reasoning steps in complex reasoning. We further shed a light on the potential future directions, like unsupervised symbolic knowledge extraction, model interpretability, few-shot learning and comprehensive benchmark for complex reasoning.  \nIndex Terms—LSAT, complex reasoning, analytical reasoning, logical reasoning, reading comprehension.  \nI. INTRODUCTION  \nCOMPLEX reasoning aims to comprehend and analyze the  \ngiven information, and apply complex rules to draw correct inference [1, 2] . As an essential ability for complex problem solving, it provides tremendous opportunities for many real-world scenarios, such as mathematical word problems, negotiation and argument, and medical diagnosis [3, 4, 5, 6] . In recent years, having a computer pass admission examinations is a hot AI challenge towards complex reasoning, which offers an objective and accurate measurement with a certain difficulty. Fujita et al. [7] design a system to sit the Japanese National Center Test for University Admissions. Gaokao, asthe National College Entrance Examination of China, also  \nWork is done during internship at Lanboat. Corresponding author: Ming Zhou; Zhongyu Wei.  \nSiyuan Wang and Zhongyu Wei are with the School of Data Science, Fudan University, Shanghai 200433, China. And Zhongyu Wei is also with the Research Institute of Intelligent and Complex Systems, Fudan University, Shanghai 200433, China ([email: wangsy18@fudan.edu.cn](email: wangsy18@fudan.edu.cn); [zywei@fudan.edu.cn](zywei@fudan.edu.cn)).  \nZhongkun Liu and Zhumin Chen are with the School of Computer Science and Technology, Shandong University, Qingdao 266237, China (email: [liuzhongkun@mail.sdu.edu.cn](liuzhongkun@mail.sdu.edu.cn); [chenzhumin@mail.sdu.edu.cn](chenzhumin@mail.sdu.edu.cn))  \nWanjun Zhong is with the School of Computer Science and Engineering, Sun Yat-Sen University, Guangzhou 510275, China (email: [zhongwj25@mail2.sysu.edu.cn](zhongwj25@mail2.sysu.edu.cn)).  \nMing Zhou is with the Sinovation Ventures, Beijing 100080, China (email: [zhouming@chuangxin.com](zhouming@chuangxin.com)).  \nNan Duan is with Microsoft Research, Beijing 100080, China (email: [nanduan@microsoft.com](nanduan@microsoft.com)) .  \nhas been widely studied [8, 9] . Although encouraging results have been achieved in taking these real high-school exams, these works study domain-specific and limited complex reasoning capabilities. They cover different subjects and each is separately processed with subject-specific knowledge [10] . For example, the annotated formulas representing physics, mathematics and biology knowledge are usually assumed to be provided to solve corresponding problems [7, 11], while history and geography questions are primarily solved ","cbCairk3oipXdRsm","https://ap.wps.com/l/cbCairk3oipXdRsm","pdf",1701983,1,17,"English","en",105,"# Introduction\n## Motivation for complex reasoning\n## LSAT as a domain-general testbed\n# Related Work\n## Symbolic, neural, and neural-symbolic approaches","[{\"question\":\"What tasks does the paper use from LSAT to study complex reasoning?\",\"answer\":\"The paper focuses on three domain-general LSAT tasks: analytical reasoning, logical reasoning, and reading comprehension.\"},{\"question\":\"What approach does the paper propose for solving the LSAT tasks?\",\"answer\":\"It proposes a hybrid reasoning system that integrates the three tasks into a unified framework to improve overall performance.\"},{\"question\":\"What do the experimental results show about the proposed system?\",\"answer\":\"The results demonstrate complex reasoning ability, particularly strong reading comprehension and challenging logical reasoning capabilities.\"}]","From LSAT - The Progress and Challenges of Complex Reasoning - arXiv 2108.00648v1 | PDF",1788062581,43,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"from-lsat-the-progress-and-challenges-of-complex-reasoning-arxiv-210800648v1","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/from-lsat-the-progress-and-challenges-of-complex-reasoning-arxiv-210800648v1/160373/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-30",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What tasks does the paper use from LSAT to study complex reasoning?","Question",{"text":75,"@type":76},"The paper focuses on three domain-general LSAT tasks: analytical reasoning, logical reasoning, and reading comprehension.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What approach does the paper propose for solving the LSAT tasks?",{"text":80,"@type":76},"It proposes a hybrid reasoning system that integrates the three tasks into a unified framework to improve overall performance.",{"name":82,"@type":73,"acceptedAnswer":83},"What do the experimental results show about the proposed system?",{"text":84,"@type":76},"The results demonstrate complex reasoning ability, particularly strong reading comprehension and challenging logical reasoning capabilities.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]