[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85486-en":3,"doc-seo-85486-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85486,962075006959,"Anda","https://ap-avatar.wpscdn.com/avatar/e0002397efbe92a78e?_k=1776741047341049297",8,"Research & Report","UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters","Text and formulas are central information units in many documents, and reliable recognition is essential for building robust, generalizable parsing systems. Vision-language models can unify text and formula understanding but are often too large and computationally expensive for broad deployment. UniRec-0.1B introduces a unified 0.1B-parameter model with multi-level outputs, supported by a 40M dataset and training designs addressing structural variability and cross-modal semantic entanglement. Experiments show superior accuracy and 2–9× faster inference on multi-domain Chinese and English benchmarks.","arXiv :2512 .21095v2 [ cs .CV] 11 Jul 2026  \nUniRec-0.1B: Unified Text and Formula Recognition with  \n0.1B Parameters  \nYongkun Du1, Zhineng Chen1,†, Yazhen Xie1, Weikang Bai1, Hao Feng2, Wei Shi2, Yuchen Su1, Can Huang2, Yu-Gang Jiang1,†  \n1Fudan University, 2 ByteDance  \nAbstract  \nText and formulas constitute the core informational components of many documents. Accurately and efficiently recognizing both is crucial for developing robust and generalizable document parsing systems. Recently, vision-language models (VLMs) have achieved impressive unified recognition of text and formulas. However, they are large-sized and computationally demanding, restricting their usage in many applications. In this paper, we propose UniRec-0.1B, a unified recognition model with only 0.1B parameters. It is capable of performing text and formula recognition at multiple levels, including characters, words, lines, paragraphs, and documents. To implement this task, we first establish UniRec40M, a large-scale dataset comprises 40 million text, formula and mixed samples, enabling the training of a powerful yet lightweight model. Secondly, we identify two challenges when building such a lightweight but unified expert model. They are: structural variability across levels and semantic entanglement between textual and formulaic content. To tackle these, we introduce a hierarchical supervision training that explicitly guides structural comprehension, and a semantic-decoupled tokenizer that separates text and formula representations. Finally, we develop a comprehensive evaluation benchmark covering Chinese and English documents from multiple domains and with multiple levels. Experimental results on this and public benchmarks demonstrate that UniRec-0.1B outperforms both general-purpose VLMs and leading document parsing expert models, while achieving 2-9× speedup, validating its effectiveness and efficiency.  \nCorrespondence: [zhinchen@fudan.edu.cn](zhinchen@fudan.edu.cn) , [ygj@fudan.edu.cn](ygj@fudan.edu.cn)  \nCodebase and Dataset: [https://github.com/Topdu/OpenOCR](https://github.com/Topdu/OpenOCR)  \n1 Introduction  \nDocument parsing [81] serves as a key component in real-world applications like document understanding, digital education, and information retrieval, etc. As the core tasks of document parsing, text and formula recognition have traditionally been addressed as distinct tasks, each with extensive research [3, 17–19, 22, 37, 45, 55–57, 67, 77, 80] and significant progress over the past decades.  \nRecent advances in vision-language models (VLMs) [2, 10, 26, 29, 62, 74, 75, 87] have enabled end-to-end document parsing [5, 7, 9, 11, 15, 35, 38, 42, 47, 49, 50, 54, 71, 72], where a single large model unifies text, formula, table, and chart understanding within one framework. While conceptually elegant, such unified paradigms typically rely on billion-scale parameters, resulting in substantial computational cost and inference latency. On the other hand, a closer examination of real-world document distributions reveals a critical  \n†Corresponding authors.  \nQuantity Proportion  \n Text  Formula  Mixed  Table  \nText (1-Edit)%  Formula (1-Edit)%  Table (TEDS)  Inference Speed  \nPerformence  \n100  \n90  \n80  \n70  \n60  \n50  \nPeak  \n\n|  |  |  |  |  |  |  |  |  |  |  |  |  |\n| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |\n|  |  |  |  |  |  |  |  |  |  |  |  |  |\n|  |  |  |  |  |  |  |  |  |  |  |  | 1.88 |\n|  |  |  |  |  |  |  |  |  |  |  |  |  |\n|  |  |  |  |  |  |  |  |  |  |  |  |  |\n|  |  |  |  0.78 |  |  |  |  |  |  |  |  |  |\n| \u003Cbr> 0.09 | 0.37\u003Cbr>.15 | 0.49 |  |  |  |  |  |  |  |  |  |  |\n\n3  \n2  \n1  \n0  \n0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3  \nInference Speed (second)  \nNumber of Parameters (B)  \n(a) (b)  \n1-Edit  \n1.0  \n0.9  \n0.9  \n0.8  \n0.8  \n0.7  \n\n|  |  |  |\n| --- | --- | --- |\n| *  |  |  |\n|  |  |  |\n|  |  |  |\n|  |  |  |\n\n0 1 2 3 Number of Parameters (B)  \n(c)  \n* UniRec-0 .1B  \n Dolphin-0 .3B  \n ","cbCaiiZzdP5DqdHB","https://ap.wps.com/l/cbCaiiZzdP5DqdHB","pdf",5870450,1,24,"English","en",105,"# Introduction\n## Document parsing and unified recognition\n## Motivation: efficiency limits of large VLMs\n# UniRec-0.1B approach","[{\"question\":\"What problem does UniRec-0.1B address?\",\"answer\":\"It targets unified recognition of both text and mathematical formulas in documents, aiming for strong accuracy while reducing model size and computational cost compared with large vision-language models.\"},{\"question\":\"How does UniRec-0.1B enable multi-level text and formula recognition?\",\"answer\":\"The method supports recognition across characters, words, lines, paragraphs, and documents, using a large-scale dataset (UniRec40M) and training strategies tailored for structure and cross-modal relations.\"},{\"question\":\"Which challenges are highlighted for building a lightweight unified expert model?\",\"answer\":\"The document identifies structural variability across levels and semantic entanglement between textual and formulaic content as two key challenges.\"}]",1784203952,60,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"unirec-01b-unified-text-and-formula-recognition-with-01b-parameters","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/unirec-01b-unified-text-and-formula-recognition-with-01b-parameters/85486/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does UniRec-0.1B address?","Question",{"text":75,"@type":76},"It targets unified recognition of both text and mathematical formulas in documents, aiming for strong accuracy while reducing model size and computational cost compared with large vision-language models.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does UniRec-0.1B enable multi-level text and formula recognition?",{"text":80,"@type":76},"The method supports recognition across characters, words, lines, paragraphs, and documents, using a large-scale dataset (UniRec40M) and training strategies tailored for structure and cross-modal relations.",{"name":82,"@type":73,"acceptedAnswer":83},"Which challenges are highlighted for building a lightweight unified expert model?",{"text":84,"@type":76},"The document identifies structural variability across levels and semantic entanglement between textual and formulaic content as two key challenges.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,109,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":28,"slug":108},5,"Comic","comic",{"id":110,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]