[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85552-en":3,"doc-seo-85552-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85552,16904993612988,"Olivia Brown","https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd",8,"Research & Report","Open, Reliable, and Collective: A Community-Driven Framework for Tool-Using AI Agents","Tool-integrated LLMs can retrieve information, compute results, and take real-world actions, yet their reliability depends not only on tool-use accuracy but also on intrinsic tool accuracy, including correctness, stability, and robustness to change. OPENTOOLS introduces a community-driven, maintainable toolbox that standardizes tool interfaces, converts documented Python functions into reviewable bundles, and supports evidence-based evaluation with risk inspection and optional advisory LLM review. Public demos and MCP enable controlled external access. Community-contributed, task-specific tools deliver 6%–22% gains.","Open, Reliable, and Collective: A Community-Driven Framework for  \nTool-Using AI Agents  \nHy Dang1 , Quang Dao2 , Meng Jiang1 ,  \n1University of Notre Dame, 2Rose-Hulman Institute of Technology,  \n [https://github.com/hydang99/opentools](https://github.com/hydang99/opentools)  \narXiv :2604 .00 137v2 [ cs .AI] 10 Jul 2026  \nAbstract  \nTool-integrated LLMs retrieve information, perform computations, and take real-world actions, but their reliability depends on both tooluse accuracy and intrinsic tool accuracy, including tool correctness, stability, and safety. While prior work primarily emphasizes tool use, intrinsic tool accuracy remains underexamined. We introduce OPENTOOLS1 , a community-driven and maintainable toolbox for discovering, using, evaluating, and contributing open-source tools. OPENTOOLS standardizes tool interfaces, converts documented Python functions into reviewable bundles, supports maintainer-triggered evaluation, and combines non-executing risk inspection with optional advisory LLM review. A public web demo2 allows users to run tools and agents, inspect evidence, contribute tests, and submit tools for maintainer review, while MCP enables controlled access from external applications. Experiments show that community-contributed, task-specific tools yield relative gains of 6% to 22% over an existing toolbox across multiple agent architectures, highlighting the importance of intrinsic tool accuracy. OPENTOOLS is released under the Apache 2.0 license, with a demonstration video at [https://](https://)[ ](https://)[www.youtube.com/watch?v=XhRwATwIBxU](www.youtube.com/watch?v=XhRwATwIBxU).  \n1 Introduction  \nLarge language models (LLMs) have evolved from generative systems into general-purpose agents that can plan, reason, and interact with users over contexts (Grattafiori et al., 2024) . Agentic frameworks support structured reasoning (Yao et al., 2023a ; Li et al., 2024b ; Zhang and Ding, 2024) and selfreflection (Ji et al., 2023 ; Liu et al., 2025), extending LLM capabilities beyond question answering and helping mitigate hallucinations (Yao et al.,  \n1Source Code and Implementation: [https://github](https://github). com/hydang99/opentools  \n2Web Demonstration: [https://huggingface.co/](https://huggingface.co/)[ ](https://huggingface.co/)spaces/opentools/opentools  \n2023a ; Zhang et al., 2024 ; Zhu et al., 2025) . However, token-only generation remains brittle when tasks require current knowledge or interaction with external systems (Paranjape et al., 2023 ; Qin et al., 2023) . Tool-augmented language models (TALMs) address this limitation through retrieval systems (Gao et al., 2023 ; Jin et al., 2025), calculators (Schick et al., 2023), code interpreters (Wang et al., 2024a), and domain APIs (Wu et al., 2025 ; Arlt et al., 2025 ; Jang et al., 2025) . While this delegation improves factuality and supports tasks, it also makes agent reliability dependent on external tools.  \nWe argue that TALM reliability has two failure modes: (i) tool-use accuracy, which concerns selecting and invoking tools correctly, and (ii) intrinsic tool accuracy, which concerns tool correctness, stability, and robustness to drift. Most prior work emphasizes tool learning (Qin et al., 2024 ; Patil et al., 2024) while assuming that tools and their documentation are reliable. In practice, tools can fail because of incomplete coverage, API and dependency changes, nondeterminism, and silent errors. Tool access can also introduce security and credential risks (Winston and Just, 2025 ; Milevet al., 2025) . Maintaining reliable tools therefore requires a shared interface, representative tests, preexecution risk inspection, explicit evaluation states, and interoperable access across agent frameworks.  \nTo address these challenges, we introduce OPENTOOLS, an open-source, community-driven toolbox for tool-integrated LLMs. First, OPENTOOLS standardizes tool schemas and wrappers, while a deterministic converter transforms supported Python functions in","cbCaibXU1u1ho0qU","https://ap.wps.com/l/cbCaibXU1u1ho0qU","pdf",1780473,1,11,"English","en",105,"# Abstract\n# Introduction\n# OPENTOOLS Framework\n## Tool Accuracy and Maintenance Loop\n## Agentic Workflow","[{\"question\":\"What are the two reliability failure modes discussed for tool-augmented language models?\",\"answer\":\"The document identifies (i) tool-use accuracy, covering correct tool selection and invocation, and (ii) intrinsic tool accuracy, covering tool correctness, stability, and robustness to drift.\"},{\"question\":\"How does OPENTOOLS improve tool reliability beyond prior tool-use-focused work?\",\"answer\":\"OPENTOOLS standardizes tool schemas, converts supported Python functions into structured, reviewable bundles, and combines non-executing risk inspection with policy-gated functional evaluation and optional advisory LLM review of sanitized evidence.\"},{\"question\":\"What mechanisms does OPENTOOLS provide for community contribution and external integration?\",\"answer\":\"It offers a public web demo for running tools and agents, inspecting evidence, contributing tests, and submitting tools for maintainer review, and it provides an MCP server for controlled access from external applications.\"}]",1784204488,28,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"open-reliable-and-collective-a-community-driven-framework-for-tool-using-ai-agents","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/open-reliable-and-collective-a-community-driven-framework-for-tool-using-ai-agents/85552/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What are the two reliability failure modes discussed for tool-augmented language models?","Question",{"text":75,"@type":76},"The document identifies (i) tool-use accuracy, covering correct tool selection and invocation, and (ii) intrinsic tool accuracy, covering tool correctness, stability, and robustness to drift.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does OPENTOOLS improve tool reliability beyond prior tool-use-focused work?",{"text":80,"@type":76},"OPENTOOLS standardizes tool schemas, converts supported Python functions into structured, reviewable bundles, and combines non-executing risk inspection with policy-gated functional evaluation and optional advisory LLM review of sanitized evidence.",{"name":82,"@type":73,"acceptedAnswer":83},"What mechanisms does OPENTOOLS provide for community contribution and external integration?",{"text":84,"@type":76},"It offers a public web demo for running tools and agents, inspecting evidence, contributing tests, and submitting tools for maintainer review, and it provides an MCP server for controlled access from external applications.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":45,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":45,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]