[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-83381-en":3,"doc-seo-83381-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},83381,1099514068365,"Aurelia","https://ap-avatar.wpscdn.com/avatar/10000253d8d9f28188e?_k=1776742907772140068",8,"Research & Report","OmniFood-Bench: 评估VLM在营养推理与个性化健康建议中的表现","Rapid integration of large vision-language models (VLMs) into food and healthcare promises more accurate dietary management, yet real systems face systemic information asymmetry between visual appearance and intrinsic nutritional composition. Existing benchmarks mainly test coarse food recognition and miss the full reasoning chain from hidden ingredients to portion mass and safety-critical medical guidance. OmniFood-Bench is built from MM-Food-100K and evaluates progressive abilities: Basic Perception, Quantitative Reasoning, and Safety-Critical Advisory. Experiments on six VLMs reveal a Semantic-Physical Gap, including mass estimation failures and benign hallucinations for high-risk diabetes profiles, establishing a trustworthiness standard for public health agents.","OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice  \nQian Jiang 1 , Zhecheng Shi2 , Jingpu Yang3 , Zirui Song4 , Miao Fang 1*  \n1Northeastern University at Qinhuangdao  \n2The Hong Kong University of Science and Technology (Guangzhou)  \n3BeiHang University  \n4Mohamed bin Zayed University of Artificial Intelligence  \narXiv :2607 .08423v 1 [ cs .AI] 9 Jul 2026  \nAbstract—The rapid integration of Large Vision-Language Models (VLMs) into critical infrastructure promises to revolutionize personalized healthcare and dietary management. However, in the domain of food systems, autonomous agents face a unique and persistent challenge: the “Systemic Information Asymmetry” between visual appearance and intrinsic nutritional composition. Existing benchmarks primarily focus on coarse-grained classification tasks, such as food category recognition, which fail to evaluate the intricate reasoning chain required for real-world dietary management—specifically, the ability to traverse from identifying hidden ingredients to estimating physical mass, and finally synthesizing safety-critical medical advice. In this paper, we introduce OmniFood-Bench, a comprehensive benchmark constructed from the MM-Food- 100K dataset. Unlike previous works, OmniFood-Bench evaluates VLMs across three progressive capabilities: Basic Perception (Ingredients & Cooking Methods), Quantitative Reasoning (Portion Size & Nutritional Profiling), and SafetyCritical Advisory (Disease-Specific Recommendations). We evaluate six state-of-the-art VLMs, including gpt-5.1, gemini-3-flash, and qwen3-vl-8B. Our extensive experiments reveal a startling “Semantic-Physical Gap”: while models achieve nearhuman accuracy in naming dishes, they exhibit catastrophic failure in mass estimation and frequently hallucinate benign advice for high-risk diabetic profiles. This work establishes a rigorous standard for trustworthiness in autonomous agents deployed for public health. The code and datasets are available in:[https://anonymous.4open.science/r/OmniFood-Bench-7D0B](https://anonymous.4open.science/r/OmniFood-Bench-7D0B)  \nIndex Terms—Vision-Language Models, Autonomous Agents, Food Computing, Nutritional Reasoning, Benchmark  \nI. INTRODUCTION  \nIn the era of intelligent media, autonomous agents are increasingly tasked with interpreting high-dimensional multimodal data to assist in complex daily decision-making processes [1] . Among the myriad applications of these agents, AI-driven dietary management holds immense potential for combating the rising global burden of chronic diseases such as obesity, diabetes, and hypertension. [2], [3] A theoretical”AI Dietitian” agent should possess the capability to perceive a meal via a camera, analyze its nutritional composition with clinical precision, and offer personalized advice tailored to the user’s specific physiological state. The realization of such a system would democratize access to personalized nutrition,  \n*Corresponding author: Miao Fang.  \nmoving beyond generic calorie counting to risk-aware health surveillance.  \nHowever, the deployment of such autonomous agents is currently hindered by significant challenges regarding robustness, data trust, and safety [4], [5] . Unlike general object detection tasks where identifying a bounding box suffices,[6] food understanding requires a complex process of Visualto-Physical Inference. An agent must deduce the invisible from the visible: determining whether a dish is deep-fried or steamed (which drastically alters caloric density), estimating the physical mass of a steak from 2D pixels (resolving scale and depth ambiguity), and retrieving domain-specific medical knowledge to warn a diabetic user about potential hidden sugars in a glaze. This creates a ”Systemic Information Asymmetry” where the visual signal alone is often insufficient without robust reasoning and world knowledge.  \nThe stakes in this domain are exceptionally high. In typical vision tasks, a misclassif","cbCaimNMK46K3cWu","https://ap.wps.com/l/cbCaimNMK46K3cWu","pdf",830545,1,7,"English","en",105,"# Introduction\n## Systemic information asymmetry and visual-to-physical inference\n## Risks and need for safety alignment\n## Limitations of existing food benchmarks\n## Proposed progressive evaluation tasks","[{\"question\":\"What core problem does OmniFood-Bench target?\",\"answer\":\"It targets the “Systemic Information Asymmetry” between what food looks like and its intrinsic nutritional composition, which makes visual-only understanding insufficient for health-safe recommendations.\"},{\"question\":\"How does OmniFood-Bench evaluate VLM capabilities?\",\"answer\":\"It uses a progressive pipeline with three capabilities: Basic Perception (ingredients and cooking methods), Quantitative Reasoning (portion size and nutritional profiling), and Safety-Critical Advisory (disease-specific recommendations).\"},{\"question\":\"What major failure pattern do experiments show?\",\"answer\":\"Models show a “Semantic-Physical Gap”: they can name dishes with near-human accuracy but catastrophically fail in mass estimation and may hallucinate benign advice even for high-risk diabetic profiles.\"}]",1784187110,18,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"omnifood-bench-evaluating-vlms-for-nutrient-reasoning-and-personalized-health-advice","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/omnifood-bench-evaluating-vlms-for-nutrient-reasoning-and-personalized-health-advice/83381/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What core problem does OmniFood-Bench target?","Question",{"text":75,"@type":76},"It targets the “Systemic Information Asymmetry” between what food looks like and its intrinsic nutritional composition, which makes visual-only understanding insufficient for health-safe recommendations.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does OmniFood-Bench evaluate VLM capabilities?",{"text":80,"@type":76},"It uses a progressive pipeline with three capabilities: Basic Perception (ingredients and cooking methods), Quantitative Reasoning (portion size and nutritional profiling), and Safety-Critical Advisory (disease-specific recommendations).",{"name":82,"@type":73,"acceptedAnswer":83},"What major failure pattern do experiments show?",{"text":84,"@type":76},"Models show a “Semantic-Physical Gap”: they can name dishes with near-human accuracy but catastrophically fail in mass estimation and may hallucinate benign advice even for high-risk diabetic profiles.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":21,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]