[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-166496-en":3,"doc-seo-166496-105":30,"detail-sidebar-cat-1-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":11,"category_id":12,"category_name":13,"doc_title":14,"doc_description":15,"doc_content":16,"file_id":17,"file_url":18,"file_type":19,"file_size":20,"view_count":4,"is_deleted":4,"is_public":11,"is_downloadable":11,"audit_status":11,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":15,"update_tm":28,"read_time":29},166496,962084928432,"Maya Linwood","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",1,17,"Forms","AI Systems Evaluation Tool 2.0 - Exhibit B - AI Systems Governance Risk Assessment Framework（Narrative）","AI Systems Evaluation Tool 2.0 provides optional exhibit questionnaires and frameworks for state regulators to identify, assess, and govern risks related to insurers’ use of artificial intelligence and machine learning. The materials support ongoing risk identification that covers both financial and consumer risks, while emphasizing adequate oversight, effective controls, and compliance with relevant laws. Exhibit B (Narrative) collects the company’s AI governance framework, including risk identification, mitigation, internal controls, third-party reliance, human-in-the-loop supervision, and information integrity for financial reporting.","Artificial Intelligence Systems Evaluations\nOptional Supplemental Exhibits for State Regulators\nBackground:\nThe rapid expansion of big data and adoption of Artificial Intelligence and Machine Learning (AI systems) is significantly transforming insurance practices. These technologies can offer substantial benefits to both insurance companies and consumers by facilitating the development of innovative products, improving customer interface and enhancing service, simplifying and automating processes, and promoting efficiency and accuracy. However, without robust governance and effective controls, the use of AI systems may lead to adverse consumer outcomes unintended consumer harm or compromise the financial soundness of an insurance company. Insurers are responsible for managing the risks associated with the development and implementation of AI systems and must demonstrate to regulators that adequate oversight mechanisms are in place and are functioning effectively.\nIntent:\nThe NAIC’s Innovation, Cybersecurity and Technology (H) Committee charged the Big Data and AI Working Group (BDAIWG) to create tool(s) that would enable regulators to identify and assess AI systems’ related risks on an on-going basis with a scope that considers both financial and consumer risks evolving specifically from company’s use of AI systems to the extent such risks can be parsed from the comprehensive structure.\nThis document and related tools are designed to supplement existing market conduct, product review, form filing, financial analysis, and financial examination review procedures. As this tool supplements existing NAIC resources, regulators should continue to consider existing NAIC resources as authoritative but may consider drawing from this tool to assist in understanding and assessing a company’s use of AI systems.\nThese optional exhibits allow regulators to determine the extent of AI systems usage for a company and whether additional analysis is needed focusing on financial and consumer risk.\nSections of the Tool include:\nExhibit A: Quantify Regulated Entity’s Use of AI Systems\nExhibit B: AI Systems Governance Risk Assessment Framework (Two Options: Narrative or Checklist)\nExhibit C: AI Systems High-Risk Model Details\nExhibit D: AI Systems Model Data Details\n\u000f\nInstructions:\nInformation obtained from the Exhibit submission may supplementing guidance and tools used during an existing market conduct, product review, form filing, financial analysis, and financial examination review, may to enhance the regulator’s understanding of the AI systems utilization and assessment of risk across an insurance company in performing the analysis and examination reviews. The pace of innovation will vary, and the insurers’ AI philosophy is to be contemplated when considering the frequency of updates which may vary from an annual to a quarterly basis as risk assessment warrants. Effective assessment requires regulators to maintain a fluent understanding and application of the applicable laws including those pertaining to unfair trade practices, confidentiality, and financial reporting.\nRegulators using the tool may wish to first use Exhibit A and based on the information provided, determine if further inquiry is necessary. It may be possible that company responses indicate that while the company responding is using AI, its use of AI is so limited or low in inherent risk as to not require further inquiry as contemplated by subsequent exhibits.\nIf information requested through the tool has already been provided to this department or any other state department of insurance, the company’s response should so state and reference when and how the information was provided.\nThe tool responses will be considered by regulators when identifying the inherent risks of the insurer. They should also affect the planned examination or inquiry approach, as well as the nature, timing and extent of any further procedures performed.\nMateriality and Risk Assessment\nExhibit C of this t","cbCaikaAQNlKrl3F","https://ap.wps.com/l/cbCaikaAQNlKrl3F","docx",122234,19,"English","en",105,"# Background\n# Intent\n# Sections of the Tool\n## Exhibit B: AI Systems Governance Risk Assessment Framework (Two Options: Narrative or Checklist)\n## Instructions\n### Company Instructions\n### Regulator Instructions\n# Materiality and Risk Assessment\n# Confidentiality\n# Which Exhibit to Use?","[{\"question\":\"What is Exhibit B (Narrative) designed to collect from an insurer?\",\"answer\":\"It is designed to obtain the insurer’s AI governance framework, including risk identification, mitigation, management, internal controls, and the process for acquiring, using, or relying on third-party AI systems and data.\"},{\"question\":\"How should regulators decide whether additional inquiry is needed after using the tool?\",\"answer\":\"Regulators should begin with Exhibit A and use the information provided to determine whether further inquiry is necessary, especially when company responses indicate low or limited inherent risk.\"},{\"question\":\"What governance topics are covered in Exhibit B (Narrative)?\",\"answer\":\"Exhibit B focuses on risk identification and classification, mitigation for adverse consumer outcomes, development of models, human-in-the-loop supervision, and efforts to maintain compliance and the integrity of financial reporting and control integrity.\"}]","AI Systems Evaluation Tool 2.0 - Exhibit B - AI Systems Governance Risk Assessment Framework（Narrative） | DOCX",1788194002,7,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":14,"keywords":34,"description":15,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"ai-systems-evaluation-tool-20-exhibit-b-ai-systems-governance-risk-assessment-framework-narrative","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":11},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/template/","Template",2,{"item":49,"name":13,"@type":43,"position":50},"https://docshare.wps.com/template/forms/",3,{"item":52,"name":14,"@type":43,"position":53},"https://docshare.wps.com/template/ai-systems-evaluation-tool-20-exhibit-b-ai-systems-governance-risk-assessment-framework-narrative/166496/",4,{"url":52,"name":14,"@type":55,"author":56,"headline":14,"publisher":58,"fileFormat":61,"inLanguage":23,"description":15,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/vnd.openxmlformats-officedocument.wordprocessingml.document","2026-08-31",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is Exhibit B (Narrative) designed to collect from an insurer?","Question",{"text":75,"@type":76},"It is designed to obtain the insurer’s AI governance framework, including risk identification, mitigation, management, internal controls, and the process for acquiring, using, or relying on third-party AI systems and data.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How should regulators decide whether additional inquiry is needed after using the tool?",{"text":80,"@type":76},"Regulators should begin with Exhibit A and use the information provided to determine whether further inquiry is necessary, especially when company responses indicate low or limited inherent risk.",{"name":82,"@type":73,"acceptedAnswer":83},"What governance topics are covered in Exhibit B (Narrative)?",{"text":84,"@type":76},"Exhibit B focuses on risk identification and classification, mitigation for adverse consumer outcomes, development of models, human-in-the-loop supervision, and efforts to maintain compliance and the integrity of financial reporting and control integrity.","https://schema.org",{"og:url":52,"og:type":87,"og:title":14,"og:site_name":59,"og:description":15},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,98,103,108,113,118,121,126,131],{"id":94,"doc_module":11,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},11,"Presentations",90,"presentations",{"id":99,"doc_module":11,"doc_module_name":46,"category_name":100,"show_sort_weight":101,"slug":102},12,"Resumes",80,"resumes",{"id":104,"doc_module":11,"doc_module_name":46,"category_name":105,"show_sort_weight":106,"slug":107},14,"Invoices",70,"invoices",{"id":109,"doc_module":11,"doc_module_name":46,"category_name":110,"show_sort_weight":111,"slug":112},15,"Posters",60,"posters",{"id":114,"doc_module":11,"doc_module_name":46,"category_name":115,"show_sort_weight":116,"slug":117},16,"Social Media",50,"social-media",{"id":12,"doc_module":11,"doc_module_name":46,"category_name":13,"show_sort_weight":119,"slug":120},40,"forms",{"id":122,"doc_module":11,"doc_module_name":46,"category_name":123,"show_sort_weight":124,"slug":125},18,"Letters",30,"letters",{"id":127,"doc_module":11,"doc_module_name":46,"category_name":128,"show_sort_weight":129,"slug":130},21,"Paper Templates",5,"papers-templates",{"id":132,"doc_module":11,"doc_module_name":46,"category_name":133,"show_sort_weight":4,"slug":134},158,"General","general-158"]