[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-122923-en":3,"doc-seo-122923-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},122923,137441390410,"Hazel","https://ap-avatar.wpscdn.com/avatar/2000252f4ab5702993?_k=1776741390130283984",8,"Research & Report","Explainable Machine Learning Multi-Label Classification of Spanish Legal Judgements - Hybrid System for Natural-Language Explanations","Artificial Intelligence techniques such as Machine Learning (ML) are not fully exploited in the legal domain due to limited decision explanations. Automatic expert systems with explanatory capabilities can support legal professionals when searching jurisprudence for contextual knowledge. The work proposes a hybrid approach using ML for multi-label classification of judgements (sentences) and visual and natural language descriptions, powered by NLP and deep legal reasoning to identify involved entities. Experiments reach over 85% micro precision on expert-annotated data, reducing labor-intensive classification work.","Explainable machine learning multi-label classification of Spanish legal judgements  \nFrancisco de Arriba-Pérez 1, Silvia García-Méndez ⇑, 1, Francisco J. González-Castaño 1, Jaime González-González 1  \nInformation Technologies Group, atlanTTic, University of Vigo, EI Telecomunicación, Campus Lagoas-Marcosende, Vigo 36310, Spain  \n\n| a r t i c l e i n f o |  | a b s t r a c t |\n| --- | --- | --- |\n| Article history:\u003Cbr>Received 11 August 2022\u003Cbr>Revised 23 September 2022\u003Cbr>Accepted 17 October 2022\u003Cbr>Available online 27 October 2022 |  | Artificial Intelligence techniques such as Machine Learning (ML) have not been exploited to their maximum potential in the legal domain. This has been partially due to the insufficient explanations they provided about their decisions. Automatic expert systems with explanatory capabilities can be specially useful when legal practitioners search jurisprudence to gather contextual knowledge for their cases. Therefore, we propose a hybrid system that applies ML for multi-label classification of judgements (sentences) and visual and natural language descriptions for explanation purposes, boosted by Natural Language Processing techniques and deep legal reasoning to identify the entities, such as the parties, involved. We are not aware of any prior work on automatic multi-label classification of legal judgements also providing natural language explanations to the end-users with comparable overall quality. Our solution achieves over 85% micro precision on a labelled data set annotated by legal experts. This endorses its interest to relieve human experts from monotonous labour-intensive legal classification tasks.\u003Cbr>􀀁 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license ([http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)). |\n| Keyword:\u003Cbr>Machine learning\u003Cbr>Natural language processing Multi-label text classification Interpretability and explainability Legal texts |  |  |\n\n1. Introduction  \nArtificial Intelligence (AI) techniques have not been exploited to their maximum potential in the legal field (Qiu et al., 2020) despite the vast amounts of judgements (sentences) that lawyers must review (Zhou et al., 2022). For example, between 2013 and 2016, the number of cases in the Spanish legal system increased by 141%2. Thus, automatic legal data analytics deserve attention to improve its productiveness.  \nThis type of analysis must rely on existing legal databases (Csányi et al., 2022), which organise judgements by jurisdictions. These databases are helpful as contextual information when legal practitioners such as lawyers, barristers and solicitors look for similar court decisions. However, human-conducted identification tends to be biased by personal points of view and this is exacerbated by the different styles of legal writing and lack of a unified formal structure (Csányi et al., 2022).  \nNowadays, many industrial sectors take advantage of the mostrecent advances in Natural Language Processing (NLP) techniques  \n⇑ Corresponding author.  \nE-mail address: [sgarcia@gti.uvigo.es](sgarcia@gti.uvigo.es) (S. García-Méndez).  \n1 These authors contributed equally to this work.  \n2 Available at [https://www.poderjudicial.es/cgpj/es/Poder-Judicial/Tribunal](https://www.poderjudicial.es/cgpj/es/Poder-Judicial/Tribunal)Supremo/Portal-de-Transparencia/Te-puede-interesar—/Estadisticas-, August 2022.  \nand Machine Learning (ML) algorithms (Oussous et al., 2018; Tanget al., 2020; Roh et al., 2021), and the legal field is no exception, for example for summarisation (Kanapala et al., 2019) and anonymisation (Di Martino et al., 2021) purposes. Previous work has already addressed multi-label legal document classification (Song et al., 2022). However, there are few freely accessible annotated data sets, their quality is often low, and they tend to be either over-or under-inclusive. This is the c","cbCaieB3kl8n0KgV","https://ap.wps.com/l/cbCaieB3kl8n0KgV","pdf",2379037,1,13,"English","en",105,"# Introduction\n## Legal data analytics and limitations of human identification\n## Natural language processing and machine learning in legal tasks\n# Multi-label classification for legal judgements\n## Rationale: multiple law categories per judgement\n## Challenges: imbalance and feature engineering\n# Proposed explainable hybrid system\n## Entity detection for deep legal reasoning","[{\"question\":\"Why do machine learning methods need explainability in the legal domain?\",\"answer\":\"Legal practitioners require understandable reasons for decisions when using models. Limited explanations reduce trust and practical usefulness in jurisprudence exploration and legal case support.\"},{\"question\":\"What problem does the proposed hybrid system address?\",\"answer\":\"It performs multi-label classification of legal judgements and generates natural-language and visual explanations. The method uses NLP and deep legal reasoning to identify relevant entities such as the parties involved.\"},{\"question\":\"How is the approach evaluated and what performance is reported?\",\"answer\":\"Evaluation uses a labeled dataset annotated by legal experts. The system achieves over 85% micro precision, demonstrating strong overall quality and potential to reduce manual, labor-intensive classification work.\"}]","Explainable Machine Learning Multi-Label Classification of Spanish Legal Judgements - Hybrid System for Natural-Language Explanations | PDF",1785813699,33,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"explainable-machine-learning-multi-label-classification-of-spanish-legal-judgements-hybrid-system-for-natural-language-explanations","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/explainable-machine-learning-multi-label-classification-of-spanish-legal-judgements-hybrid-system-for-natural-language-explanations/122923/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why do machine learning methods need explainability in the legal domain?","Question",{"text":75,"@type":76},"Legal practitioners require understandable reasons for decisions when using models. Limited explanations reduce trust and practical usefulness in jurisprudence exploration and legal case support.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What problem does the proposed hybrid system address?",{"text":80,"@type":76},"It performs multi-label classification of legal judgements and generates natural-language and visual explanations. The method uses NLP and deep legal reasoning to identify relevant entities such as the parties involved.",{"name":82,"@type":73,"acceptedAnswer":83},"How is the approach evaluated and what performance is reported?",{"text":84,"@type":76},"Evaluation uses a labeled dataset annotated by legal experts. The system achieves over 85% micro precision, demonstrating strong overall quality and potential to reduce manual, labor-intensive classification work.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]