Javascript must be enabled to continue!
Agentic Legal Intake: A Multi-Agent Framework For Hallucination-Free, Audit-Ready AI Screening In Mass-Tort Litigation
View through CrossRef
This study presents a multi-agent framework to address the risks of large language models (LLMs) in legal intake, particularly in mass tort litigation. The research focuses on mitigating a phenomenon known as hallucination, where LLMs generate plausible but false information. The study's objective is to evaluate if a system of peer-auditing agents, along with human involvement, can outperform a traditional single-agent model in terms of accuracy, data completeness, and audit efficiency. The methodology involved a mixed-methods design, using a multi-agent system with distinct Extractor, Validator, and Auditor agents, followed by human review. This system was tested on 100 anonymized mass tort intake cases, with 70% being real and 30% being synthetic. The quantitative metrics measured were hallucination rate, completeness score, and human review time. Qualitative analysis was also performed, based on feedback from six legal operations professionals. The multi-agent framework demonstrated a substantial reductionin the hallucination rate, from 21% in the single-agent baseline to just 5%, a 76% decrease. It also significantly improved data completeness, achieving a 92% score compared to 74% in the baseline, which is an 18 percentage point increase. Furthermore, the time required for human review of finalized cases dropped by 51%. Qualitative feedback from professionals highlighted increased trust and transparency in the agent-generated outputs due to the built-in audit trails. However, some noted issues with precision. In conclusion, the findings confirm that a structured multi-agent LLM framework is a highly effective way to improve the reliability and efficiency of legal intake workflows. By mimicking human peer-review processes, this agentic approach transforms AI into a transparent and accountable augmentation tool. This study emphasizes that agentic AI is accountable augmentation, paving the way for explainable and scalable legal AI systems.
Emerging Innovations Society: Science, Technology, and Social Studies
Title: Agentic Legal Intake: A Multi-Agent Framework For Hallucination-Free, Audit-Ready AI Screening In Mass-Tort Litigation
Description:
This study presents a multi-agent framework to address the risks of large language models (LLMs) in legal intake, particularly in mass tort litigation.
The research focuses on mitigating a phenomenon known as hallucination, where LLMs generate plausible but false information.
The study's objective is to evaluate if a system of peer-auditing agents, along with human involvement, can outperform a traditional single-agent model in terms of accuracy, data completeness, and audit efficiency.
The methodology involved a mixed-methods design, using a multi-agent system with distinct Extractor, Validator, and Auditor agents, followed by human review.
This system was tested on 100 anonymized mass tort intake cases, with 70% being real and 30% being synthetic.
The quantitative metrics measured were hallucination rate, completeness score, and human review time.
Qualitative analysis was also performed, based on feedback from six legal operations professionals.
The multi-agent framework demonstrated a substantial reductionin the hallucination rate, from 21% in the single-agent baseline to just 5%, a 76% decrease.
It also significantly improved data completeness, achieving a 92% score compared to 74% in the baseline, which is an 18 percentage point increase.
Furthermore, the time required for human review of finalized cases dropped by 51%.
Qualitative feedback from professionals highlighted increased trust and transparency in the agent-generated outputs due to the built-in audit trails.
However, some noted issues with precision.
In conclusion, the findings confirm that a structured multi-agent LLM framework is a highly effective way to improve the reliability and efficiency of legal intake workflows.
By mimicking human peer-review processes, this agentic approach transforms AI into a transparent and accountable augmentation tool.
This study emphasizes that agentic AI is accountable augmentation, paving the way for explainable and scalable legal AI systems.
Related Results
Paper K-9 Pelaporan Hasil Audit dan Tindak Lanjut Audit Internal
Paper K-9 Pelaporan Hasil Audit dan Tindak Lanjut Audit Internal
Pelaporan hasil audit merupakan komponen utama dalam komunikasi dari audit internal tentang hasil audit. Untuk mengkomunikasikan hasil audit diperlukan susunan laporan, dimana hasi...
DETERMINAN FEE AUDIT
DETERMINAN FEE AUDIT
ABSTRACT This study aims to examine the factors that affect audit fees. Factors examined include factors derived from the entity (client) and the factors derived from the auditor....
Sebuah Jurnal Audit Audit Plan, Audit Program dan Audit Prosedur Pada Harta, Utang dan Modal
Sebuah Jurnal Audit Audit Plan, Audit Program dan Audit Prosedur Pada Harta, Utang dan Modal
Tujuan penelitian ini adalah untuk mengetahui bagaimana proses dan prosedur audit plan, audit program dan audit prosedur pada harta, utang dan modal. Penelitian ini juga dimaksudka...
Literature Review Pengaruh Audit Fee, Audit Tenure, Rotasi Audit, Audit Delay, Dan Komite Audit Terhadap Kualitas Audit
Literature Review Pengaruh Audit Fee, Audit Tenure, Rotasi Audit, Audit Delay, Dan Komite Audit Terhadap Kualitas Audit
Masih terdapat hasil audit yang kurang berkualitas dilihat dari kasus-kasus keuangan terdahulu yang melibatkan akuntan publik. Artikel ini mereview faktor-faktor yang mempengaruhi ...
THE ROLE OF AUDIT ROTATION, AUDIT COMMITTEE OVERSIGHT, AUDIT CAPACITY STRESS, AND AUDIT TENURE IN DETERMINING AUDIT QUALITY
THE ROLE OF AUDIT ROTATION, AUDIT COMMITTEE OVERSIGHT, AUDIT CAPACITY STRESS, AND AUDIT TENURE IN DETERMINING AUDIT QUALITY
Abstract— The quality of audits is a crucial factor determining the credibility of financial reporting. This research aims to explore the determinants that impact audit quality for...
PENGARUH AUDIT TENURE, UKURAN PERUSAHAAN, AUDIT DELAY, KOMITE AUDIT, DAN ROTASI AUDIT TERHADAP KUALITAS AUDIT
PENGARUH AUDIT TENURE, UKURAN PERUSAHAAN, AUDIT DELAY, KOMITE AUDIT, DAN ROTASI AUDIT TERHADAP KUALITAS AUDIT
Penelitian ini bertujuan untuk menganalisis faktor-faktor yang mempengaruhi kualitas audit pada perusahaan sektor keuangan yang terdaftar di Bursa Efek Indonesia, dengan fokus pada...
Abnormal audit fees and accrual and real earnings management: evidence from UK
Abnormal audit fees and accrual and real earnings management: evidence from UK
Purpose
This paper aims to examine the relationship between abnormal audit fees and accrual-based and real-based earnings management by using a sample of 1,055 UK...
AUDIT SERVICES MARKET IN UKRAINE
AUDIT SERVICES MARKET IN UKRAINE
Background. Trends in the open economy, the processes of information globalization require the search for new effective tools of trust of the state, public oversight bodies, inves...

