Related Experiment Video
Updated: Jun 28, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Overview and Discussion of the Competition on Legal Information, Extraction/Entailment (COLIEE) 2023
Randy Goebel1, Yoshinobu Kano2, Mi-Young Kim3
1Department of Computing Science and Alberta Machine Intelligence Institute, University of Alberta, Edmonton, AB Canada.
Abstract:
We summarize the 10th Competition on Legal Information Extraction and Entailment. In this tenth edition, the competition included four tasks on case law and statute law. The case law component includes an information retrieval task (Task 1), and the confirmation of an entailment relation between an existing case and a selected unseen case (Task 2). The statute law component includes an information retrieval task (Task 3), and an entailment/question-answering task based on retrieved civil code statutes (Task 4). Participation was open to any group based on any approach. Ten different teams participated in the case law competition tasks, most of them in more than one task. We received results from 8 teams for Task 1 (22 runs) and seven teams for Task 2 (18 runs). On the statute law task, there were 9 different teams participating, most in more than one task. 6 teams submitted a total of 16 runs for Task 3, and 9 teams submitted a total of 26 runs for Task 4. We describe the variety of approaches, our official evaluation, and analysis of our data and submission results.
More Related Videos
07:50A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
Published on: September 20, 2018
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
Related Concept Videos
Extraction: Advanced Methods
Sources of Law
Constitutional law is foundational, deriving from federal and state constitutions, and...
Competition
Legal Guidelines for Documentation
Extraction: Partition and Distribution Coefficients
For extracting a solute from an aqueous phase into an...
Law of Independent Assortment