Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021-Reference-Cited by-同舟云学术

Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021

Published:2022-02-15 Issue:1 Volume:16 Page:111-133
ISSN:2523-3173
Container-title:The Review of Socionetwork Strategies
language:en
Short-container-title:Rev Socionetwork Strat

Author:

Rabelo Juliano^ORCID,Goebel Randy,Kim Mi-Young,Kano Yoshinobu,Yoshioka Masaharu,Satoh Ken

Abstract

AbstractWe summarize the 8th Competition on Legal Information Extraction and Entailment. In this edition, the competition included five tasks on case law and statute law. The case law component includes an information retrieval Task (Task 1), and the confirmation of an entailment relation between an existing case and an unseen case (Task 2). The statute law component includes an information retrieval Task (Task 3), an entailment/question answering task based on retrieved civil code statutes (Task 4) and an entailment/question answering task without retrieved civil code statutes (Task 5). Participation was open to any group based on any approach. Eight different teams participated in the case law competition tasks, most of them in more than one task. We received results from six teams for Task 1 (16 runs) and 6 teams for Task 2 (17 runs). On the statute law task, there were eight different teams participating, most in more than one task. Six teams submitted a total of 18 runs for Task 3, 6 teams submitted a total of 18 runs for Task 4, and 4 teams submitted a total of 12 runs for Task 5. Here we summarize the approaches, our official evaluation, and analysis on our data and submission results.

Publisher

Springer Science and Business Media LLC

Link

https://link.springer.com/content/pdf/10.1007/s12626-022-00105-z.pdf

Reference27 articles.

1. Althammer, S., Askari, A., Verberne, S., & Hanbury, A. (2021). Dossier@coliee 2021: Leveraging dense retrieval and summarization-based re-ranking for case law retrieval. In: Proceedings of the COLIEE Workshop in ICAIL.

2. Banerjee, P., & Han, H. (2009). Language modeling approaches to information retrieval. JCSE, 3, 143–164. https://doi.org/10.5626/JCSE.2009.3.3.143.

3. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., & Amodei, D. (2020). Language models are few-shot learners.

4. Clark, K., Luong, M.T., Le, Q.V., & Manning, C.D. (2020). Electra: Pre-training text encoders as discriminators rather than generators. CoRR. http://arxiv.org/abs/1910.10683

5. Devlin, J., Chang, M., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. CoRR. http://arxiv.org/abs/1810.04805

Cited by 31 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Textual similarity for legal precedents discovery: Assessing the performance of machine learning techniques in an administrative court;International Journal of Information Management Data Insights;2024-11

2. An entity-centric approach to manage court judgments based on Natural Language Processing;Computer Law & Security Review;2024-04

3. Enforcing legal information extraction through context-aware techniques: The ASKE approach;Computer Law & Security Review;2024-04

4. Contribution Analysis of Large Language Models and Data Augmentations for Person Names in Solving Legal Bar Examination at COLIEE 2023;The Review of Socionetwork Strategies;2024-03-08

5. NOWJ at COLIEE 2023: Multi-task and Ensemble Approaches in Legal Information Processing;The Review of Socionetwork Strategies;2024-02-22