Awesome Legal NLP

repository·master·Indexed 43 days ago

https://github.com/maastrichtlawtech/awesome-legal-nlp

A curated list of resources for Legal Natural Language Processing (Legal NLP), featuring datasets for judgement prediction, text classification, information retrieval, question answering, textual entailment, and summarization. Includes legal language modeling corpora, benchmarks like LexGLUE and FairLex, pre-trained models such as LEGAL-BERT and Legal LLaMA, evaluation frameworks, and a directory of academic conferences and workshops.

Tokens
2.7K
Snippets
1
Records
11
Agent score
6%

What's inside Awesome Legal NLP

  1. Evaluate Legal NLP models and embeddings

    master

    To benchmark and assess the quality of legal NLP models, use the following tools and frameworks:

    Embedding Benchmarking:

    • MTEB (Massive Text Embedding Benchmark)
    • Hugging Face evaluate
    • LegalBench
    • COLIEE (Competition on Legal Information Extraction/Entailment)

    Argument Mining:

    • RMU:ECHR corpus and mining models for legal argument mining.

    Quality and Fairness Assessment:

    • LegalEval-Q: Evaluates the quality of LLM-generated legal text.
    • FairLex Evaluation: Assesses bias and fairness in legal models.
  2. Explore Legal Judgement Prediction (LJP) datasets

    master

    Legal Judgement Prediction (LJP) datasets are used to train models to predict the outcomes or directions of court decisions. Available datasets include:

    • FSCS: Swiss court judgments (German, French, Italian).
    • ECtHR: EU court judgments (English).
    • ECHR: EU court judgments (English).
    • CAIL: Chinese court judgements (Chinese).
    • AnnoCaseLaw: US Appeals Court negligence cases (English).
    • IndianBailJudgments-1200: Indian court bail decisions (English).
    • CaseSumm: US Supreme Court opinions (English).
    • JUSTICE: US Supreme Court cases (English).
    • Cambridge Law Corpus (CLC): UK court cases (English).
    • Super-SCOTUS: US Supreme Court decisions (English).
  3. Explore Legal Text Classification (LTC) datasets

    master

    Legal Text Classification (LTC) datasets are used for categorizing legal documents, contracts, or legislation. Key datasets include:

    • GLC: Greek legislation (Greek).
    • CUAD: Contracts (English).
    • MultiEURLEX: EU legislation (Multilingual: English, German, French, Italian, Spanish, etc.).
    • LEDGAR: Contracts (English).
    • Contract Discovery: Contracts (English).
    • EURLEX-57K: EU legislation (English).
    • Unfair-ToS: Contracts (English).
    • Contract Elements: Contracts (English).
    • OPP-115: Privacy laws (English).
    • FairLex: Multi-jurisdictional legal texts (English, German, French, Italian, Chinese).
    • Legal Case Document Summarization (Kaggle): Legal case summaries.
    • Legal Citation Text Classification Dataset (Kaggle): General legal documents (English).
  4. Explore Legal Question Answering (LQA) datasets

    master

    Legal Question Answering (LQA) datasets are designed for models that answer specific questions based on legal texts. Key datasets include:

    • CaseHOLD: US case holdings (English).
    • JEC-QA: Chinese law (Chinese).
    • CJRC: Chinese court judgements (Chinese).
    • PrivacyQA: Privacy policies (English).
    • LLeQA: French-Belgian statutes (French).
    • IndicLegalQA: Indian Supreme Court judgments (English).
    • GerLayQA: German civil law (German).
    • LEGAL-UQA: Legal questions (Urdu, English).
  5. Find Legal NLP conferences and workshops

    master

    Stay updated with the latest research through these recurring academic and industry events:

    Academic Workshops & Conferences:

    • NLLP (Natural Legal Language Processing Workshop)
    • ICAIL (International Conference on Artificial Intelligence and Law)
    • JURIX (International Conference on Legal Knowledge and Information Systems)
    • XAILA (EXplainable AI in Law Workshop)
    • JURISIN (International Workshop on Juris-informatics)
    • COLIEE (Competition on Legal Information Extraction/Entailment)
    • RegNLP (Regulatory Natural Language Processing Workshop)
    • MWAiL (Multilingual Workshop on AI & Law Research)

    Industry Events:

    • AI Legal Summit
    • Legal AI Conferences Online Platform
  6. Explore Legal Language Modeling (LLM) datasets

    master

    Legal Language Modeling (LLM) datasets provide large-scale corpora for pre-training legal language models. Key datasets include:

    • Pile of Law: Large corpus of legal and administrative text (English).
    • MultiLegalPile: Multilingual legal corpus from 17 jurisdictions (Multilingual).
  7. Explore Legal NLP Benchmarks

    master

    Benchmarks are used to evaluate the performance of legal NLP models across multiple tasks. Key benchmarks include:

    • FairLex: Evaluates Classification and Legal Judgement Prediction (English, German, French, Italian, Chinese).
    • LexGLUE: Evaluates Classification and Multiple-choice QA (English).
  8. Explore Legal Information Retrieval (LIR) datasets

    master

    Legal Information Retrieval (LIR) datasets focus on finding relevant legal documents or statutes based on queries. Key datasets include:

    • BSARD: Belgian legislation (French).
    • EU2UK: EU & UK legislation (English).
    • UK2EU: EU & UK legislation (English).
    • COLIEE-Case-Law-Retrieval: Canadian precedents (English).
    • COLIEE-Statute-Law-Retrieval: Japanese legislation (English, Japanese).
    • CAIL2019-SCM: Chinese court judgements (Chinese).
    • CLERC: Legal case retrieval (English).
    • LEAD: Legal case retrieval (Various).
    • Legal IR Philippines: Philippine legal documents (English).
  9. Explore Legal NLP Models

    master

    The repository maintains a curated list of pre-trained models specifically adapted for the legal domain. These models vary by language (e.g., Hebrew, English, Italian, French, Chinese), size, and architecture (e.g., BERT, RoBERTa, Longformer, LLaMA).

    Key model categories include:

    • Domain-specific BERTs: Such as LEGAL-BERT, JuriBERT, and Italian-LEGAL-BERT.
    • Large Language Models (LLMs): Such as LEGAL-GPT and Legal LLaMA.
    • Multilingual/Multijurisdictional: Such as MultiLegalPile Models and FairLex Domain Models.
    • Task-specific: Such as LegalCore Models for event coreference resolution.
    | Model | Links | Language | Size |
    |---|---|---|---|
    | Legal-HeBERT (Chriqui et al., 2022) | [📄](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4147127) [🤗](https://huggingface.co/avichr/Legal-heBERT) [💻](https://github.com/avichaychriqui/Legal-HeBERT) | 🇮🇱 | 110M |
    | PoL-BERT-Large (Henderson et al., 2022) | [📄](https://arxiv.org/abs/2207.00220) [🤗](https://huggingface.co/pile-of-law/legalbert-large-1.7M-1) [💻](https://github.com/Breakend/PileOfLaw) | 🇬🇧 | 336M |
    | Italian-LEGAL-BERT (Licari and Comande, 2022) | [📄](https://ceur-ws.org/Vol-3256/km4law3.pdf) [🤗](https://huggingface.co/dlicari/Italian-Legal-BERT)| 🇮🇹 | 110M |
    | JuriBERT (Douka et al., 2021) | [📄](https://arxiv.org/abs/2110.01485) [💾](http://master2-bigdata.polytechnique.fr/resources#juribert) | 🇫🇷  | {6M, 15M, 42M, 110M} |
    | Custom-LEGAL-BERT (Zheng et al., 2021) | [📄](https://arxiv.org/abs/2104.08671) [🤗](https://huggingface.co/zlucia/custom-legalbert) [💻](https://github.com/reglab/casehold) | 🇬🇧  | 110M |
    | LEGAL-BERT (Chalkidis et al., 2020) | [📄](https://arxiv.org/abs/2010.02559) [🤗](https://huggingface.co/nlpaueb/legal-bert-base-uncased) | 🇬🇧  | {35M, 110M} |
    | LEGAL-GPT-{1,2} (Borchmann et al., 2020) | [📄](https://arxiv.org/abs/1911.03911) [💻](https://github.com/applicaai/contract-discovery) | 🇬🇧  | {117M, 1.5B} |
    | MultiLegalPile Models (2024-2025) | [📄](https://reglab.stanford.edu/publications/multilegalpile/) [🤗](https://huggingface.co/collections/joelniklaus/multilegalpile-datasets-6535db705f5e918bdc17ecc7) | 🌍 | RoBERTa (multilingual + 24 monolingual), Longformer |
    | Legal-BERT Fine-tuned (2024) | [📄](https://towardsai.net/p/artificial-intelligence/fine-tuning-legal-bert-llms-for-automated-legal-text-classification) | 🇬🇧 | Domain-adapted classification models |
    | LegalCore Models (2025) | [📄](https://aclanthology.org/2025.findings-acl.1284.pdf) | 🌍 | Event coreference resolution for legal texts |
    | Legal LLaMA (2025) | [📄](https://arxiv.org/abs/2305.15062) | 🇨🇳 | Chinese legal domain adaptations |
    | FairLex Domain Models (2024-2025) | [🤗](https://huggingface.co/collections/coastalcph/legal-nlp-683ffd107b0dc24048c449ae) | 🌍 | Domain-specific BERT models for 4 jurisdictions |
  10. Explore Legal Text Summarization (LTS) datasets

    master

    Legal Text Summarization (LTS) datasets provide pairs of legal documents and their corresponding summaries. Key datasets include:

    • UK-Abs: UK court cases (English).
    • IN-Abs: Indian court cases (English).
    • IN-Ext: Indian court cases (English).
    • TOS;DR: Terms of service (English).
    • BillSum: US Congressional bills (English).
    • TL;DRLegal: Terms of service (English).
    • BVA Cases: US court cases (English).
    • LCR: Australian court cases (English).
    • EurLexSummarization: EU legislation (Multilingual: 24 languages).
    • Multi-LexSum: Legal documents (English).
    • CaseSumm: US Supreme Court opinions (English).
  11. Explore Legal Textual Entailment (LTE) datasets

    master

    Legal Textual Entailment (LTE) datasets involve reasoning tasks where a model determines if one legal statement entails another. Key datasets include:

    • COLIEE-Case-Law-Entailment: Canadian precedents (English).
    • COLIEE-Statute-Law-Entailment: Japanese legislation (English, Japanese).
    • LAR-ECHR: European Court of Human Rights (English).
    • δ-Stance: US legal argumentation (English).