ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine

Domain:

natural language processing

Record type:

papermodel

Creator:

QasHenTan

Host:

Large Language Models (LLMs) have demonstrated remarkable potential in diverse domains, yet their application in the legal sector, particularly in low-resource contexts, remains limited. This study addresses the challenges of adapting LLMs to the Palestinian legal domain, where political instability, fragmented legal frameworks, and limited AI resources hinder effective machine-learning applications. We present a fine-tuned model based on a quantized version of Llama-3.2-1B-Instruct, trained on a synthetic data set derived from Palestinian legal texts. Using smaller-scale models and strategically generated question-answer pairs, we achieve a cost-effective, locally sustainable solution that provides accurate and contextually relevant legal guidance. Our experiments demonstrate promising performance on various query types, ranging from yes/no questions and narrative explanations to complex legal differentiations, while highlighting areas for improvement, such as handling calculation-based inquiries and structured list formatting. This work provides a pathway for the deployment of AI-driven legal assistance tools tailored to the needs of resource-constrained environments.

Visit

arxiv.org

Tasks

language modeling question answering

Youssef9393/Data-Collection-Web-Scrapping-Fine-Tuning-LLMs

Multilingual medical Question-Answering dataset in Darija, French, English, collected through web sc

Fine-Tuning Transformers and LLMs for Fake News Detection in Algerian Dialect

BerkGuny/Sequential-fine-tuning-for-improving-everyday-cultural-knowledge-in-multilingual-LLMs

Developed a two-stage multilingual LLM fine-tuning pipeline that improves culturally grounded questi

Fine-Tuning LLMs for Low-Resource Dialect Translation: The Case of Lebanese

This paper examines the effectiveness of Large Language Models (LLMs) in translating the low-resourc

Fine-tuning LLMs on Intermediate Text Classification for Multilingual Zero-shot Reasoning

Intermediate-task training---fine-tuning a pretrained model on an intermediate task before fine-tuni

Curriculum-Based Sequential Fine-Tuning of XLM-R for Cross-Lingual Figurative Language Understanding

Euphemisms are culturally variable and often ambiguous, posing challenges for language models, espec