FiLLM -- A Filipino-optimized Large Language Model based on Southeast Asia Large Language Model (SEALLM)
Research paper by Carlos Jude G. Maminta and collaborators. arXiv record dated 2025-05-25. Research area: Language technology.
Resource information
- Authors
- Carlos Jude G. Maminta, Isaiah Job Enriquez, Deandre Nigel Nunez, Michael B. Dela Fuente
- Research area
- Language technology
- Application domain
- General AI research
- AI methods
- Large language models, Natural language processing
- Research topics
- cs.CL, cs.AI
- arXiv record date
- 2025-05-25
- Publication
- arXiv
- Upstream last modified
- May 27, 2025
- License
- CC BY 4.0
- Last record update
- Nov 3, 2026
Abstract
This study presents FiLLM, a Filipino-optimized large language model, designed to enhance natural language processing (NLP) capabilities in the Filipino language. Built upon the SeaLLM-7B 2.5 model, FiLLM leverages Low-Rank Adaptation (LoRA) fine-tuning to optimize memory efficiency while maintaining task-specific performance. The model was trained and evaluated on diverse Filipino datasets to address key NLP tasks, including Named Entity Recognition (NER), Part-of-Speech (POS) tagging, Dependency Parsing, and Text Summarization. Performance comparisons with the CalamanCy model were conducted using F1 Score, Precision, Recall, Compression Rate, and Keyword Overlap metrics. Results indicate that Calamancy outperforms FILLM in several aspects, demonstrating its effectiveness in processing Filipino text with improved linguistic comprehension and adaptability. This research contributes to the advancement of Filipino NLP applications by providing an optimized, efficient, and scalable language model tailored for local linguistic needs.