!MSA at AraHealthQA 2025 Shared Task: Enhancing LLM Performance for Arabic Clinical Question Answering through Prompt Engineering and Ensemble Learning
Research paper by Mohamed Tarek and collaborators. arXiv record dated 2025-09-14. Research area: Language technology.
Resource information
- Authors
- Mohamed Tarek, Seif Ahmed, Mohamed Basem
- Research area
- Language technology
- Application domain
- Healthcare
- AI methods
- Large language models
- Research topics
- cs.CL
- arXiv record date
- 2025-09-14
- Publication
- arXiv
- Upstream last modified
- Sep 16, 2025
- Last record update
- Nov 4, 2026
Abstract
We present our systems for Track 2 (General Arabic Health QA, MedArabiQ) of the AraHealthQA-2025 shared task, where our methodology secured 2nd place in both Sub-Task 1 (multiple-choice question answering) and Sub-Task 2 (open-ended question answering) in Arabic clinical contexts. For Sub-Task 1, we leverage the Gemini 2.5 Flash model with few-shot prompting, dataset preprocessing, and an ensemble of three prompt configurations to improve classification accuracy on standard, biased, and fill-in-the-blank questions. For Sub-Task 2, we employ a unified prompt with the same model, incorporating role-playing as an Arabic medical expert, few-shot examples, and post-processing to generate concise responses across fill-in-the-blank, patient-doctor Q&A, GEC, and paraphrased variants.