Chinese-Vicuna: A Chinese Instruction-following Llama-based Model
Research paper by Chenghao Fan and collaborators. arXiv record dated 2025-04-17. Research area: Language technology.
Resource information
- Authors
- Chenghao Fan, Zhenyi Lu, Jie Tian
- Research area
- Language technology
- Application domain
- General AI research
- AI methods
- Large language models
- Research topics
- cs.CL
- arXiv record date
- 2025-04-17
- Publication
- arXiv
- Upstream last modified
- Apr 18, 2025
- License
- CC BY 4.0
- Last record update
- Nov 4, 2026
Abstract
Chinese-Vicuna is an open-source, resource-efficient language model designed to bridge the gap in Chinese instruction-following capabilities by fine-tuning Meta's LLaMA architecture using Low-Rank Adaptation (LoRA). Targeting low-resource environments, it enables cost-effective deployment on consumer GPUs (e.g., RTX-2080Ti for 7B models) and supports domain-specific adaptation in fields like healthcare and law. By integrating hybrid datasets (BELLE and Guanaco) and 4-bit quantization (QLoRA), the model achieves competitive performance in tasks such as translation, code generation, and domain-specific Q&A. The project provides a comprehensive toolkit for model conversion, CPU inference, and multi-turn dialogue interfaces, emphasizing accessibility for researchers and developers. Evaluations indicate competitive performance across medical tasks, multi-turn dialogue coherence, and real-time legal updates. Chinese-Vicuna's modular design, open-source ecosystem, and community-driven enhancements position it as a versatile foundation for Chinese LLM applications.
