5,527,005 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Chinese-Vicuna: A Chinese Instruction-following Llama-based Model

Research paper by Chenghao Fan and collaborators. arXiv record dated 2025-04-17. Research area: Language technology.

Resource information

Authors
Chenghao Fan, Zhenyi Lu, Jie Tian
Research area
Language technology
Application domain
General AI research
AI methods
Large language models
Research topics
cs.CL
arXiv record date
2025-04-17
Publication
arXiv
Upstream last modified
Apr 18, 2025
License
CC BY 4.0
Last record update
Nov 4, 2026

Abstract

Chinese-Vicuna is an open-source, resource-efficient language model designed to bridge the gap in Chinese instruction-following capabilities by fine-tuning Meta's LLaMA architecture using Low-Rank Adaptation (LoRA). Targeting low-resource environments, it enables cost-effective deployment on consumer GPUs (e.g., RTX-2080Ti for 7B models) and supports domain-specific adaptation in fields like healthcare and law. By integrating hybrid datasets (BELLE and Guanaco) and 4-bit quantization (QLoRA), the model achieves competitive performance in tasks such as translation, code generation, and domain-specific Q&A. The project provides a comprehensive toolkit for model conversion, CPU inference, and multi-turn dialogue interfaces, emphasizing accessibility for researchers and developers. Evaluations indicate competitive performance across medical tasks, multi-turn dialogue coherence, and real-time legal updates. Chinese-Vicuna's modular design, open-source ecosystem, and community-driven enhancements position it as a versatile foundation for Chinese LLM applications.