5,424,109 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

OctoPack: Instruction Tuning Code Large Language Models

Research paper by Niklas Muennighoff and collaborators. Published 2023-08-14. Topics: instruction tuning, code, Git commits, CommitPack, 16B parameter StarCoder.

Resource information

Authors
Niklas Muennighoff, Qian Liu, Armel Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro von Werra, Shayne Longpre
Research topics
instruction tuning, code, Git commits, CommitPack, 16B parameter StarCoder, HumanEval benchmark, HumanEvalPack, Code Repair, Code Explanation, Code Synthesis, OctoCoder, OctoGeeX
Publication date
2023-08-14
Publication
arXiv
Last record update
Nov 3, 2026