jackaduma/Vicuna-LoRA-RLHF-PyTorch

A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna

By jackadumaToolReference information

ORIGINAL REPOSITORY

GitHub activity

jackaduma/Vicuna-LoRA-RLHF-PyTorch ↗

Stars: 219
Forks: 18
Open issues and PRs: 16
Repository size: ~19,602 KB
Default branch: main
Created: Apr 22, 2023
Repository updated: Oct 15, 2026
Last push: May 20, 2024
Language: Python
License: MIT

Topics chatgpt · finetune · gpt · llama · llm · lora · peft · ppo · pytorch · reward-models · rlhf · vicuna

Repository-wide figures from GitHub, checked Nov 6, 2026. Stars are endorsements, not a Mega AI Hub quality rating. Repository size is GitHub’s estimate; a ZIP download may differ.

Resource information

Original repository: jackaduma/Vicuna-LoRA-RLHF-PyTorch
Credit basis: GitHub repository owner or organization; individual authorship is not asserted
Publisher: jackaduma
Upstream last modified: Oct 15, 2026
Official website: https://github.com/jackaduma/Vicuna-LoRA-RLHF-PyTorch
Languages: Python
Access: Open original GitHub repository; publisher terms apply
Last checked: Nov 6, 2026
License: MIT
Last record update: Nov 6, 2026