Fine-tuning LLMs with LoRA: A Gentle Introduction

• stanford_alpaca

  108 28,999 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

In this article, we're going to experiment with LoRA and fine-tune Llama Alpaca using commercial hardware.

• alpaca-lora

  107 18,293 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Implement the code in Llama LoRA repo in a script we can run locally

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• GPT-4-LLM

  5 4,034 5.4 HTML

  Instruction Tuning with GPT-4

I'm using the Instruction Tuning with GPT-4 dataset, which is hosted on Huggingface.

Suggest a related project