Stanford's Alpaca fine-tunes LLaMA for a few hundred dollars
Instruction-following behaviour was reproduced for under $600 total by fine-tuning Meta's 7B LLaMA on GPT-3.5-generated examples; the public demo was pulled within days.
Open weights & ecosystem · Ideas & essays