Stanford's Alpaca fine-tunes LLaMA for a few hundred dollars
Instruction-following behaviour was reproduced for under $600 total by fine-tuning Meta's 7B LLaMA on GPT-3.5-generated examples; the public demo was pulled within days.
Stanford HAI, Meta AIOpen weights & ecosystem · Ideas & essays