5 open-source large language models you can use in your project

We collected the links to all research papers and repositories with the code.

• BLOOMZ is a resulting model after applying multitask prompted fine-tuning to the pre-trained multilingual BLOOM.

  • Paper

  • Code

• OPT-IML (OPT + Instruction Meta-Learning) is a set of instruction-tuned versions of OPT, on a collection of ~2000 NLP tasks gathered from 8 NLP benchmarks, called OPT-IML Bench.

  • Paper

  • Code

• Pythia is a suite of 16 LLMs, all trained on public data seen in the same order and ranging in size from 70M to 12B parameters.

  • Paper

  • Code

• LLaMA is a collection of foundation language models ranging from 7B to 65B parameters.

  • Paper

  • Code

• Vicuna is an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT.

  • Article

  • Code

Every day we post helpful lists and bite-sized explanations on our Twitter. Please join us there: