Tuesday, July 18, 2023

Meta releases Llama 2 LLM

Meta released Llama 2, its large language model with an open source license for research and commercial use. 

Microsoft is the preferred partner for Llama 2, however Meta announced support across a broad set of companies, including AWS, HuggingFace, Intel, AMD, Nvidia, IBM Qualcomm, data cricks, Deutsche Telekom, Orange, YCombinator, Palo Alto Networks, Andreessen Horowitz, MIT, etc.

Llama 2 pretrained models are trained on 2 trillion tokens, and have double the context length than Llama 1. Its fine-tuned models have been trained on over 1 million human annotations. It is available in available in 7B, 13B and 70B parameters.

https://about.fb.com/news/2023/07/llama-2/