Meta introduced the launch of Llama 3, the most recent model of its giant language mannequin (LLM), on April 18, describing it as a “main leap over Llama 2.”
The corporate stated it has initially launched the primary two fashions of the present model, that includes 8B and 70B parameters, with upcoming fashions slated to function 400B parameters.
Meta emphasised Llama 3 was skilled with a “giant, high-quality coaching dataset” that includes over 15 trillion tokens, 7x bigger than Llama 2 and that includes 4x extra code. Llama 3 additionally options filtering strategies, together with NSFW filters, to make sure knowledge high quality.
LLama 3 outperforms Llama 2 and competing fashions reminiscent of Anthropic’s Claude Sonnet, Mistral Medium, and OpenAI’s Chat GPT-3.5 greater than half the time throughout 12 use circumstances.
The primary releases of Llama 3 are text-based fashions. Nonetheless, future releases will probably be multilingual and multimodal. They may even function longer context and display higher efficiency in reasoning and coding, which Meta described as “core LLM capabilities.”
The corporate plans to deploy Llama 3 on all main cloud suppliers, mannequin API suppliers, and different companies. It plans to launch the product “all over the place.”
Broader consumer entry
Llama 3 is geared toward builders, however Meta has additionally launched new methods for finish customers to entry AI companies within the US and greater than 12 different international locations.
One new addition is a devoted web site referred to as Meta AI, the place customers can entry AI-powered writing help, trivia video games, simulated job interviews, and homework assist.
Meta has additionally built-in Meta AI with all its merchandise, together with Fb, Instagram, WhatsApp, and Messenger. Moreover, the corporate presents the service through Ray-Ban Meta sensible glasses within the US and plans to increase it to its Meta Quest VR headset.
In an announcement, CEO Mark Zuckerberg stated:
“We imagine that Meta AI is now probably the most clever AI assistant you can freely use.”
Information of Meta’s expanded AI merchandise comes shortly after upgrades to competing companies. ChatGPT upgraded to GPT-4 Turbo on April 11, whereas Microsoft Copilot upgraded to GPT-4 Turbo beginning in March, advancing the race between consumer-oriented AI companies.
