Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More<\/em><\/p>\n\n\n\n The entire AI landscape shifted back in January 2025 after a then little-known Chinese AI startup DeepSeek (a subsidiary of the Hong Kong-based quantitative analysis firm High-Flyer Capital Management) launched its powerful open source language reasoning model DeepSeek R1 publicly to the world, besting U.S. giants such as Meta. <\/p>\n\n\n\n As DeepSeek usage spread rapidly among researchers and enterprises, Meta was reportedly sent into panic mode upon learning that this new R1 model had been trained for a fraction of the cost of many other leading models yet outclassed them for as little as several million dollars \u2014 what it pays some of its own AI team leaders.<\/p>\n\n\n\n Meta\u2019s whole generative AI strategy had until that point been predicated on releasing best-in-class open source models under its brand name \u201cLlama\u201d for researchers and companies to build upon freely (at least, if they had fewer than 700 million monthly users, at which point they are supposed to contact Meta for special paid licensing terms). <\/p>\n\n\n\n Yet DeepSeek R1\u2019s astonishingly good performance on a far smaller budget had allegedly shaken the company leadership and forced some kind of reckoning, with the last version of Llama, 3.3, having been released just a month prior in December 2024 yet already looking outdated.<\/p>\n\n\n\n Now we know the fruits of that reckoning: today, Meta founder and CEO Mark Zuckerberg took to his Instagram account to announced a new Llama 4 series of models, with two of them \u2014 the 400-billion parameter Llama 4 Maverick and 109-billion parameter Llama 4 Scout \u2014 available today for developers to download and begin using or fine-tuning now on llama.com and AI code sharing community Hugging Face.<\/p>\n\n\n\n A massive 2-trillion parameter Llama 4 Behemoth is also being previewed today, though Meta\u2019s blog post on the releases said it was still being trained, and gave no indication of when it might be released. (Recall parameters refer to the settings that govern the model\u2019s behavior and that generally more mean a more powerful and complex all around model.)<\/p>\n\n\n\n One headline feature of these models is that they are all multimodal \u2014 trained on, and therefore, capable of receiving and generating text, video, and imagery (hough audio was not mentioned).<\/p>\n\n\n\n Another is that they have incredibly long context windows \u2014 1 million tokens for Llama 4 Maverick and 10 million for Llama 4 Scout \u2014 which is equivalent to about 1,500 and 15,000 pages of text, respectively, all of which the model can handle in a single input\/output interaction. That means a user could theoretically upload or paste up to 7,500 pages-worth-of text and receive that much in return from Llama 4 Scout, which would be handy for information-dense fields such as medicine, science, engineering, mathematics, literature etc.<\/p>\n\n\n\n Here\u2019s what else we\u2019ve learned about this release so far:<\/p>\n\n\n\n All three models use the \u201cmixture-of-experts (MoE)\u201d architecture approach popularized in earlier model releases from OpenAI and Mistral, which essentially combines multiple smaller models specialized (\u201cexperts\u201d) in different tasks, subjects and media formats into a unified whole, larger model. Each Llama 4 release is said to be therefore a mixture of 128 different experts, and more efficient to run because only the expert needed for a particular task, plus a \u201cshared\u201d expert, handles each token, instead of the entire model having to run for each one. <\/p>\n\n\n\n As the Llama 4 blog post notes:<\/p>\n\n\n\n As a result, while all parameters are stored in memory, only a subset of the total parameters are activated while serving these models. This improves inference efficiency by lowering model serving costs and latency\u2014Llama 4 Maverick can be run on a single [Nvidia] H100 DGX host for easy deployment, or with distributed inference for maximum efficiency.<\/em><\/p>\n\n\n\n Both Scout and Maverick are available to the public for self-hosting, while no hosted API or pricing tiers have been announced for official Meta infrastructure. Instead, Meta focuses on distribution through open download and integration with Meta AI in WhatsApp, Messenger, Instagram, and web.<\/p>\n\n\n\n Meta estimates the inference cost for Llama 4 Maverick at $0.19 to $0.49 per 1 million tokens (using a 3:1 blend of input and output). This makes it substantially cheaper than proprietary models like GPT-4o, which is estimated to cost $4.38 per million tokens, based on community benchmarks.<\/p>\n\n\n\n\n\n\n\n All three Llama 4 models\u2014especially Maverick and Behemoth\u2014are explicitly designed for reasoning, coding, and step-by-step problem solving \u2014 though they don\u2019t appear to exhibit the chains-of-thought of dedicated reasoning models such as the OpenAI \u201co\u201d series, nor DeepSeek R1. <\/p>\n\n\n\n Instead, they seem designed to compete more directly with \u201cclassical,\u201d non-reasoning LLMs and multimodal models such as OpenAI\u2019s GPT-4o and DeepSeek\u2019s V3 \u2014 with the exception of Llama 4 Behemoth, which does<\/em> appear to threaten DeepSeek R1 (more on this below!)<\/p>\n\n\n\n In addition, for Llama 4, Meta built custom post-training pipelines focused on enhancing reasoning, such as:<\/p>\n\n\n\n MetaP is of particular interest as it could be used going forward to set hyperparameters on on model and then get many other types of models out of it, increasing training efficiency. <\/p>\n\n\n\n As my VentureBeat colleague and LLM expert Ben Dickson opined ont the new MetaP technique: \u201cThis can save a lot of time and money. It means that they run experiments on the smaller models instead of doing them on the large-scale ones.\u201d<\/p>\n\n\n\n This is especially critical when training models as large as Behemoth, which uses 32K GPUs and FP8 precision, achieving 390 TFLOPs\/GPU over more than 30 trillion tokens\u2014more than double the Llama 3 training data.<\/p>\n\n\n\n In other words: the researchers can tell the model broadly how they want it to act, and apply this to larger and smaller version of the model, and across different forms of media.<\/p>\n\n\n\n In his announcement video on Instagram (a Meta subsidiary, naturally), Meta CEO Mark Zuckerberg said that the company\u2019s \u201cgoal is to build the world\u2019s leading AI, open source it, and make it universally accessible so that everyone in the world benefits\u2026I\u2019ve said for a while that I think open source AI is going to become the leading models, and with Llama 4, that is starting to happen.\u201d<\/p>\n\n\n\n It\u2019s a clearly carefully worded statement, as is Meta\u2019s blog post calling Llama 4 Scout, \u201cthe best multimodal model in the world in its class<\/em> and is more powerful than all previous generation Llama models,\u201d (emphasis added by me). <\/p>\n\n\n\n In other words, these are very powerful models, near the top of the heap compared to others in their parameter-size class, but not necessarily setting new performance records. Nonetheless, Meta was keen to trumpet the models its new Llama 4 family beats, among them:<\/p>\n\n\n\n But of course, there are a whole other class of reasoning-heavy models such as DeepSeek R1, OpenAI\u2019s \u201co\u201d series (like GPT-4o), Gemini 2.0, and Claude Sonnet. <\/p>\n\n\n\n Using the highest-parameter model benchmarked\u2014Llama 4 Behemoth\u2014and comparing it to the intial DeepSeek R1 release chart for R1-32B and OpenAI o1 models, here\u2019s how Llama 4 Behemoth stacks up:<\/p>\n\n\n\n What can we conclude?<\/p>\n\n\n\n Takeaway: While DeepSeek R1 and OpenAI o1 edge out Behemoth on a couple metrics, Llama 4 Behemoth remains highly competitive and performs at or near the top of the reasoning leaderboard in its class.<\/p>\n\n\n\n Meta also emphasized model alignment and safety by introducing tools like Llama Guard, Prompt Guard, and CyberSecEval to help developers detect unsafe input\/output or adversarial prompts, and implementing Generative Offensive Agent Testing (GOAT) for automated red-teaming.<\/p>\n\n\n\n The company also claims Llama 4 shows substantial improvement on \u201cpolitical bias\u201d and says \u201cspecifically, [leading LLMs] historically have leaned left when it comes to debated political and social topics,\u201d that that Llama 4 does better at courting the right wing\u2026in keeping with Zuckerberg\u2019s embrace of Republican U.S. president Donald J. Trump and his party following the 2024 election.<\/p>\n\n\n\n Meta\u2019s Llama 4 models bring together efficiency, openness, and high-end performance across multimodal and reasoning tasks. <\/p>\n\n\n\n With Scout and Maverick now publicly available and Behemoth previewed as a state-of-the-art teacher model, the Llama ecosystem is positioned to offer a competitive open alternative to top-tier proprietary models from OpenAI, Anthropic, DeepSeek, and Google.<\/p>\n\n\n\n Whether you\u2019re building enterprise-scale assistants, AI research pipelines, or long-context analytical tools, Llama 4 offers flexible, high-performance options with a clear orientation toward reasoning-first design.<\/p>\n Daily insights on business use cases with VB Daily<\/strong><\/p>\n If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.<\/p>\n \n\t\t\t\t\tThanks for subscribing. Check out more VB newsletters here.\n\t\t\t\t<\/p>\n An error occured.<\/p>\n<\/p><\/div>\n
\n<\/div>All-in on mixture-of-experts<\/h2>\n\n\n\n
\n
A powerful \u2013 but not yet the<\/em> most<\/em> powerful \u2014 model family<\/h2>\n\n\n\n
Llama 4 Behemoth<\/h3>\n\n\n\n
\n
\n
![\"\"](\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/04\/489511937_1627813884508038_4209289296588372348_n.png?w=800\")
<\/figure>\n\n\n\nLlama 4 Maverick<\/h3>\n\n\n\n
\n
\n
\n
![\"\"](\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/04\/489031501_1656960988514372_2535138154557835854_n.png?w=703\")
<\/figure>\n\n\n\nLlama 4 Scout<\/h3>\n\n\n\n
\n
\n
![\"\"](\"https:\/\/venturebeat.com\/wp-content\/uploads\/2025\/04\/488658055_1347378876402143_3412007366291908454_n.png?w=800\")
<\/figure>\n\n\n\nBut after all that, how does Llama 4 stack up to DeepSeek?<\/h2>\n\n\n\n
Benchmark<\/th> Llama 4 Behemoth<\/th> DeepSeek R1<\/th> OpenAI o1-1217<\/th><\/tr><\/thead> MATH-500<\/td> 95.0<\/td> 97.3<\/td> 96.4<\/td><\/tr> GPQA Diamond<\/td> 73.7<\/td> 71.5<\/td> 75.7<\/td><\/tr> MMLU<\/td> 82.2<\/td> 90.8<\/td> 91.8<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n \n
Safety and less political \u2018bias\u2019<\/h2>\n\n\n\n
Where Llama 4 stands so far<\/h2>\n\n\n\n
![\"\"\/](\"https:\/\/venturebeat.com\/wp-content\/themes\/vb-news\/brand\/img\/vb-daily-phone.png\")
\n\t\t\t\t<\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div><\/script>\r\n