Meta has just dropped Llama 3.1, and for the first time, we're seeing an open-source model that can go toe-to-toe with the closed-source heavyweights like GPT-4 and Claude 3.5 Sonnet.

Imagine for a moment that the AI world is a bustling marketplace. In one corner, you have the luxury boutiques – the GPT-4s and Claude 3.5s of the world – offering high-end, proprietary AI models at premium prices. And then, seemingly out of nowhere, Meta shows up and starts handing out free samples that are nearly as good as the expensive stuff.

That's essentially what's happening with Llama 3.1. Meta has released not one, but three powerful AI models that anyone can download and use, even for commercial purposes. The largest model, 405B, is performing on par with the best closed-source models out there. It's like giving away a sports car that can keep up with a Formula 1 racer.

Here's where it gets really interesting. Meta didn't just create three separate models – they used a clever technique called "knowledge distillation" to make the smaller models punch above their weight class.

Think of it like this: Imagine you had a world-class chef (the 405B model) teach a talented home cook (the smaller models) all their secrets. The home cook might not be able to replicate every complex dish, but they'd certainly pick up techniques that make their cooking far better than before. That's essentially what Meta has done, using the massive 405B model to improve the capabilities of the smaller, more accessible models.

It's similar to what OpenAI did with GPT-4 Mini. Announced last week.

The true significance of Llama 3.1 isn't just its technical capabilities – it's what it means for the AI ecosystem as a whole. By releasing such powerful models as open-source, Meta is essentially lowering the barrier to entry for AI innovation.

This could lead to:

Llama 3.1's architecture is simpler compared to other complex strategies, like a mixture of experts. Despite its simplicity, it requires significant resources: Meta used 16,000 H100 GPUs to train the 405B mode. In the words of Ben Thompson, "Meta trained Llama like a big company with lots of resources, while OpenAI trained GPT-4 like a startup."

But that brings us back to :

Mark Zuckerberg's letter provides valuable insights into Meta's strategy in the competitive AI landscape. He emphasizes the need for developers, CEOs, and governments to control their models, ensuring data protection, fine-tuning for specific use cases, and making appropriate long-term technology choices. Larger organizations often require more control over the technology they use, making open-source AI like Llama an attractive option.

Meta doesn't want to depend on a single AI provider or proprietary systems, so they benefit from Llama being open-source. Zuckerberg recognizes the intense competition in AI development, meaning the best models will keep changing. Open-sourcing a model won't give a lasting edge in this fast-paced environment.

Moreover, OpenAI, Anthropic, DeepMind, and other foundation model developers make money by selling access to their models, either per token or via product subscriptions. Meta already has a multi-billion dollar ad business, which means it can afford to give away the AI stuff for free.

That allow them to apply, a longstanding idea in tech "commoditize your complement" - to make adjacent layers of the stack/supply-chain/ecosystem commodities, so that your product benefits from more options and your competition fights each other

With the release of Llama 3.1, a significant ecosystem of partners is already in place, offering the model on various cloud platforms and providing fine-tuning and RAG systems.

This extensive support seems to create a much larger moat than having a model that marginally outperforms others on benchmarks, especially as AI models become increasingly commoditized. Additionally, Meta can position itself as an advocate for AI safety.

Let's talk performance. The 405B model is flexing hard:

Interpretation from Clement Delangue

They're integrating Llama 3.1 across Facebook, Instagram, WhatsApp, and even AI glasses.

Will we see a world where AI is as ubiquitous as cat photos on social media? Only time will tell!

But of course, for Europe there are and will be restrictions.

Before you go all-in on Llama 3.1, keep in mind:

While the new Llama 3.1 license seems generous, it requires downstream models to include "Llama" in their name, potentially boosting the brand and ecosystem.

Meta might also influence standard interfaces and APIs for open-source LLMs, which raises concerns similar to Big Tech's efforts to define browser standards, a topic that privacy and open internet advocates have been fighting against for years.

We should indeed acknowledge Zuckerberg and Meta for supporting open-source AI. However, it's essential to remain cautious about relying on a tech giant, as their incentives may not always align with the developer community's interests, despite current synergies.

Thank you, see you next week!