Can Open Weight AI Compete with Frontier? Mozilla CTO Raffi Krikorian explains.
55 min
Companies running AI must decide which work to send to the frontier labs and which to run on open-weight models. Raffi Krikorian, Mozilla's Chief Technology Officer, explains open-weight AI for the enterprise: what open-weight and open-source models are, which work belongs on frontier models, and when running your own models pays off. The conversation covers cost, security, backup plans, token pricing, and lock-in. YOU'LL DISCOVER ✅ Why Raffi compares an open-weight model to a compiled binary: you can download and run it, but you cannot see what went into it, unlike a fully open-source model. ✅ Where to draw the line: frontier models for scientific research, open-weight models for everyday tasks at about 35 to 50 times lower cost. ✅ How to find your own line: record and log every prompt and response, so those traces show which work a cheaper model can handle. ✅ Why openness leads to more security, not less, with Signal as the example. ✅ Why Raffi expects the moat to shift from building models to using them: fine-tuning, deployment, and the tooling around the model. ✅ How to run open models today, from NeoCloud API providers to Ollama, vLLM and llamafile on a MacBook, Mac Studio or DGX Spark, and why RAM is king. ✅ Why Raffi tells CTOs not to switch providers today, but to start evaluating a backup plan for outages, cost spikes, and lowered token limits. ✅ Why today's token prices are subsidized ahead of the labs' IPOs: a $200 subscription that one Mozilla engineer measured at about $6,000 a month in tokens. ⏱️ TIMESTAMPS 0:00 Introduction 0:14 Open weight versus open source models 5:11 Rent the frontier, own everyday AI 12:21 Openness leads to more security, not less 14:45 The moat shifts from model to usage 18:28 Open models are getting easier to run 27:42 Start evaluating a model backup plan today 32:51 When enterprises should move to open models 38:51 Subsidized token prices will not last 43:13 IP rights and inspection at scale 47:00 Open-weight compet...