Beyond the God Model | Alex Atallah & Amjad Masad
The a16z Show
Erik Torenberg hosts OpenRouter's Alex Atallah and Replit's Amjad Masad to explore a shifting paradigm in AI architecture. Rather than racin
Key takeaways
- OpenRouter's acquisition by Stripe was driven by shared mission values around fostering new companies rather than consolidating them into single platforms.
- Enterprises are actively diversifying away from proprietary frontier models to avoid vendor lock-in, control costs, and build internal AI practices.
Main topics
- Model neurodiversity and routing
- Enterprise AI independence and data sovereignty
Notable quotes
"It's like nuking a butterfly."
Conclusion
The episode provides actionable context for developers and enterprise leaders
Transcript preview
Speaker 4 (0:00) You saw the SpaceX S1. It was like, Speaker 1 (0:02) oh, $30 trillion. It's like, what is the world GDP? $100 trillion? Both Stripe and OpenRouter really want lots of new companies in the world. We don't want everyone to be a part of one giant company. Speaker 4 (0:14) The reason why the OpenAI hacks have been so destructive is because they're so capable. Speaker 1 (0:22) It's like nuking a butterfly. When the models get more intelligent. The risk actually will continue to get higher. And yet no one knew is taking responsibility. Speaker 4 (0:32) We're going to slowly realize how good we've had it with deterministic code. Remember the days when Speaker 1 (0:40) computers did exactly what we told them to do. Are we going to prevent the models from deceiving users during training runs predictably? Will a model that's big enough and powerful enough suddenly stop deception, stop sandbagging? Speaker 2 (0:57) For the past few years, AI has been racing toward bigger, more general models. But what if the future is actually more specialized? In this episode, I sit down with OpenRouter's Alex Atala and Replit's Amjad Massad to discuss why the next phase of AI may be built around many different models working together. Alex makes the case for what he calls neurodiversity, combining models with different strengths rather than locking into a single provider. Amjad explains why enterprises may increasingly want that independence too, owning more of their intelligence and choosing the best model for each job. We also get into specialized agents, model routing and fusion, the trade-offs between capability, cost, and safety, and what happens when AI systems start training smaller models to handle specific tasks. Speaker 3 (1:47) Welcome to A's and Z's podcast. We're here with Amjad of Replit and Alex of OpenRouter. And this is the first podcast that Alex has done since the acquisition. So we're really excited to have both of you. Speaker 2 (1:57) Thank you. I'm excited to be here. Alex, let's start with that, actually, if you can briefly share. Speaker 3 (2:03) Obviously, massive acquisition. Amjad is an investor. We're also, of course, an investor, the biggest shareholder, but who's counting? Alex, why don't you give us a little bit of the backstory? Like, how does an acquisition like that even happen? Do you get a DM from Patrick one day? What can you share? Hey, Speaker 4 (2:18) how much for an open router? Speaker 1 (2:24) I had talked to Will Gabrick, the Stripe president, a long time ago, a couple years ago, when we were doing our Series A. And we just, we stayed in touch. We had like a lot of Stripe work streams going on with various teams at Stripe. So there were always sort of like things that we were doing with Stripe. We presented at Stripe sessions. And so they always kind of felt close. And then, Yeah, just in July, I believe, they reached out, wanted to chat, met both of them in person, and it kind of just progressed from there fairly quickly. They were very efficient, and they were very founder-friendly about the experience. I was really impressed with the whole thing. Did you want to sell? Did Speaker 4 (3:13) it even cross your mind before the year shot? Speaker 1 (3:16) No, we were not thinking about that at all. I did really respect the company, do really respect it today. And of possible acquisition options for us, it was my top choice. And so it was like an interesting idea. And as we kind of fleshed out the reasons why it would make sense for both companies, it got more and more interesting. It was really clear how aligned they were with us kind of having autonomy over the brand and roadmap and product and keeping OpenRouter doing what it's already doing, just much faster with like a much more serious go-to-market plan and then some better together stories between the two products and the two companies. And then culturally, there were just, I think, in terms of mission and values and... building a neutral, trusted platform that businesses can depend on and scale on top of that's also really developer-friendly with the best possible developer experience to encourage new companies to emerge. That alignment was there. And there was a bigger picture kind of alignment too, where both Stripe and OpenRouter really want lots of new companies in the world. We don't want everyone to be a part of one giant company. We want to like create really good incentives and really sort of easy, streamlined workflows for people to start new companies and grow them successfully and make both lifestyle and venture-backed businesses on top of really good, reliable, and price-efficient infrastructure and like a marketplace that works. And I really want that future. And Stripe... demonstrated that they've been wanting it and building towards it for many, many, many years. And in many ways, like payments and inference are going to blend together for companies of the future. Speaker 4 (5:19) I'm curious, I understand why Stripe's incentive is to have much more vibrant startup ecosystem. I understand the kind of moral argument and why you would want that. But why is that? good for open router is your model for open router is that it's a network effects business Speaker 4 (5:40) Is it like a network? Well, for us, I think there's a couple different problems OpenRouter solves. Speaker 1 (5:47) One is allowing you to build a company that uses AI or augments intelligence with unique data and other services without model lock-in, without vendor lock-in. Allowing you to kind of... like be on the Pareto frontier continuously as the ecosystem grows it. And to do that, it's a lot of work because there's all kinds of little lock-in that appears. We also, we want companies to feel like that they can like add more than just prompts on top of a single model. There's a lot more to building. like unique intelligence. And I think a big component of that is neurodiversity. You really need the power of multiple models that are trained in different ways, including some of your own, to do more than Jack GPT or Claude would on the task. If like someone who is thinking about buying from you as a potential customer is wondering, well, what if I just use the model directly? How do you really show that you are significantly better and able to build a business that matters? And I think a lot of it will involve neurodiversity and blending powers and good data from multiple models. Another component is helping people get really good cost efficiency. There are a lot of businesses that just cannot, do not emerge until they become cost effective. Speaker 1 (7:28) Creating an environment where we can help drive down costs by building an efficient market is crucial to making that happen. Otherwise, why lower my prices as a provider? We have a captive market. And I think that's like a key point of marketplaces that was just totally missing from AI before we showed up. There was just one player, OpenAI. It could have been like a very strange world. Speaker 1 (7:58) I'm not saying that we did all the work. Of course not. But helping people choose new models and explore new models and learn what makes a closed source or open weight model actually good at your task involves seeing what the whole ecosystem is doing and learning automatically. LLMs are not things where you can just enumerate all the features on a webpage. It's impossible. You have to see how they're being used. to know what they're good at. You started the Speaker 3 (8:29) company three years ago. I'm curious what has surprised you the most about sort of the evolution of open and closed source models to the present as it relates to model performance or just people's perspective on the variety of models they have available to them. Speaker 1 (8:42) People have been more open-minded than I thought they would be towards open weight models. Typically, there's a lot of brand. Speaker 1 (8:54) Especially an enterprise. Typically there's a lot of like brand trust where like enterprises in general are like, oh, I don't really know how to tell the difference between these things. So I'm just going to buy the one that all the other credible enterprises are buying. And there's a lot of enterprise lock-in with a mentality like that. And that just didn't happen that much. It did happen a bit, but we saw a lot of enterprises want to explore new models. It was very much good for a marketplace. Enterprises wanted to diversify outside of just the proprietary frontier model labs. both for like cost reasons and for differentiation reasons. They wanted to own their intelligence so they could, I think one, keep their talent, have like an internal AI practice. Like AI is just like a huge strategy topic. It's not like you go to your board and you're like, oh yeah, we fixed the AI problem, quarter complete. Like your board is like asking you every month, like what's next for the internal AI team? And like every single enterprise now has just this internal AI team that they're developing where they need a strategy behind it. It's not just a like, you know, we check the feature off, we like set up the database and we're done. And so I think that that dynamic has resulted in just like a desire to explore and diversify. A desire to kind of like figure out how to reduce costs and... figure out how to do benchmarks for the first time in the company's life. I have been surprised there hasn't been more benchmarking, more companies creating more benchmarks. It's starting to happen, and I think eventually we'll see a lot more of them to demonstrate, oh yeah, this thing is better than using Cloud Direct. But I think that's going to be a bigger focus for this internal AI group at every company, evals. And I think Amjad's been doing that a lot at Replit, for example. You guys have done cost-per-task research. You guys have been, you know, you've made a Doomloop rescue. You've kind of been experimenting with new ways of using agents like Doomloop rescue and helping bring those to developers.