Anthropic rival says companies can (mostly) skip the pricey models

image

On the same day that Anthropic went public in the largest IPO on record, with investor enthusiasm for the AI lab through the roof, far away at the Slush startup conference in Helsinki, the topic du jour was open source everything.

That’s the enormous opportunity being chased by companies like Fireworks AI, as enterprises seek ways to avoid paying frontier prices for their AI needs.

Fireworks runs AI models for other businesses. It specializes in open-weight models, which anyone can download, and helps customers tune them on their own data so they run faster and cheaper than the models of Anthropic, OpenAI, and other heavyweights, and are harder for rivals to copy. Customers have included Uber, Shopify, and Notion. Co-founder Chenyu Zhao and I spoke onstage toward the end of the day.

Zhao and many others believe companies are gravitating toward platforms like his because frontier models are pricey and, in most cases, he says, unnecessary unless you need the very latest and greatest generalized intelligence. There are also growing concerns that frontier labs absorb too much of their customers’ know-how, even if only through the prompts used to get answers, a worry Microsoft CEO Satya Nadella raised in July.

Fireworks has also gotten its first black eye, having disclosed two security incidents this fall. In one, hackers reached API keys and tokens stored as secrets for a limited number of accounts; in the other, attackers breached its cloud provider, made their way into a development system, and nabbed customer data, including billing records and some datasets.

Notion says AI chat transcripts from fewer than 1% of its workspaces were exposed, but it has disconnected from Fireworks. Uber says hackers stole the names, addresses, birth dates and driver’s license numbers of about 150,000 drivers through a vendor that TechCrunch identified as Fireworks. Fireworks will have to win back the confidence of customers like them.

Fireworks, assigned a $17.5 billion valuation by its investors in summer, is reportedly in “early talks” for yet another round, though Zhao declined to comment.

There’s money chasing everyone in the category, seems like. Rival companies Together AI and Baseten have announced massive rounds in recent months. On Wednesday, Palo Alto Networks said it will buy Applied Compute, which, like Fireworks, helps companies train and run custom AI models on their own data. The deal for the startup, founded just a year ago by former OpenAI researchers, is $4.5 billion, all of it in stock.

Here’s some of what Zhao had to say. This conversation has been edited for length and clarity.

You spent a decade at Google, including managing a 50-person engineering team on Google Cloud Vertex AI. Why leave when you did?

When you meet great co-founders, it’s obvious within five minutes that they’re really smart. I was sold after talking to Lin [Qiao] and Dima [Dzhulgakov]. It’s also important to find people who are genuinely nice, people you’ll enjoy working with.

How do you describe Fireworks to a CEO who has never heard of it?

I describe Fireworks as a specialized intelligence platform. OpenAI and Anthropic are building general intelligence. We use open models, which are often smaller, cheaper, and faster, and let companies add their own data to specialize them. That way you own your AI rather than being beholden to giant AI conglomerates. If you’re just using Opus or Sonnet, that’s not a differentiator.

How far behind are open models right now?

A few years ago I’d have said a year, a year and a half. Then came DeepSeek and a waterfall of fantastic open models. These days it’s at most six months behind, probably closer to three.

If the models are so close behind, why are businesses slow to switch?

Frontier models are a household brand, and before you find product-market fit, using the best model is low risk. But once you pass 10,000 or 100,000 users and you’re spending $10,000 to $100,000 a month on tokens, it’s time to think about open source.

In July, Microsoft CEO Satya Nadella warned that companies using proprietary AI models pay twice, once in money and again in know-how. Do you think that warning had a material effect?

We think we’ll live in a two-model world, with frontier and open models in parallel. You want the best intelligence for high-level planning, but you don’t need a frontier model for basic arithmetic. That’s why there’s so much interest in routing, and why people now think about cost per task, not just cost per token.

Anthropic went public today. What do you think of its valuation? There’s one scenario in which it just continues to cement its place in this sort of oligopoly; there’s another where it starts to lose traction.

On the record: I’ll probably call my broker tonight and buy a few shares. This is a long-term bet. In 10 years AI usage will be at a completely different scale, and that takes an incredible amount of capital, which is why these companies are going public.

Fireworks has had a couple of security breaches recently. What do you tell customers?

Every company is probably seeing an unprecedented frequency of attacks. For our incident, a lot of the motivation was LLM jacking: hunting through providers for API keys and secrets to sell tokens on illicit marketplaces. Our promise is zero data retention for inference traffic, and there’s no indication that has been compromised.

Notion has disconnected from Fireworks. Did you lose other customers?

I don’t think I can publicly name the specific customers that were impacted. Some, such as Notion and Cursor, have gone public already. It was a small subset of our customers that had this data impact.

How did that customer data get exposed, given your zero-retention promise?

Notion was using batch prediction, where you upload a dataset that’s stored at rest, so it’s not a zero-retention product by nature. We’re moving those services to an online flow so we keep data only as long as we need it.

Jensen Huang left Nvidia last week, and Nvidia has backed Fireworks since 2024. Does that affect you?

It’s been a blow to the industry, and we feel for Jensen and his family. But Nvidia has always been a strong supporter of open source, and I don’t see that changing. We expect it to keep investing in Nemotron, and we’re excited to keep partnering with them.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Don’t miss these tips!

We don’t spam! Read more in our privacy policy

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Hot this week

How Mauricio Pochettino could line up Man Utd against Liverpool

With Mauricio Pochettino officially taking the reins at Old...

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

Peacock Reveals ‘The Traitors’ Season 5 Premiere Date, First Look

Viewers now know when they’ll get to see whether...

Zeeland duo crushes school records, swims toward state title contention

1 / 21See West Ottawa girls swimming take on...

Topics

How Mauricio Pochettino could line up Man Utd against Liverpool

With Mauricio Pochettino officially taking the reins at Old...

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

AI Is Thriving at Capital One

If one were making a list of the companies...

Featured Artist | Darrell Black

Darrell Black Frankfurt, Germanyhttp://darrell-black.pixels.com/@definismart My Darrell Urban Black, an American visual...

What are the animals in your home learning from each other?

LEARNING FROM EACH OTHER Leaf, Sunshine, and Cuddles The animals who...

Related Articles

Popular Categories

News Feed

How to watch Percy Jackson and the Olympians season 3 online from anywhere

Share this article Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Overview Dealing with heavier themes – literally, in the case...

‘Public lands belong in public hands’: New bill looks to ban new data centers being built on US federal land — meaning national parks...

Share this article Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Oregon congresswoman wants developers kept away from millions of...

Coleen Rooney shares photos of her two ‘thrones’ after I’m A Celeb fans predicted she would ‘kill’ husband Wayne for his bathroom confession

Coleen Rooney has thankfully seen the funny side of her husband Wayne's jaw-dropping bathroom confession on I'm A Celebrity... Get Me Out Of Here. 

Grace Tame flaunts her toned midriff in a daring cropped blazer as she leads arrivals at Marie Claire Women of the Year Awards in...

Grace Tame turned heads as she stepped out in a bold fashion-forward ensemble at the Marie Claire Women of the Year Awards in Sydney...

Tammy Hembrow reveals humiliating Leonardo DiCaprio encounter after drunken nightclub mix-up: ‘It haunts me to this day’

Tammy Hembrow has revealed she once had an 'embarrassing' encounter with Hollywood star Leonardo DiCaprio in a nightclub about eight years ago. 

Jennifer Lopez, 57, details her very strict diet and the one exercise that ‘changed her body’

Jennifer Lopez detailed her strict diet and the one exercise that 'changed her body' as she stopped by the Friends Keep Secrets podcast this...

Sydney Sweeney spreads holiday cheer in lace lingerie as she strips off for another Christmas-themed shoot

Sydney Sweeney has stripped off for yet another steamy photoshoot to promote her lingerie line Syrn. 

Spin City star Richard Kind, 69, reveals ‘horrible’ health diagnosis: ‘It’s all over my body’

The 69-year-old actor, appearing Tuesday on the podcast Inside of You with Michael Rosenbaum, made a 'confession' about living with the medical condition.

Brittany Snow, 40, confirms engagement to hunky photographer Hunter Moreno, 32, after two years of dating as she flashes diamond ring

The actress, 40, confirmed she is set to wed the 32-year-old during an appearance on The Drew Barrymore Show alongside her The Hunting Wives co-star...

Jon Hamm is a dad at 55! Mad Men star’s wife Anna Osceola, 38, gives birth

Jon Hamm and his wife Anna Osceola are celebrating the birth of their first child after the Daily Mail exclusively revealed that Osceola was...

How Florence Pugh became a defiant feminist voice in Hollywood after refusing to conform to stereotypes to defending her nipple-baring gowns and refusing to...

After weeks of speculation over her changing looks and critique regarding her body, Florence Pugh hit back on Wednesday night with an eight-page Instagram statement. 

Is Robert Pattinson ready for Bond? Reluctant face of film franchises negotiates a shorter 007 contract after ‘selling out’ with Twilight and sharing his...

Robert refused to sign up for four films - a requirement which the other Bond contenders had agreed to - only signing up when...

Nicola Peltz shares defiant photo of her stomach after receiving ‘mean’ comments when she posted ‘weird’ snap of her tummy

Nicola Peltz has shared a defiant photo flashing her tummy after firing back at 'mean' comments about her weight after posting 'weird' photo of...

Orlando Bloom bails on hosting children’s charity gala at the ‘last minute’ after partying at Leonardo DiCaprio’s wild birthday… and is called out by...

Journalist Stephanie Ruehl took to Instagram on Wednesday to post about how she had to take over hosting duties at the 2026 Child Advocacy Award...

Bentonville Film Festival Sets 2027 Dates, Variety’s Producers to Watch Returns for 3rd Year

The Bentonville Film Festival will return for its 13th year June 14-20, renewing its partnership with Variety’s 10 Producers to Watch for its third...

Bo Derek turns 70! How actress is ageing in reverse as youthful star insists she doesn’t believe in plastic surgery and ‘hates’ exercise

Bo Derek has barely aged a day since her breakthrough role in the 1979 romantic comedy 10. 

Lara Worthington flashes her underwear in sheer dress while Sam Armytage shows off her bust in plunging gown as they lead celebrity arrivals at...

Fashion and feminism combined at the Marie Claire Women of the Year Awards in Sydney on Thursday night. 

Logitech Pebble Mouse 2 review: the perfect travel mouse but not a fit for gaming or productivity

Why you can trust TechRadar We spend hours testing every product or service we review, so you can be sure you're buying the best. Find...

How ‘Hunger Games’ Stars Jennifer Lawrence, Josh Hutcherson and Woody Harrelson Return for ‘Sunrise on the Reaping’

SPOILER ALERT: This article contains spoilers for the ending of “Hunger Games: Sunrise on the Reaping,” now playing in theaters. The mutt is out of...

Apple may be developing its own AI agent that runs your Mac

Apple appears to be working on its own AI agent to conduct computer work on behalf of users — including using apps, accessing websites,...

Popular articles

How to watch Percy Jackson and the Olympians season 3 online from anywhere

Share this article Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Overview Dealing with heavier themes – literally, in the case...

‘Public lands belong in public hands’: New bill looks to ban new data centers being built on US federal land — meaning national parks...

Share this article Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Oregon congresswoman wants developers kept away from millions of...

Coleen Rooney shares photos of her two ‘thrones’ after I’m A Celeb fans predicted she would ‘kill’ husband Wayne for his bathroom confession

Coleen Rooney has thankfully seen the funny side of her husband Wayne's jaw-dropping bathroom confession on I'm A Celebrity... Get Me Out Of Here. 

Grace Tame flaunts her toned midriff in a daring cropped blazer as she leads arrivals at Marie Claire Women of the Year Awards in...

Grace Tame turned heads as she stepped out in a bold fashion-forward ensemble at the Marie Claire Women of the Year Awards in Sydney...

Tammy Hembrow reveals humiliating Leonardo DiCaprio encounter after drunken nightclub mix-up: ‘It haunts me to this day’

Tammy Hembrow has revealed she once had an 'embarrassing' encounter with Hollywood star Leonardo DiCaprio in a nightclub about eight years ago. 

Jennifer Lopez, 57, details her very strict diet and the one exercise that ‘changed her body’

Jennifer Lopez detailed her strict diet and the one exercise that 'changed her body' as she stopped by the Friends Keep Secrets podcast this...

Sydney Sweeney spreads holiday cheer in lace lingerie as she strips off for another Christmas-themed shoot

Sydney Sweeney has stripped off for yet another steamy photoshoot to promote her lingerie line Syrn. 

Spin City star Richard Kind, 69, reveals ‘horrible’ health diagnosis: ‘It’s all over my body’

The 69-year-old actor, appearing Tuesday on the podcast Inside of You with Michael Rosenbaum, made a 'confession' about living with the medical condition.

Brittany Snow, 40, confirms engagement to hunky photographer Hunter Moreno, 32, after two years of dating as she flashes diamond ring

The actress, 40, confirmed she is set to wed the 32-year-old during an appearance on The Drew Barrymore Show alongside her The Hunting Wives co-star...

Jon Hamm is a dad at 55! Mad Men star’s wife Anna Osceola, 38, gives birth

Jon Hamm and his wife Anna Osceola are celebrating the birth of their first child after the Daily Mail exclusively revealed that Osceola was...

How Florence Pugh became a defiant feminist voice in Hollywood after refusing to conform to stereotypes to defending her nipple-baring gowns and refusing to...

After weeks of speculation over her changing looks and critique regarding her body, Florence Pugh hit back on Wednesday night with an eight-page Instagram statement. 

Is Robert Pattinson ready for Bond? Reluctant face of film franchises negotiates a shorter 007 contract after ‘selling out’ with Twilight and sharing his...

Robert refused to sign up for four films - a requirement which the other Bond contenders had agreed to - only signing up when...

Nicola Peltz shares defiant photo of her stomach after receiving ‘mean’ comments when she posted ‘weird’ snap of her tummy

Nicola Peltz has shared a defiant photo flashing her tummy after firing back at 'mean' comments about her weight after posting 'weird' photo of...

Orlando Bloom bails on hosting children’s charity gala at the ‘last minute’ after partying at Leonardo DiCaprio’s wild birthday… and is called out by...

Journalist Stephanie Ruehl took to Instagram on Wednesday to post about how she had to take over hosting duties at the 2026 Child Advocacy Award...

Bentonville Film Festival Sets 2027 Dates, Variety’s Producers to Watch Returns for 3rd Year

The Bentonville Film Festival will return for its 13th year June 14-20, renewing its partnership with Variety’s 10 Producers to Watch for its third...

Bo Derek turns 70! How actress is ageing in reverse as youthful star insists she doesn’t believe in plastic surgery and ‘hates’ exercise

Bo Derek has barely aged a day since her breakthrough role in the 1979 romantic comedy 10. 

Lara Worthington flashes her underwear in sheer dress while Sam Armytage shows off her bust in plunging gown as they lead celebrity arrivals at...

Fashion and feminism combined at the Marie Claire Women of the Year Awards in Sydney on Thursday night. 

Logitech Pebble Mouse 2 review: the perfect travel mouse but not a fit for gaming or productivity

Why you can trust TechRadar We spend hours testing every product or service we review, so you can be sure you're buying the best. Find...

How ‘Hunger Games’ Stars Jennifer Lawrence, Josh Hutcherson and Woody Harrelson Return for ‘Sunrise on the Reaping’

SPOILER ALERT: This article contains spoilers for the ending of “Hunger Games: Sunrise on the Reaping,” now playing in theaters. The mutt is out of...

Apple may be developing its own AI agent that runs your Mac

Apple appears to be working on its own AI agent to conduct computer work on behalf of users — including using apps, accessing websites,...