Hacker News new | past | comments | ask | show | jobs | submit
I'd hate to be OpenAI and Anthropic. They are better than the rest of the available models currently, but only by a few months.

That is a very tenuous lead and doesn't speak to much of a sustainable competitive moat for either company. The have to keep sprinting as fast as possible on the hamster wheel to just stay ahead.

Claude has pushed hard on productization. Day to day I use codex for everything, I went to watch my wife use Claude and the way it works is so different. I was shocked when she was modifying an artifact through the Claude website and it was able to make changes to a local file on her desktop.

Microsoft didn't win spreadsheets by having the most advanced or releasing the most often. They made a really good, easy to use product, and got it in front of everyone. (Though Office's p-code was a huge advantage to portability)

I started using Claude in Chrome three weeks ago (after switching to Chrome after almost a decade) and I've been bloody impressed. It's able to invoke the desktop app for desktop stuff, use my browser for browser tools related stuff, and finally, uses MCP for all the apps I've given it gated access to using 'connectors.'

Anthropic's productization is an order of magnitude better than OpenAI, imo, even if OpenAI has nearly the same, if not better, raw model performance. UX wins every time.

Yeah, had the same experience. Left claude since it rambles too much and so far loving Luna/Sol. But, man the codex cloud environment setup sucks. Liking the chat’s ux though since it can make github edits directly, so hopefully the cloud experience was one off.
Now if only they could have one of their innumerable agents make a Firefox version.
loading story #50547113
> Microsoft didn't win spreadsheets by having the most advanced or releasing the most often. They

They won by owning the distribution. Essentially making it the default option for businesses. Bundling with Office, owning the operating system (eg. Making competing products error out), licensing deals and many other things very similar to their Embrace, Extend, Extinguish strategy (which they used against open standards)

It's common spiel, but for many cases they really had a superior product, even if it was combined with anti-competetive approaches, the competitor were often deficient even if there were no such approaches
It is definitely true that they often had the superior product. They went all in on GUI applications years earlier than their competitors. So the option was a nice GUI Excel or Word versus a DOS version of Lotus 123 or Wordperfect.

Excel 1.0 for Mac came out 6 years before a GUI Lotus 123 version for Windows. The first Windows Excel version was 2 years after the Mac one. Word for Windows was 2 years before Wordperfect for Windows.

Then when 32-bit Windows 95 came out, Microsoft also released 32-bit native Windows 95 versions of apps 1-2 years before their competitors.

I’m sure there were plenty of crappy competitors. That still doesn’t mean MS didn’t do all of those things. They were a pretty ruthless corporation, which was even deemed a monopoly and ordered by the govt to split up (which they appealed and won, so it never happened)
Yes, I fully agree - I do remember the 1990s :)

I am just saying that it was not just that which let them win in the market.

In fact, some markets they were lagging behind before windows 2000, but Active Directory just wiped out competitors' offerings in many ways - and even before there was part of "Run a server on NT4 and have less worries about hardware support" compared to alternatives (which in turn was encroaches by Linux with Samba)

How to say that you worked at Microsoft without saying it
Ahahahaha, nope.

For the 1990s I was wildly anti-microsoft person, we were an OS/2 home for big chunk of it, WordPerfect over Word, etc.

Over time I learnt just what kind of advantages beyond the popularly villified ones Microsoft ended up having in sales, and Windows 2000 was really a huge blow to competition in many ways, because it was first product that integrated it to this level.

There were even stories they deliberately sabotaged Lotus 123 (spreadsheet application) on Dos. There is an infamous quote:

" DOS Isn’t Done Until Lotus Won’t Run "

although this article and others say it probably never happened in reality

https://raywoodcockslatest.wordpress.com/2021/06/09/dos-lotu...

Yes, I remember we used to have DR DOS (Digital Research DOS). And at some point the latest version of windows at that time (I know it was before 3.11), would either not install or not run, seemingly random. My dad knew that MS made it hard to have windows in non MS DOS, so he tried a bunch of times, but in the end gave up and removed DR DOS so we could have Windows
{"deleted":true,"id":50541874,"parent":50537364,"time":1794976012,"type":"comment"}
Agree 100%. Would love to try out their interactive artifact
>she was modifying an artifact through the Claude website and it was able to make changes to a local file on her desktop

And people wonder why we have so many things being attacked by agents…

So you mean if the CEO is using claude shouting "give Bob a raise" will actually work?
loading story #50539969
loading story #50539869
loading story #50537654
I would counter argue with "But chinese models use distillation of Frontiermodels..." which is different than being a Frontierlab or not clear how different it is.

But Microsoft coming from the side like this might be very different if it holds up.

For now I have not seen any credible evidence for "But chinese models use distillation of Frontiermodels...".

Of course, I would not be surprised if they also do this, mainly because after OpenAI and Anthropic have succeeded to gather most training information that was easily accessible in the past and now it has become much more difficult to do the same. For some information that was hoarded by OpenAI and Anthropic, public access may have become impossible otherwise than through their LLMs.

Nonetheless, distillation cannot be the main source of improvement for the Chinese models, among other reasons because even assuming that they may have access to a great number of fake accounts, there still is not enough time for a lot of distillation, taking into consideration the timeline of the releases, and it is not believable that the attempts to do distillation would not be detected quickly by OpenAI and Anthropic, leading to the banning of the fake accounts. While OpenAI and Anthropic provide negligible information about their models, the Chinese AI companies are much more transparent about their methods and we can see that there is a lot of diversity among their models and a lot of innovations with each new version.

Yeah, there is a limit to how much you can get from capturing reasoning traces. (Traditional distillation of weights is not possible via the API.)

Patrick Toulme noted a while ago that the biggest advantage of that in his opinion came from bootstrapping the post-training process: https://xxcancel.com/PatrickToulme/status/206921157543762774...

At Thinking Machines, they explicitly said that they used open-weights models for bootstrapping post-training, including Kimi K2.5: https://thinkingmachines.ai/news/introducing-inkling/

Speaking of Thinking Machines, that's another data point. Their Inkling Small 2 model is just a bit behind DeepSeek V4.1 Flash 1017 in benchmark, and in my tests, that seems to be accurate, but mostly because they used less training data for pre-training, so they have less of a knowledge base, while similar reasoning capabilities. (One of the most interesting parts of Inkling Small 2 is that their training must have been very cost-efficient, apparently using less, but higher quality training data.)

And we're now seeing more and more Western near-frontier models from labs other than Anthropic and OpenAI to question whether distilling reasoning traces is really much of a difference maker.

Personally, my theory is that the gap is primarily due to Chinese labs having a harder time getting the necessary compute (especially top of the line GPUs) for training. These are, as far as I can tell, orders of magnitude differences in availability, so it wouldn't be surprising that a large compute gap is reflected in capabilities (and also indirectly visible through model sizes).

I don't think there is perfect proof, but its taken as truth.

Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".

My assumption is, that Chinese model found things Frontierlabs already had but didn't share. There was this paper were i had the feeling that this was a real and significant Research Result from Deepseek "DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression" but otherwise its just unclear.

The main issue is, that as long as it seems plausable that they do distillation, its hard to determine how big the gap is.

Not saying they can't catch up but they are also potentially limited by resources (money & nvidia GPUs)

> Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".

There is evidence that some Chinese labs have been training on frontier model CoT (in particular from the analysis of reasoning traces [1]), but what models claim about their identity is pretty much worthless as evidence. LLMs are not self-aware. These claims come from whatever is in their training data, and Claude/GPT output including such statements is all over the public web, including in some huggingface data dumps. Consider that people got Opus claiming to be Qwen or DeepSeek when asked in Chinese, and you'll see how weak this particular evidence is.

[1] E.g. https://arxiv.org/abs/2608.09867

loading story #50538932
The thing that makes me think they do it is that you can tell there is more of a difference in personality between Gemini and Opus for example, than between Opus and most other models
Heck, they destroyed some rare physical books after scanning them. Something to show their mentality.
That isn't countering though. Pointing out that distillation makes it "easy" for other labs to catch up, in a matter of months, supports the lack of a moat.

It's like they're runners drafting behind the lead runner. It is easier to run in their wake. If the lead wants to stay in front, they have to keep running into the wind.

Do they need to stay in front though? Because if it is 25% the cost, I'm happy to be one leg behind the leader.
The distillation argument is stupid in any case and only people that don't understand training, post training or RL can make such asinine arguments.
> I would counter argue with "But chinese models use distillation of Frontiermodels..." which is different than being a Frontierlab or not clear how different it is.

This reeks of a desperate attempt to convince yourself that "Chinese models" are worse than they are, in spite of actually being on par if not better than some so-called frontier models.

It's same blend of comments that accuse open weight models of being economic warfare.

After a point, references to "Chinese models" start to sound like a dog whistle. I mean, who walks around talking about "American models" ?

Perhaps it's high time that "Chinese models" are given some respect. They outperform models from openai and Anthropic and constantly show up in the Pareto front. That's quite the achievement, isn't it?

Even if OpenAI/Anthropic remain "a few months" ahead of open weight models indefinitely that still is not great news for them.
loading story #50537791
loading story #50537854
loading story #50548791
Openai and Anthropic are better at making models easily available too. Both Google and Microsoft are using promotional pricing to push their models and that should tell you how far they are from actually competing.

Also model availability is not easy. Google newest models are unavailable on some pro accounts and perform best only with Antigravity. Trying to plug it in some other harness and its terrible. If you try to connect your subscription with Hermes etc you might get banned.

Microsoft models are hidden away in Azure.

So every time I read Google/MS announcements I just shrug. If I want to use models like these I might as well get DeepSeek on Openrouter instead.

I disagree, I think distillation hides the true technical advantage since you can always get within X% of Claude by ex: training on newly created code on Github, but the underlying intelligence is harder to replicate.
based on the behavior of the chinese labs it seems like training on chain-of-thought is extremely important for distillation, and you can't get that by training on llm generated text.
Why would you hate and why would anybody care?

Time and time again it's been clear that LLMs are commodities with no winners. You'll jump where wallet and performance in your applications will bring you.

loading story #50539031
They’ve been ahead of the pack by 3-6 months for years now. I doubt that’s sustainable in the long term, but it’s apparently sustainable on the order of a few years.
> They are better than the rest of the available models currently, but only by a few months.

I think only google is catching up, and others plateaued.

Are they ahead in any way that matters? I've never run into something DeepSeek can't do
loading story #50537116
the gap is bigger than you think and widens on niche tasks
Anti distillation efforts have greatly increased the difference between open and closed models
loading story #50541022