The moat for OAI and anthropic seems to be very quickly shrinking. Chinese labs are now using RSI-like approaches and even without resorting to heavy distillation they're catching up in a couple of months vs. what would have been 6-12 months a year prior.

And as these models get better the pace of training is quickly speeding up too.

This doesn't bode particularly well for anthropic/OAI after they go public.