Hacker News new | past | comments | ask | show | jobs | submit
ahmadyan | on: #49732857
even in pre-training, usually 30%-50% is code these days.
leothetechguy | parent
That would be far too high in my opinion. But happy if anybody can give insights from their own experience with pretraining runs.