> I never understand the “only a next token predictor” argument

Yeah, that's typically the case for people who have no clue about LLMs or AI.