If you use the definition from On Bullshit, then bullshit is a statement made without regard for truth value because of its utility to the speaker.

As such, LLMs can only bullshit.