Add ‘-nobattleye’ to the Steam command-line launch options and you can play single-player without any installs.

(Rockstar really should’ve made this a separate launch option like other games do)