Somebody invents an amazing new technology that lets you code 10,000 times faster with guaranteed correctness. You consider using it, but find out very early on it that using it will cause the death of both your maternal grandparents.
Do you use it?
Now, vary the consequences. Just one of them? Both your parents? Your next door neighbor? Someone you don't know and have never met in a country 10000 miles away? A small village in a dry land? 40% of all the birds living today?
Which of the possible costs of your adoption of this incredible new technology would stop you from adopting it, and which will you choose to ignore?
What kind of arm-chair, ultra-utilitarist thought experiment ist this
It's a consideration of LLM adoption using hypothetical negative externalities that are qualitatively different than the ones typically being thought about, to try to force the point that there are negative externalities and that few people are really dealing with them in realistic ways.