Why does it have to be either/or?
From a high-level view, there are powerful cultural/political forces that nudge us towards building harmful, wasteful things without us being aware of said forces. The government, corporate greed, and billion-dollar marketing budgets are to blame.
But on the ground, from an in-the-trenches perspective, I think an engineer at Meta, for example, shares in some level of blame, too. Mainly because there is plenty of evidence showing how much harm Meta products have brought upon society. Yet Meta couldn’t be built without engineers opting in to work there in exchange for $300k salaries.
We desperately need moral clarity and courage at both the policy-level and the individual level.
Are we all going to stop building things until the government is fixed and all political problems are resolved? No? Then we must think about how we should build in a world with imperfect government.
Sure, IF we could just go and fix our governments in some magical way then the problem would disappear. That goes from hunger, climate change, videogame addiction and AI. The problem is that what you value in life in different than what others do, so we now have a system in which sometimes you get what you want and sometimes you don't.
But back to the topic, I do think that how OpenAI and Anthropic handled the government and them asking to drop guardrails is something a company can actually and actively do without having to reinvent the universe.
Everyone likes to talk about "fixing the government". It feels nice to understand the problem with something else that is broken. The problem is that replacing the people in charge is a no-op if you don't have a pool of good people to choose from and the will to choose them.
"That which can be automated by the AI should be."
Like it or not if you knowingly build stuff that is used for evil purposes you are complicit
You can't build an orphan mulching machine and get away with just a shrug. "I don't really agree with mulching orphans but someone else paid me to build that. If I didn't build it someone else would have" just does not absolve you of your involvement in mulching orphans