Hating work is good, wanting it to all be automated is good. It is a pro-human flourishing stance, whereas keeping the majority of humanity laboring in jobs they dislike just to survive is against human flourishing in favor of the status quo.
People are worried that if they lose this leverage, nothing is stopping the few who have most of the capital to just disregard the needs of the masses.
Not without a concrete answer for how we all continue to survive and thrive when our jobs are replaced. And that's the part the AI boosters are silent on, beyond vague notions of UBI.
People may hate their job, but they will hate being unemployed way more.
Automating away the drudgery or dangerous parts of life seems inherently good. But I would argue that AI has not been awesome at that, really. There are certainly cases where it has lessened tiresome work, but there are just as many cases where AI is worsening the pleasant parts of life. And I don't know anyone who has experienced shorter work weeks because AI is doing stuff for them.
Under capitalism, AI is converting labor power of ordinary people to "property" owned by the owning class. It is making the rich richer. It doesn't really improve my state of being.