Hacker News new | past | comments | ask | show | jobs | submit
You... Do know that people scrape websites for non-AI reasons, right?
Why should the site owners be interested in allowing them to do that?
Because it's legal to scrape websites? And, oh, I don't know, maybe people like me might want to archive those websites for historical reasons?