Hacker News new | past | comments | ask | show | jobs | submit
Well this scraper honours robots.txt so I'm sure most AI crawlers will find it useless.