As someone that has recently built out a once-daily crawler for a not so ban-happy site, thanks for the article.

I haven’t had to go the CV route yet, but I know it’s a matter of time once they “improve” the site and it starts breaking regularly.