Free Python Web Crawler tutorial, Web scraping and crawling aren't illegal by themselves. After all, you could scrape or crawl your own website, without a hitch. ... Web scraping started in a legal grey area where the use of bots to scrape a website was simply a nuisance.