Cloudflare, which works to stop scraping bots, launches its own scraping bot

Cloudflare, a US-based company that works to prevent bots from scraping content off of websites, has now launched its own scraping bot. "One API call and an entire site crawled. No scripts. No browser management. Just the content," Cloudflare said while releasing the tool. After backlash over being hypocritical, Cloudflare clarified that the bot follows "crawling best practices".

Load More