AI crawlers, fetchers are blowing up websites; Meta, OpenAI are worst offenders
Link: https://www.theregister.com/2025/08/21/ai_crawler_traffic/
Discussion: https://news.ycombinator.com/item?id=44971487
AI crawlers, fetchers are blowing up websites; Meta, OpenAI are worst offenders
Link: https://www.theregister.com/2025/08/21/ai_crawler_traffic/
Discussion: https://news.ycombinator.com/item?id=44971487
If you have a fediverse account, you can quote this note from your own instance. Search https://social.lansky.name/users/hn100/statuses/115067408178412343 on your instance and quote it. (Note that quoting is not supported in Mastodon.)