If you self-host services on the internet, you may have seen waves of crawlers hammering your websites without mercy.

To annoy them and protect my services from DDoS, I decided to setup an iocaine instance, along with NSoE... And it worked... Too well.

Recently, they started flooding my VPS so much it started choking.
If you followed me here on Fedi, you saw my journey to find a way to relieve my server.

This is a rant about LLM crawlers, and some observations & conclusions, along with some techniques to help you protect your own services.

Read it here: xaselgio.net/posts/26.poisonin

0
0
0

If you have a fediverse account, you can quote this note from your own instance. Search https://eldritch.cafe/users/Soblow/statuses/116059748458304085 on your instance and quote it. (Note that quoting is not supported in Mastodon.)