Is there a central repository with AI bot crawler IP addresses and user agents somewhere?
I have a small one with the main AI products, but looking to expand.
Is there a central repository with AI bot crawler IP addresses and user agents somewhere?
I have a small one with the main AI products, but looking to expand.
If you have a fediverse account, you can quote this note from your own instance. Search https://noc.social/users/dcid/statuses/114824516035350366 on your instance and quote it. (Note that quoting is not supported in Mastodon.)