Now this is a cool new trick that is definitely borderline on the halon razor (is it a fuck up? or is it someone doing something malicious?)

This LLM crawler is supplying two different user-agent headers presumably with the idea to confuse systems that restrict or log user-agent values

Vn4Sb4Sv6T5xW3ZG52.png
0

If you have a fediverse account, you can quote this note from your own instance. Search https://benjojo.co.uk/u/benjojo/h/fTKQv1834WL3CGF7y5 on your instance and quote it. (Note that quoting is not supported in Mastodon.)