don't worry, the AI guys who dismiss the METR paper are totally gonna do a better study that thoroughly refutes it with actual measurements, not just vibes
any time now
METR includes all the caveats. but nothing's stopping you from running simliar actual measurements, better. except not wanting to. wonder why.