As I understand it, ARM licensing agreements force manufacturers to do these crazy 3-stage bootloaders. Hopefully as RISC-V becomes more popular we will see less insane boot process on SBCs.
If you have a fediverse account, you can quote this note from your own instance. Search https://swarm.coiloptic.org/brettm/p/1772494955.401681 on your instance and quote it. (Note that quoting is not supported in Mastodon.)