It's a bit funny to me that non deterministic black boxes and even seed optimisation are just accepted as normal in FPGA design...

I think a key difference compared to software is that acceptance criteria are a lot clearer (some of it due to nature of the substrate, but others because the culture seems to more readily accept performance trade-offs upfront).