some ISPs have done sneaky shit like prioritising speedtest sites, while throttling everything else.

Yes, and I really dislike that. In my estimation, speed.cloudflare.com gives you a more comprehensive snapshot. Sites like fast.com, or you ISP’s own speed test usually concentrate on download speed and don’t actually measure under load, along with other variables.