My campus is working on upgrading our redunant 100gb ISP connections to 400gb next summer, so not necessarily just for HPC/AI/‘massive datacenter’.
Granted, our 100gb edge routers are reaching end of life, and a LOT of grant proposals will be able to put down “400gb uplink on our campus”, which helps lands money. The actual bandwidth utilization normally peaks at like 22gbps.