Why must the concept of time before the big bang (or after our heat death) exist in our physical reality for us to speculate about theoretical infinities past those? The thought experiment is about ~infinite~ time, not all the time in our limited universe. A lot of things happen at infinity that break down as soon as you add a limit, but we’re not talking limits when we’re talking infinity.