Except that’s not actually an issue in practice. In a real-world conversation you would disambiguate with “Let’s get breakfast” or “Let’s get dinner” if you’re not referring to the immediate future. I honestly can’t think of a single time that I’ve been genuinely confused in this way.