Even if earth just gets pulled away from the sun a little we are screwed.

I get what you’re saying, but had to laugh at the use of “a little” here. The goldilocks zone in the solar system is roughly the between the orbits of Venus and Mars, and we’re almost right in the middle of it, so “a little” is like 150 million km.

I would imagine that the first issue we would experience would be that the moon would be pulled out of Earth’s orbit first and then we lose the ocean tides and the stable tilt of the earth. It would probably get worse from there.