Yes! There’s actually a fictional universe way ahead of you. See, for example, the Sundrivers, which use their star systems for thrust: www.orionsarm.com/eg-article/478adb4aeb392

Or Dyson Beams, used to propel large spacecraft and for communication: www.orionsarm.com/eg-article/48fe49fe47202

Planets arranged as phased array communicators/propulsion are quite common.

But there are more exotic solutions here too, like re-arranging stars into more compact configurations, or “metric” engineering involving warping space time in theoretically plausible, non relativity violating ways. This even (theoretically) allows for the creation of wormhole network and highly relativistic spacecraft, though with immense difficulty and complications, and no true FTL.

As an addendum, you actually don’t need to go millions of years into the future! A few millennia is plausibly enough for feats of engineering that are way beyond our comprehension: www.orionsarm.com/xcms.php?r=oa-timeline