Not only not insane, but actually a great idea, for all the reasons you mentioned, but also because it’ll be x86 where the Pi is ARM, so software compatibility will be that much better.