If you want to go tiny you could get an Anbernic Gameboy like the RG35xxSP. They run Linux with a gaming UI on top. But it’s very easy to run full desktop Linux distros on them.

Skip to 5 minutes. youtu.be/EvbGb_rHFqk