Thank you very much! This is probably the best answer.

For anyone from the future reading this: From my understanding almost every SBC does not really work with “Linus Torvalds’ Linux” which is why one often sees HW manufacturers also providing their own Linux image with the computer. This is fine for development but honestly not something I would want for self hosting stuff. There are few exceptions like the Raspberry Pi but that one is not that much open source. So imo the best option is to look at ubuntu.com/download/risc-v where Ubuntu provides “official” images for few RISC-V boards. (The Visionfive 2 is what lead me there.)