It’s tricky to make a recommendation as pretty much all the home lab stuff that people typically run can be done so on a potato, which is why RPis are so popular.

An N100 would definitely be a step up from the pis and meet your stated needs. They are super popular, in a multitude of formfactors so should be able to find something you like. But you may get the itch to upgrade further if you expect to expand or experiment extensively. Like any hobby, it’s generally easy to justify to yourself that you need to get that “next cool/better/faster/prettier thing” so such an itch may be unavoidable no matter what you get.

Instead of worrying about performance, as pretty much any modern miniPC should outclass a Pi, take a look at the specific form factors that are available. Do they have the expansion, networking you need? Can you stick this thing somewhere out of the way and not worry about it taking too much space or making too much noise? Are you comfortable with their level of support/warranty? Expect garbage/non-existent support from most of the miniPC specialty brands out there, which includes minisforum which I recommended in another comment. If you outgrow it, are you comfortable with it being e-waste/have a means of repurposing it?