I tried a USB KVM switcher. I only recall there were serious issues and it didn’t last long.

Now I use a high quality USB dock and physically unplug/re-replug a work and personal laptop. That’s been a simple and reliable solution.

For my home server, I ssh into it.