I’m finding it a little hard to follow your description sorry, but couldn’t you do something like: Outside Internet -> Modem -> Router -> network switch -> devices?

Sounds like you just might need a network switch with more ports.

And I feel like it’s not a good idea to have a modem directly attached to the pc directly unless you’re using it as a router?