That is why upterm & tmate exist… ephemeral shared SSH sessions. Biggest missing feature would be some sort of scoping since someone could raw dog your system—catting SSH keys, deleting config, force pushing a repo if unlocked keys are in memory.