Take sex off the table for the first few times of him staying over. he might be more comfortable if he knows theres no expectation of boinking.

Then when he’s more relaxed with the idea of staying over down the road you can reintroduce the idea. don’t pressure tho