I wouldn’t want to deal with additional background characters either even if they played the role for free.

It’s just more contracts to be signed, more people on set, more potential things that don’t go as planned. Its a lot of extra work and organisation needed for something that pretty much no normal viewer would notice.