The userbase is not that important with activity pub. If the features are good they can grow slowly and still enjoy the whole fediverse. Of course it is important to have users at all. Otherwise it doesn’t make sense to put work on the software.