Yes, each new communities needs to be manually added to each instance and subscribed to by a local user. Lemmy-federate is a service that instances sign up to to federate all new communities added there across the fediverse. Most instances are on it.