The fediverse originally had nothing to do with ActivityPub. Diaspora and ostatus were, and still are a part of it.

Although, the term seems to typically fixate on social networking.