Yes, it will count towards your bandwidth.

I typically don’t get anywhere close to this though.

The few times I did were due to initiating large backups between devices, upwards of 2TB. But I’ve since moved my backup system to a mesh network and haven’t hit bandwidth overages since.