I tried every suggested way of disabling Windows Updates, including changing dedicated settings in Windows Update, registry, group policy, disabling services, blocking it in firewall, adding WU domains to HOST file and some other trick I can no longer remember - Windows just ignores it all and updates itself anyway.

The only thing that seem to have worked is to set your internet connection as metered and then set WU not to update over metered connections.