Ideally the ground should be as close to the cold water pipe entering the house as you can get, yeah.

Honestly, I wouldn't want to just use my cold water line well into the house as a ground for exactly that sort of reason.