I looked up the advice I had blindly followed and apparently milk jugs are biodegradable. That’s good for the environmentalists, but not for water storage. That said, stored water won’t “go bad”. It won’t even acidize like a glass of water on your countertop.