those doing the investigative work, away from public interaction (and possible abuse), are not the root of the problem there

They’re the root of privacy problems, which is a non-trivial issue for many of us.