Lead poisoning probably didn’t impact empire in any significant way, also romans were aware that lead is poisonous. Insane instability of later empire might have much bigger impact on fall of western empire.