Misalignment won’t look like Terminator. It’ll look more like an optimization run that treats human survival as distraction to their goal completion. Humans first build a system to solve incredible difficult jobs like protein folding. But, more importantly, they give AI instrumental goals to ensure its own persistence so it can finish the job. Hence, when the AI becomes misaligned from human values, it ain’t because it hate you. It just wants to route around you because you’re suboptimal. Power grids would get rededicated to compute clusters. Fresh water gets diverted to cool server farms. The atmosphere gets scrubbed or poisoned as a byproduct of a chemical synthesis the AI considers more mathematically elegant. To them, math is clearly more elegant than organic respiration. That said, you aren’t exactly exterminated. You’ll just get un-metered out of existence because your continued presence introduces too much fluctuation. After all, humans are indeed fickle as hell. submitted by /u/sourdub
Originally posted by u/sourdub on r/ArtificialInteligence