The story says:

After days of concern over use of the chatbot to alter photographs to create sexualised pictures of real women and children stripped to their underwear without their consent

Pictures of women or children in underwear are generally not illegal in the United States.