imitate human speech
Good point on bringing this up. It’s imitation. The moment it needs to make - arbitrary decision and context which is a thing we need to do a LOT on a daily basis - it is useless, but AI creators thought they could circumvent this by making the AI say: “Oh! Sorry, you are correct, it is exactly what you said” after you give it the context only your human persona can grasp.
Had they called this letters or words calculator, it would be much more ethical than calling this AI. Hence why the bubble is bursting, lying to people about it’s capabilities. It is just a new calculator for phrases instead of numbers.