I’d say it depends on whether or not the voice actor whose voice the AI is imitating has agreed and is fairly compensated.

I’m imagining a game, where instead of predefined dialog choices, you talk into your microphone and the game’s AI generates the NPCs answer.