Alphonso is listening for TV sound signatures, which while definitely intrusive and privacy invading, is not the same as 24/7 listening for voice-to-text purposes.

They would only need to listen for a second or so to determine what channel you are on, instead of all the time, so there is a massive difference in scope.

They are effectively shazaming your TV.

Still creepy and invasive, but not 24/7 recording invasive.