It’s likely for activating voice input, but you didn’t give the keyboard app permission to use the mic or something. Usually on keyboard apps there’s a key you long press to get to settings, and you might be able to get rid of it there.