worst deals given to the poorest people, who are least likely to have other options
Financially, giving the higher price to those who have fewer options is exactly “what it should be” so it makes sense that a pattern finding algorithm trained to maximize profit produces such a result.
It’s Ethically and Morally that this is the very opposite of “what it should be”.