Indeed. Additional context will influence the response, and not always in predictable ways… which can be both interesting and frustrating.
The important thing is for users to have sufficient control, so they can counter (or explore) such weirdness themselves.
Education is key, and there’s no shortage of articles and guides for new users.