I don't know about you, but I only notice when it's a wildly different pic, usually nsfw. Probably just bias, I bet it happens all the time with pics that seem somewhat related or it's a topic (and picture) you don't care about.