That’s a false equivalence. “Stupid” isn’t the same as any of the words in the diagnosis “mental retardation” (recently updated to intellectual disability). Your example would work better if you did it like this:

Like me saying that you’re retarded shouldn’t imply that you have mental retardation.

There, that’s a much closer analogy. Do you still stand by your point if we use a proper equivalence?