That’s only going to affect me if I am reading something particularly boring and don’t really want to read it.
But if that were the case, I wouldn’t be reading it in the first place.

I don’t feel the need to rid myself of distractions, because when I am not in the mood to read a book, I don’t read it.

Also, this “distracted by functionality” logic is what parents seem to use to get rid of stuff with a screen.
I can say for sure, that people being loud in another room is a much bigger distraction.
If your OS is distracting you, you have installed the wrong one.