It's not the ash, it's the tar. Smoke lingers in the air, cools, and condenses on surfaces including walls. It creates a fine film that sticks to everything. Sometimes it seems like it's even embedded into the paint but I'm no materials engineer.

Source: I grew up around chain smokers and my childhood best friend has 2 parents that constantly smoke indoors.