In geography academia, “small town” usually means a place that has a name and between 5000 and 50000 inhabitants. Though I suspect that a large part of the confusion here is that a lot of US towns are very low density and don’t have anything like a center. So those towns are themselves rural in look and feel, regardless of total population.