Our reference is warmth. Thermometers measure the activity of atoms which is proportional to temperature.