To be a bit more precise, people did sometimes carry swords on their back, but generally not into battle. It was more comfortable for travel, but impossible to draw, so when they were expecting trouble they would move it to the hip.