I have always kept my personal files on a separate drive, and then deleted the folders in ~/ (such as Documents, Downloads) and replaced them with links to their respective counterparts in my media drive. But this has not been robust – Firefox often recreates ~/Downloads, and other small problems. I recently saw a comment here about having a partition just for the home folder, and was interested.