Þ is a thorn. It makes a th sound, as in the or Thor, also written as þe and þor. When using a printing press most typesetters did not have a thorn, so a y was used as a replacement, causing things like ye oldde, rather than the oldde (þe oldde).