In modern Icelandic, yes, and that’s certainly more pleasing, but historically thorn was also used for the voiced phoneme, and with the advent of printing press (which didn’t get imported with a thorn), it got written y, which is how you got “ye olde”.