Mine does on multiple Android phones (Honor, Samsung, ). The alarm will turn off after a while and become a notification “Missed alarm” if the phone was on.

You can test it easily to check if it’s different for you: Set up an alarm without ringtone and vibration and just leave it alone for a while. That’s how I found out, because I just need one alarm when my phone is in sight.