So you’re saying that they need to direct the WOL unicast, on the same segment, to the MAC and not the IP, yes?

Then if they are in a remote subnet/LAN/network, they’ll need to contact something local to generate the unicast packet.