Why are you running two HAProxy instances? You should be able to forward the traffic on your VPS to your homeserver with a firewall rule.

If that’s not an option, this should still be doable using the X-Forwarded-For header. Instead of setting it to single value, you need to append to it:

developer.mozilla.org/en-US/…/X-Forwarded-For#syn…