I use github.com/nosduco/nforwardauth for this purpose

There is an example implementation for caddy in github.com/nosduco/nforwardauth/tree/…/caddy-v2

or maybe voidauth could do it sh.itjust.works/post/42016490