I think you're either looking for a tunnelling solution or a Web Application Firewall. And there are several options. ModSecurity, or SafeLine, BunkerWeb, Coraza, open-appsec. For (AI) crawlers and bad bots we have Anubis, Iocaine... or something like more traditional blocklists or something like OpenResty which is some modified Nginx plus modules...