Comment - FBXL Lotide

Comment on 3 days ago I said I needed a new hobby...

BlueEther@no.lastname.nz ⁨15⁩ ⁨hours⁩ ago

Well done on getting it up and running, federation seems to be working moplemmy.fyi/instances

You shouldn’t have to put instances in the Allowed Instances, just use blocked list for stuff you dont want to see

Yes email is a pain in the arse. More so if you are having to deal with dynamic IPs

Now just wait for the scrapers to turn up. Both Dave (lemmy.nz) and I are getting well in excess of 500k requests from content scrapers per day atm and they are tyring to pull in whole comment trees and walk through all posters.

Have a look at Iocaine to help tarpit some of them if you dont want to route through something like cloudflare.

original

Sort:hotnew top

mappe@moplemmy.fyi ⁨14⁩ ⁨hours⁩ ago

Ohh interesting, I have CrowdSec going but I like the sound of Iocaine as well, anything to screw with scrapers since that’s still on the to do list (robots.txt, etc).

original

BlueEther@no.lastname.nz ⁨14⁩ ⁨hours⁩ ago

Back up the server then work through:

Just follow the guide iocaine.madhouse-project.org/…/getting-started/ Bind the iocaine service to 0.0.0.0:42069

cat /opt/iocaine/etc/iocaine/config.d/00-server.txt.kdl 
http-server default {
  bind "0.0.0.0:42069"
  use handler-from=default
}

expose interface to Docker (make sure not to expose it to the world).

sudo iptables -I INPUT 4 \
  -s 172.18.0.0/16 \
  -d 172.18.0.1 \
  -p tcp --dport 42069 \
  -j ACCEPT

add the interface to the proxy service in a custom/docker-compose.yml.template

proxy:
    {{COMPOSE_CADDY_IMAGE}}
    env_file:
      - ./caddy.env
      - {{ CADDY_EXTRA_ENV }}
    volumes:
      - ./caddy/Caddyfile:/etc/caddy/Caddyfile:ro
      - caddy_data:/data
      - caddy_config:/config
    extra_hosts:
      - "host.docker.internal:172.18.0.1"
...

add iocaine to caddy in a custom/Caddyfile.template

{$LEMMY_HOSTNAME} {
        import caddy-common

        ######################################
        ########## log files        ##########
        log cn_blocked {
                output file /data/cn-blocked.log
                format json
                no_hostname
        }

        ########## iocaine  code ##########
        @read method GET HEAD
                reverse_proxy @read host.docker.internal:42069 {
                @fallback status 421
                handle_response @fallback
        }
...

rebuild all the docler images (at least the caddy one ./deploy.sh -f) and test

I think that should work

original

mappe@moplemmy.fyi ⁨14⁩ ⁨hours⁩ ago
Woh, thanks for all that! I have full backups going through restic so I can’t use that as an excuse not to play around with this over the weekend, heh

original