13 Feet Ladder

Submitted ⁨⁨10⁩ ⁨months⁩ ago⁩ by ⁨tree@lemmy.zip⁩ to ⁨selfhosted@lemmy.world⁩

A site similar to 12ft.io but is self hosted and works with websites that 12ft.io doesn’t work with.

How does it work?

It pretends to be GoogleBot (Google’s web crawler) and gets the same content that google will get. Google gets the whole page so that the content of the article can be indexed properly and this takes advantage of that.

link: github.com/wasi-master/13ft

source

Comments

Sort:hotnew top

Qwaffle_waffle@sh.itjust.works ⁨10⁩ ⁨months⁩ ago
Where are the metric versions? I want my 3 meter ladder.

source
- MacNCheezus@lemmy.today ⁨10⁩ ⁨months⁩ ago
  Clone the repo and make it yourself.
  
  source
- spechter@lemmy.ml ⁨10⁩ ⁨months⁩ ago
  Most often I use it, it’s too avoid metrics.
  
  source
redcalcium@lemmy.institute ⁨10⁩ ⁨months⁩ ago
It amazes my that all it takes is just changing user agent to Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) and it can bypass paywalls on many sites? I thought those sites would try harder *e.g. checking if the ip address is truly belong to google", but apparently not.

source
- andrew@radiation.party ⁨10⁩ ⁨months⁩ ago
  Checking ip ownership is a moving target more likely to result in outcomes these sites don’t want (accidentally blocking google bots and preventing results from appearing on google).
  
  Checking useragent is cheap, easier, unlikely to break (for this purpose, anyway) and the percentage of folks who know how to bypass this check is relatively slim, with a pretty small financial impact.
  
  source
  - douglasg14b@lemmy.world ⁨10⁩ ⁨months⁩ ago
    It’s not necessarily a moving target when entire blocks can be associated with Google.
    
    source
    -> View More Comments
- aniki@lemm.ee ⁨10⁩ ⁨months⁩ ago
  Same. I thought there would be more stuff happening in the background but when I saw it’s just hijacking the google bot headers to display the html i was a bit disappointed it’s so stupidly easy.
  
  source
thanksforallthefish@literature.cafe ⁨10⁩ ⁨months⁩ ago
1ft.io also seems to work and by the branding seems unrelated to 12ft

source
SeeJayEmm@lemmy.procrastinati.org ⁨10⁩ ⁨months⁩ ago
I’ve been happy withhttps://github.com/everywall/ladder

source
- tootbrute@piefed.social ⁨10⁩ ⁨months⁩ ago
  I use this, too! It's great but doesn't always work.
  
  source
CCMan1701A@startrek.website ⁨10⁩ ⁨months⁩ ago
Loaded the docker for fun on my NAS. I don’t need it, but other users in my home may appreciate this.

source
knova@infosec.pub ⁨10⁩ ⁨months⁩ ago
Love it! Deployed it this morning.

source
jadelord@discuss.tchncs.de ⁨10⁩ ⁨months⁩ ago
Seems like this can be done in the browser using a user agent switcher.

source
PlexSheep@feddit.de ⁨10⁩ ⁨months⁩ ago
So ist this an http proxy? I don’t quite get it.

source