Comment

Comment on The Internet is not forever after all: CNET deletes old articles to game Google

skankhunt42@lemmy.ca ⁨10⁩ ⁨months⁩ ago

Unfortunately, we are penalized by the modern Internet for leaving all previously published content live on our site

Even if this is true, which I doubt, why not edit your robots.txt to disallow them to index it and leave the content up?

Sort:hotnew top

plz1@lemmy.world ⁨10⁩ ⁨months⁩ ago
That wouldn’t generate news hype

source
Puzzle_Sluts_4Ever@lemmy.world ⁨10⁩ ⁨months⁩ ago
Because then they are hosting content that actively won’t show up in any search?

Hosting web content (especially with lots of images) costs money. Historically, sites like cnet were built around ad revenue. It is worth keeping a review of a 2001 GE Refrigerator online if it comes up when people search for the model number (generally to figure out specs to shop for a replacement). It is not worth it if that is showing up when people want to buy a 2023 GE Refrigerator or actively penalizes you for having too much “old” content and so forth.

And if it won’t generate any ad revenue going forward? baleeted!

source