Comment on Nearly all of Spotify has been scraped and is available via torrents

sbv@sh.itjust.works ⁨13⁩ ⁨hours⁩ ago

• borokov@lemmy.world ⁨13⁩ ⁨hours⁩ ago

  Yep, most of tracks were already available on “various” sources, but this time they directly scraped the whole Spotify database.

  It’s really nice from them to backup Spotify database on a distributed system, and for free ! This ensure Spotify business won’t be endanger in case of critical hardware failure.

  source

  • halcyoncmdr@lemmy.world ⁨9⁩ ⁨hours⁩ ago

    So nice of them to help with Spotify’s off-site backup.

    source
• JASN_DE@feddit.org ⁨13⁩ ⁨hours⁩ ago

  It’s new insofar as this is one big scrape. About 300TB iirc.

  source

  • HeyJoe@lemmy.world ⁨13⁩ ⁨hours⁩ ago

    300tb is a lot, but its kind of crazy to think this entire company only needs 300tb storage arrays to function. I wonder how they handle things internally. I would imagine at least 1 backup server ready to go in HA. I wonder if they have multiple regions across the country that also serves up the same setup.

    source

    • capuccino@lemmy.world ⁨12⁩ ⁨hours⁩ ago

      They need other 300TB to store all the ads.

      source

      • mojofrododojo@lemmy.world ⁨10⁩ ⁨hours⁩ ago

        “Are you an incel with few friends, no job, and a deep seated hate for melanin? COME JOIN ICE!”

        source
    • rainwall@piefed.social ⁨7⁩ ⁨hours⁩ ago

      Likely cloned Netflix’s “netflix in a box” arctecture, where they drop a large 200TB+ NAS in different CDN datecenters with their most populuar content cached so that total traffic is minimal across the internet at large.

      Spotify mainly being music with very little video likely makes this even easier.

      source
    • JohnEdwa@sopuli.xyz ⁨10⁩ ⁨hours⁩ ago

      IIRC there’s still like 700TB of low popularity music missing, but it is only something like 0.4% of listens.
      And they need a more storage overall because they have to set up datecenters around the world - doesn’t make sense to stream tens of millions of connections across the ocean. But that also gives all the backups one would need for “free”.

      source
    • Duke_Nukem_1990@feddit.org ⁨10⁩ ⁨hours⁩ ago

      Afaik 300 TB is just the most popular music and around a third of all tracks. The blog post is quite entertaining tho.

      source
    • OrganicMustard@lemmy.world ⁨8⁩ ⁨hours⁩ ago

      There are 245 TB ssd drives now. You can almost fit that in a single drive.

      source
    • CarbonatedPastaSauce@lemmy.world ⁨12⁩ ⁨hours⁩ ago

      [deleted]

      source

      • HeyJoe@lemmy.world ⁨11⁩ ⁨hours⁩ ago

        Oh I know, I work in the industry as well. Our company backups alone for workstations and servers is just under 1 petabyte. This is then replicated to an offsite location which is also out disaster recovery location, and also stored in long term storage in Azure. This is just backups, sooo much money for backups haha. Thats why I am shocked that this entire company can run off of 300tb which is a lot, but nothing when you think of it being the entire business model for them.

        I think the craziest thing ive seen is we have these instruments that do genome testing and sequencing and they would create like 10tb worth of data per month. Every month they got there own 10tb drive handed to them to backup their stuff on there own on top of the ones we did for them.

        source
• navigator@piefed.zip ⁨10⁩ ⁨hours⁩ ago

  Not mine, because I’m not famous enough for people to pirate my music lol. It would be flattering for me to be included in this batch of scraped music.

  source

  • FatVegan@leminal.space ⁨9⁩ ⁨hours⁩ ago

    I’d steal your music

    source
  • selokichtli@lemmy.ml ⁨9⁩ ⁨hours⁩ ago

    If your Spotify popularity is not 0, you probably are in the scraped archive.

    source