Comment on Claude Code deletes developers' production setup, including its database and snapshots — 2.5 years of records were nuked in an instant

SapphironZA@sh.itjust.works ⁨10⁩ ⁨hours⁩ ago

• daychilde@lemmy.world ⁨10⁩ ⁨hours⁩ ago

  AND something tested to restore successfully, otherwise it’s just unknown data that might or might not work.

  (i.e. reinforcing your point, no disagreements)

  source

  • mic_check_one_two@lemmy.dbzer0.com ⁨10⁩ ⁨hours⁩ ago

    AKA Schrödinger’s Backup. Until you have successfully restored from a backup, it is just an amorphous blob of data that may or may not be valid.

    I say this as someone who has had backups silently fail. For instance, just yesterday, I had a managed network switch generate an invalid config file for itself. I was making a change on the switch, and saved a backup of the existing settings before changing anything. That way I could easily reset the switch to default and push the old settings to it, if the changes I made broke things. Sure enough, the change I made broke something, so I performed a factory reset and went to upload that backup I had saved like 20 minutes prior… When I tried to restore settings after the factory reset, the switch couldn’t read the file that it had generated like 20 minutes earlier.

    So I was stuck manually restoring the switch’s settings, and what should have been a quick 2 minute “hold the reset button and push the settings file once it has rebooted” job turned into a 45 minute long game of “find the difference between these two photos” for every single page in the settings.

    source

    • Rolder@reddthat.com ⁨9⁩ ⁨hours⁩ ago

      Always a fun time when technology decides to just fuck you over for no reason

      source
    • daychilde@lemmy.world ⁨5⁩ ⁨hours⁩ ago

      That’s always just one of the worst feelings in the world. This thing is supposed to work and be easy and… nope. Not there. It’s gone. Now you have work to do. heh

      source
    • vandsjov@feddit.dk ⁨9⁩ ⁨hours⁩ ago

      But the backup software verified the backup!

      source
  • Whitebrow@lemmy.world ⁨10⁩ ⁨hours⁩ ago

    Schrödinger backup

    source
• Krudler@lemmy.world ⁨2⁩ ⁨hours⁩ ago

  Circa 1997 I was making some innovative new games, employed by a dude who’d put millions of his own money into the company. He was completely nonplussed when I brought him 20 CDs in a sealed box to remove from the building and store off site. He thought I’d lost my damned mind and blew it off as ravings of a stressed dev. I pointed out real threats to our IP including the hardware failures and even so far as the building burning down. 2 years of custom art and code gone. “Unlikely. Relax.”

  After I moved on… an ex co-worker who’s still a longtime friend, tells me a different division lost a huge amount of FMV over some whoops-I-destroyed-the-wrong-drive blunder. 20 days to render on an 8 or 10 machine farm. Poof - No backups. In 1997 even with top-of-the-line gear it took an insane investment to render quality 3D.

  The friggin’ carelessness irks the shit out of me as I type ahah

  source
• tetris11@feddit.uk ⁨9⁩ ⁨hours⁩ ago

  3-2-1 Backup Rule: Three copies of data at two different types of storage media, with 1 copy offsite

  source
• SreudianFlip@sh.itjust.works ⁨7⁩ ⁨hours⁩ ago

  Fukan yes

  • D\L all assets locally
  • proper 3-2-1 of local machines
  • duty roster of other contributors with same backups
  • automate and have regular checks as part of production
  • also sandbox the stochastic parrot

  source
• OrteilGenou@lemmy.world ⁨8⁩ ⁨hours⁩ ago

  I remember back when I first started seeing a DR plan with three tiers of restore, 1 hour, 12 hours or 72 hours. I knew that to 1 hour meant a simple redirect to a DB partition that was a real time copy of the active DB, and twelve hours meant that failed, so the twelve hours was a restore point exercise that would mean some data loss, but less than one hour, or something like that.

  I had never heard of 72 hours and so raised a question in the meeting. 72 hours meant having physical tapes shipped to the data center, and I believe meant up to 12 (though it could have been 24) hours of data lost. I was impressed by this, because the idea of having a job that ran either daily or twice daily that created tape backups was completely new to me.

  This was in the early aughts. Not sure if tapes are still used…

  source
• HugeNerd@lemmy.ca ⁨8⁩ ⁨hours⁩ ago

  A LTO drive with a non-consumer interface?

  source
• prenatal_confusion@feddit.org ⁨8⁩ ⁨hours⁩ ago

  We still say that.

  source