Last night, Lemmygrad went down due to a hardware glitch on our VPS provider. Unfortunately, they were unable to do anything to help me fix the issue, and asked that I reinstall from scratch 🙁 . They did inform me that the hardware issue at fault is fixed at least.

I do daily backups, so we lost a day of posts.

Pictures are in the process of being restored now, but it should take a day or so to restore them all.

Let me know if there are any other ongoing issues so I can fix them. Again, sorry everyone.

  • Capitalist Tears
    link
    fedilink
    arrow-up
    12
    ·
    2 years ago

    Being involved in devops, I can relate to how much this sucks and I appreciate you taking the time to fix it. o7

    • Muad'DibberOPMA
      link
      fedilink
      arrow-up
      8
      ·
      2 years ago

      Thanks comrade, ya these can be nightmare scenarios. I at least have several backup locations, so at most we lose a day’s worth of data.

    • panic
      link
      fedilink
      arrow-up
      6
      ·
      2 years ago

      I’m not involved in this type of work but I would just pull the plug, I can’t understand the amount of patience you need for this shit

      • Muad'DibberOPMA
        link
        fedilink
        arrow-up
        3
        ·
        2 years ago

        Everything will be going fine for weeks, and then: oopsie poopsie everything’s gone!

    • Capitalist Tears
      link
      fedilink
      arrow-up
      5
      ·
      2 years ago

      Anecdotally, my instances have poofed into thin air even on AWS, so this seems not too rare. You use a managed database or something you’ve setup yourself?

      • Muad'DibberOPMA
        link
        fedilink
        arrow-up
        4
        ·
        2 years ago

        Set up ourselves. Its postgres running in a docker container, with daily backups.