• RoundSparrow@lemmy.ml
    link
    fedilink
    arrow-up
    113
    arrow-down
    18
    ·
    11 months ago

    A reminder to move to smaller instances for a better experience

    A reminder that this constant advice people blindly parrot to install and flock to smaller instance has now created something like 1000 new servers in 50 days that are poorly run and already going offline as quickly as they went online.

    Github Issue 2910 is the kind of PostgreSQL problems that the developers ignored for months and people still defend the developer choices to have the code doing real-time counting of every single comment and post for numbers nobody needs to needs done in real-time.

    PostgreSQL is voodoo to this project, they do everything they can to avoid going to !postgresql@lemmy.ml community and asking for help, learning 101 about how to fix their SQL TRIGGER logic like Github Issue 2910 spelled out June 4.

    • remkit@lemmy.kya.moe
      link
      fedilink
      English
      arrow-up
      40
      arrow-down
      11
      ·
      11 months ago

      I know you are salty about how you are getting treated over at GitHub, but you should look at it objectively, Blaze is clearly advocating that people join top instances that’s not lemmy.world or lemmy.ml, not nobody instances that only have 1-2 users. They certainly aren’t going offline as quickly as they come online.

      • RoundSparrow@lemmy.ml
        link
        fedilink
        arrow-up
        14
        arrow-down
        24
        ·
        11 months ago

        I know you are salty about how you are getting treated over at GitHub

        No, it isn’t about my personal treatment. It’s about the cultist attitude you have towards Lemmy and the leaders without any ability to see what they are doing behind the scenes with the code. I know cults and religious faith is how many people enjoy the world.

        A 2-line SQL TRIGGER removal takes about minutes to fix. It was crashing the entire site constantly. They sat by and asked for donations of money.

        • Zetaphor@zemmy.cc
          link
          fedilink
          English
          arrow-up
          19
          arrow-down
          2
          ·
          11 months ago

          A 2-line SQL TRIGGER removal takes about minutes to fix.

          Then go fix it and open a PR

          • RoundSparrow@lemmy.ml
            link
            fedilink
            arrow-up
            8
            arrow-down
            17
            ·
            11 months ago

            Then go fix it and open a PR

            Do you think I am the one who created the mistake or something? That I have access to the servers to install it?

            It’s so odd to me that you respond this way, as if it was my coding mistake. It isn’t even me who opened issue, that is GitHub “makotech222” - is that your answer to them?

            • degrix@lemmy.hqueue.dev
              link
              fedilink
              arrow-up
              19
              arrow-down
              2
              ·
              11 months ago

              I don’t believe they’re insinuating that you were the one that created the mistake. Rather, that you seem to be knowledgeable of the specific problem and may be the one most capable of fixing it. The two line fix may be obvious to you, but may not to the main Lemmy devs. Until phriskey got involved, a lot of db tuning was being avoided (they’re responsible for most of the big db improvements this version).

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                4
                arrow-down
                6
                ·
                11 months ago

                a lot of db tuning was being avoided

                and I did not understand or properly relate to that project culture. It had been that way for years and I should have “read the room” “go with the flow”.

        • remkit@lemmy.kya.moe
          link
          fedilink
          English
          arrow-up
          23
          arrow-down
          14
          ·
          11 months ago

          No, it’s everything to do about your personal treatment, stop deceiving yourself. Just because you claim you have autism doesn’t immediately grant you the right to be entitled. You don’t get your way so you spam create multiple issues to call out the developers, and you expect people to believe it isn’t personal for you?

          If you aren’t happy with the Lemmy developers, fork the project, run your own fork, convince others to use your fork. It’s a FOSS world, no one has to do what you say, even if you claim to be autistic.

          • Ichebi@lemmy.pt
            link
            fedilink
            arrow-up
            14
            arrow-down
            8
            ·
            11 months ago

            Telling someone “you claim you have autism” is extremely ableist to all disabled people.

          • RoundSparrow@lemmy.ml
            link
            fedilink
            arrow-up
            4
            arrow-down
            20
            ·
            11 months ago

            convince others to use your fork.

            Reddit convinced people to use Reddit. Elon Musk convinces people to stay on Twitter. Donald Trump convinces people to vote for him.

            Just maybe the audience level of knowledge about the topics of media is the problem. You. Maybe you are actually attracted to Lemmy because it crashes, just like people flock to Donald Trump because he does bad things. And people flock to HDTV news instead of reading a book on a subject.

            It’s odd but not unexpected that you think the problem is code and does not involve the audience being attracted to certain characteristics. I hear McDondl’s has a lot of customers.

          • RoundSparrow@lemmy.ml
            link
            fedilink
            arrow-up
            6
            arrow-down
            24
            ·
            11 months ago

            Just because you claim you have autism doesn’t immediately grant you the right to be entitled.

            Entitled to what? free money? discount at the car wash? I see you like claiming things that I never said, who talked about deserving things or being entitled?

            perhaps you do not grasp that autism impacts my writing and the level of pain I have in communicating, even this very comment. It causes me huge pain and suffering to have my brain touch the keyboard and compose English sentences.

            Maybe you lack compassion for my suffering and you are a bully.

            • remkit@lemmy.kya.moe
              link
              fedilink
              English
              arrow-up
              14
              arrow-down
              6
              ·
              11 months ago

              Entitled to what? free money? discount at the car wash? I see you like claiming things that I never said, who talked about deserving things or being entitled?

              No, I never claimed that you said you were entitled. I claimed that you like using your autism as an excuse.

              perhaps you do not grasp that autism impacts my writing and the level of pain I have in communicating, even this very comment. It causes me huge pain and suffering to have my brain touch the keyboard and compose English sentences.

              See? Why make yourself suffer?

              Maybe you lack compassion for my suffering and you are a bully.

              Why do you deserve my compassion? You are literally hurting yourself by participating in discussions even when you claim, in your own words, “autism impacts my writing and the level of pain I have in communicating, even this very comment. It causes me huge pain and suffering to have my brain touch the keyboard and compose English sentences.”. If it hurts so much, get offline.

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                6
                arrow-down
                13
                ·
                11 months ago

                I claimed that you like using your autism as an excuse.

                you used the word entitled, or are you confused? Now you are saying it is an excuse?

                It’s a fact, it impacts my every word I’m typing on this keyboard, every single English word I speak, read, write, type, hear. It causes bullies and hate-filled people who hate human beings to flock to you to try to “correct” everything about your existence and behavior. Like you are doing.

                Do you know the history of Autism in Nazi Europe where it started to get documented? Do you know how humans treat those with mental differences? Is it all your game to imply that love and kindness is shown towards those who speak and behave oddly?

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                4
                arrow-down
                14
                ·
                11 months ago

                If it hurts so much, get offline.

                that is all you car about, not having to encounter words you disagree with, to drive off human person you don’t like. It’s sad to see the popularity of people like you, Donald Trump likes to harm others and gets big crowds too.

                • remkit@lemmy.kya.moe
                  link
                  fedilink
                  English
                  arrow-up
                  12
                  arrow-down
                  4
                  ·
                  11 months ago

                  If you willingly hurt yourself, or your brain, conversing online, then you shouldn’t be using it as an excuse to get your point across. The advice was given, if it hurts, stop doing it, is that really that hard to explain?

                  • RoundSparrow@lemmy.ml
                    link
                    fedilink
                    arrow-up
                    5
                    arrow-down
                    5
                    ·
                    11 months ago

                    is that really that hard to explain?

                    to you, yes. As I don’t think in flippant attempts to trivialize human beings and reduce things to simpleton answers for something they have struggled with each and every day of their life. It sure is easier to dehumanize me as you keep doing.

                    writing online is about the only thing in my life that I can do, despite the constant pain, and I’m near death. Once the writing goes, there is zero left, I’m not even really surviving.

                    Simon Baron-Cohen; July 1, 2003; “The Essential Difference: Male And Female Brains And The Truth About Autism”, page 146 quote: “Another man with AS described his life in a very graphic way: ‘Every day is like climbing Mount Everest in lead boots, covered in molasses. Every step in every part of my life is a struggle.’”

        • notfromhere@lemmy.ml
          link
          fedilink
          arrow-up
          3
          arrow-down
          3
          ·
          11 months ago

          What is a SQL trigger and why is it taking down servers? Do you know how to fix it?

          • RoundSparrow@lemmy.ml
            link
            fedilink
            arrow-up
            1
            arrow-down
            1
            ·
            11 months ago

            I think 0.18.3 fixed some of it, but there are likely some more performance issues related to PostgreSQL lurking in Lemmy.

            A TRIGGER in SQL is a logic that executes based on other activity.

            Lemmy uses them so that when you create a new comment or post, it executes code to insert tracking record for votes and comments on a post. One of the things Lemmy does is called site_aggregates, and there was a bug where it was updating the counts for 1500 servers instead of just the one server. That got fixed in 0.18.3

            Deleting accounts in lemmy was causes crashes. I’m not sure if that has been entirely resolved. These things are all kind of hidden in the background of the code, so a lot of developers overlooked that there were problems in them.

            • notfromhere@lemmy.ml
              link
              fedilink
              arrow-up
              2
              arrow-down
              1
              ·
              11 months ago

              Isn’t there a logstream they could tap into to have a separate async tally going on instead of doing it synchronously? Probably a lot of things could be delegated to an async job performed when server load allows?

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                4
                arrow-down
                2
                ·
                edit-2
                11 months ago

                I’ve had to really adjust my thinking with this project. They want to do things a very particular way and it goes back 4 years, and a lot of the mistakes are just now getting noticed/attention. For example, comments were not deleting on all the servers, I was testing that after comparing server copies of the same communities and found they were not the same. It just didn’t seem to have a lot of people spot-checking it for mistakes. I am learn to just “go with the flow” and face that it’s more like how musicians would approach design and running a project. Media-focused systems can be that way.

                • notfromhere@lemmy.ml
                  link
                  fedilink
                  arrow-up
                  7
                  ·
                  11 months ago

                  Going with the flow is both ways. It’s a community project so everyone’s opinion matters, especially those who contribute PRs.

    • Blaze@sopuli.xyzOP
      link
      fedilink
      arrow-up
      31
      arrow-down
      4
      ·
      11 months ago

      A reminder that this constant advice people blindly parrot to install and flock to smaller instance has now created something like 1000 new servers in 50 days that are poorly run and already going offline as quickly as they went online.

      I am always advocating for any of the top 25 instances that are not Lemmy.world or Lemmy.ml

      For the rest of your post, I don’t know what that has to do with people aggreating on LW.

      • RoundSparrow@lemmy.ml
        link
        fedilink
        arrow-up
        7
        arrow-down
        2
        ·
        11 months ago

        For the rest of your post, I don’t know what that has to do with people aggreating on LW.

        aggregation refers to the lemmy database tables, site_ aggregates, community, person. The SQL TRIGGER logic lemmy_server uses that has been the source of so many crashes the past 60+ days.

        • Blaze@sopuli.xyzOP
          link
          fedilink
          arrow-up
          16
          arrow-down
          2
          ·
          11 months ago

          Even if the SQL was top notch, it would not be a good thing for 50% of the active users to be on a simple instance. Just makes it easier to take down by any potential attacker.

          • RoundSparrow@lemmy.ml
            link
            fedilink
            arrow-up
            8
            arrow-down
            29
            ·
            edit-2
            11 months ago

            Shit dude, you still going on about the GitHub issues?

            Is it your cult loyalty to the pro-China project leaders speaking? The authoritarianism that you honor? Do you have blind faith in machine code and are unable to see the level of effort they make to avoid the performance critical code in the application?

            Did their words “high performance” on GitHub mesmerise you into believing it without actually installing the Rust code and looking at their performance your own self?

            • remkit@lemmy.kya.moe
              link
              fedilink
              English
              arrow-up
              25
              arrow-down
              14
              ·
              11 months ago

              Sorry to tell you this, but you need to stop being overly obsessed over the Lemmy project. It is not healthy for you. Go do something better with your life. With the amount of enthusiasm you are showing, I bet you can find the cure for cancer.

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                5
                arrow-down
                15
                ·
                11 months ago

                I bet you can find the cure for cancer.

                If the cure to cancer were found, like a virus to prevent deaths from COVID-19, sites like Twitter and Lemmy would spread lies and disinformation and tell people to avoid authentic facts and science.

                Is it the pro-China stance of the developers that gives you blind faith in how their SQL TRIGGER code works or Rust logic?

                Sorry to tell you this,

                I doubt your sincerity and think this is a social tactic you use, lies. Insincerity.

                It is not healthy for you

                The lies coming out of Elon Musk’s Twitter and the lies from Cambridge Analtica on Facebook make me ill. The constant people I meet in the USA who praise oil consumption and deny climate change science makes me sick. I didn’t stubble into Lemmy because I was healthy with crowds of people who flock to anything in “meme format” and praise authoritarian politicians and businessmen.

                Based on how humanity behaved during the pandemic, with all the denial of a virus that a microscope can deonstate as fact, I don’t think it is possible to be healthy unless you choose to self-deceive and believe the memes and advertisements.

                • remkit@lemmy.kya.moe
                  link
                  fedilink
                  English
                  arrow-up
                  11
                  arrow-down
                  3
                  ·
                  11 months ago

                  If the cure to cancer were found, like a virus to prevent deaths from COVID-19, sites like Twitter and Lemmy would spread lies and disinformation and tell people to avoid authentic facts and science.

                  Maybe, maybe not. It’s up to the reader to differentiate between facts and tales. I don’t see how that is relevant.

                  Is it the pro-China stance of the developers that gives you blind faith in how their SQL TRIGGER code works or Rust logic?

                  No, I believe the project is in need of a lot of polish. However, the way you act, makes me hope the polish does not come from you.

                  I doubt your sincerity and think this is a social tactic you use, lies. Insincerity.

                  Okay.

                  The lies coming out of Elon Musk’s Twitter and the lies from Cambridge Analtica on Facebook make me ill. The constant people I meet in the USA who praise oil consumption and deny climate change science makes me sick. I didn’t stubble into Lemmy because I was healthy with crowds of people who flock to anything in “meme format” and praise authoritarian politicians and businessmen.

                  Have you considered turning off your computer, and looking out the window? Looks like the problems you are facing can be solved rather easily. There is neither Twitter nor Facebook out the window.

                  • RoundSparrow@lemmy.ml
                    link
                    fedilink
                    arrow-up
                    3
                    arrow-down
                    2
                    ·
                    edit-2
                    11 months ago

                    It’s up to the reader to differentiate between facts and tales. I don’t see how that is relevant.

                    Perhaps you do not see it is relevant, or that you are being insincere on the topic

                    Humanity track record is to avoid truth and favor mythology. I can suggest Carl Sagan’s 1995 book on the subject.

                    Have you considered turning off your computer, and looking out the window?

                    Yha, all the people around me are staring into their Smartphones and attacking humanism on social media like you are.

                    There is neither Twitter nor Facebook out the window.

                    You apparently can not see them with their Smartphone while driving and doing practically anything.

                    You quoted it in your reply, but you obviously ignored this: “The constant people I meet in the USA who praise oil consumption and deny climate change science makes me sick.”

                    Meet, in person, IRL, “outside the window” as you call it. You clearly do not care for reality of humanity and what is actually happening because of media like Twitter, Reddit, Lemmy.

    • Dubious_Fart@lemmy.ml
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      6
      ·
      edit-2
      11 months ago

      A reminder that this constant advice people blindly parrot to install and flock to smaller instance has now created something like 1000 new servers in 50 days that are poorly run and already going offline as quickly as they went online.

      And this will always… always be the biggest problem in the FOSS community.

      “I dont like X, so I’m going to leave and make my own version of X”

      So userbases get spread thin, manpower gets spread thin, developers get spread thin, and the user experiences degrades for everyone until it pushes them back to the bullshit websites and products.

      • poVoq@slrpnk.net
        link
        fedilink
        arrow-up
        17
        arrow-down
        3
        ·
        11 months ago

        This is exactly what federation is meant to solve: power in numbers without the centralization. Is that so hard to understand?

        • Blaze@sopuli.xyzOP
          link
          fedilink
          arrow-up
          19
          arrow-down
          2
          ·
          11 months ago

          Sometimes I question why people not in favor of the decentralization are commenting on a Fediverse platform. Why not go to Tildes, Squabbles or another centralized alternative? There is plenty of fish in the sea.

          • Dubious_Fart@lemmy.ml
            link
            fedilink
            English
            arrow-up
            10
            arrow-down
            9
            ·
            11 months ago

            This is another big problem in the FOSS

            “If you dare offer valid criticism, then why are you even here? get out and go somewhere else!”

                • pjhenry1216@kbin.social
                  link
                  fedilink
                  arrow-up
                  9
                  arrow-down
                  1
                  ·
                  11 months ago

                  Pot calling the kettle black. I offer criticism of your criticism and you throw a hissy fit. Poor child.

                  • Dubious_Fart@lemmy.ml
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    arrow-down
                    2
                    ·
                    11 months ago

                    Wow, I havent gotten a genuine, unironic “No, U!” since like kindergarten.

      • pjhenry1216@kbin.social
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        11 months ago

        Your answer didn’t justify lemmy.world being treated the same as Lemmy as a whole. It’s just a bunch of people who don’t understand federation.

      • RoundSparrow@lemmy.ml
        link
        fedilink
        arrow-up
        5
        arrow-down
        9
        ·
        11 months ago

        For the rest of your post, I don’t know what that has to do with people aggreating on LW.

        And, factually, the project leaders telling everyone to create 1000 new instances and shutting down sign-up on Lemmy.ml caused more performance problems.

        They had a bug in their PostgreSQL TRIGGER logic where 1500 instances were updating + 1 comment and +1 post counting instead of WHERE site_id = 1, a single database row. So each new Lemmy server that went online made the table larger and crashes more frequent on lemmy.ml

        The amount of disk writing by lemmy was ignored

        • remkit@lemmy.kya.moe
          link
          fedilink
          English
          arrow-up
          16
          arrow-down
          5
          ·
          11 months ago

          They’ve neither told people to create 1000 new instances, nor have they closed signups on lemmy.ml.

          Again, you should really stop revolving your entire life over one GitHub issue, and go touch grass.

            • remkit@lemmy.kya.moe
              link
              fedilink
              English
              arrow-up
              11
              arrow-down
              2
              ·
              11 months ago

              The irony in you saying that, and posting second-hand recounts by other people. They aren’t closed. If they are closed, you wouldn’t even be able to submit a registration application.

              • ramplay@lemmy.ca
                link
                fedilink
                arrow-up
                4
                arrow-down
                3
                ·
                11 months ago

                Man reading this thread, you’re kind of a dumbass. Especially if you think rewording your answer here from the last reply to reframe to current time period vs what was being talked about would throw off the scent

                • remkit@lemmy.kya.moe
                  link
                  fedilink
                  English
                  arrow-up
                  12
                  arrow-down
                  1
                  ·
                  edit-2
                  11 months ago

                  They’ve not closed sign ups. Requiring approval of sign ups, is not closing sign ups. How am I wrong?

                  • ramplay@lemmy.ca
                    link
                    fedilink
                    arrow-up
                    1
                    ·
                    11 months ago

                    Currently no. But they had, which was clearly stated as it was talking on the past.

              • RoundSparrow@lemmy.ml
                link
                fedilink
                arrow-up
                2
                arrow-down
                6
                ·
                edit-2
                11 months ago

                If they are closed, you wouldn’t even be able to submit a registration application.

                Show me in the code. Because I have closed the registration on my Lemmy server, and it does not turn off the “Sign Up” link or HTML input fields. But you sure like lies and deception

      • RoundSparrow@lemmy.ml
        link
        fedilink
        arrow-up
        3
        arrow-down
        13
        ·
        11 months ago

        The developers of Lemmy seem to make every effort they can to avoid using Lemmy itself to discuss their !postgresql@lemmy.ml learning 101. They have made massive mistakes in SQL TRIGGER logic that they avoided to such a degree that their social motives are in question now. Github Issue 2910 was opened June 4, almost a month before the Reddit API deadline, and they ignored it. Just like they hang out on Matrix Chat and don’t use Lemmy their own self to discuss code.

        They have cultivated a kind of voodoo attitude towards PostgreSQL where people using Lemmy won’t actually scrutinize the Rust code or PostgreSQL tuning parameters.

    • HughJanus@lemmy.ml
      link
      fedilink
      arrow-up
      7
      arrow-down
      2
      ·
      11 months ago

      I mean having a bunch of new servers is not a problem. Just choose one that’s been up for a while and more stable.

      • RoundSparrow@lemmy.ml
        link
        fedilink
        arrow-up
        9
        arrow-down
        3
        ·
        11 months ago

        But each additional row in site_aggregates table was causing the instability itself. The SQL code had major flaws. Adding more servers actually made Lemmy crash more.