Serious question, why do we give so much power to these tech firms such as Google, when really the solution is decentralization. We have some solutions for money with bitcoin, but there still doesn’t seem to be a viable alternative with a search engine that is decentralized?

  • @TheAnonymouseJoker@lemmy.mlM
    link
    fedilink
    193 years ago

    Because Google, Bing (less prominently Yandex and Baidu) have an oligopoly on how most of the world searches things.

    Search engine indexing takes years, and open source engines lack the infrastructure to speed up web crawling. SearX is just an instance hoster, a proxy. We have Yacy, Wiby, Mojeek, Metager and some other niche search engines. Then we have Qwant, that indexes its own and supplies results using Bing that it has not indexed yet. Then there is DuckDuckGo with its own indexing but is USA based. Then there is System1’s StartPage, essentially a Google proxy with no self indexing that is hostile to Tor users.

    Then there are others.

    I settled on using Qwant for searching and Yandex via VPN for reverse image searching. Startpage is used extremely rarely and with VPN.

    • @throwaway284921384@lemmy.mlOP
      link
      fedilink
      -33 years ago

      I don’t see why we can’t just have something like a blockchain based search engine where crypto is given based on how much indexing (crawling) is done. Of course this is just an idea right now. But have an incentive to people to do crawling of it through something like blockchain. This ensures that there won’t be any centralization and search result manipulation with things such as psyops (brain washing the population through search results)

      • @TheAnonymouseJoker@lemmy.mlM
        link
        fedilink
        20
        edit-2
        3 years ago

        Blockchain is a meme. It is the same buzzword lalaland meme that is AI in phone software these days.

        LokiNet and Adamant are probably the only serious attempts I have seen in a while, and even they did not get me interested to check them out. If something does not get me tingly in the sack, it is not worth.

        • @sia@lemmy.ml
          link
          fedilink
          23 years ago

          Wait until you see what TV makers mean with AI. I recently found a setting ‘AI Brightness’ on my LG TV, which just sets the brightness relative to the environment, measured by a light sensor.

          • @TheAnonymouseJoker@lemmy.mlM
            link
            fedilink
            13 years ago

            The kind of BS sold to people is hilarious. Every phone has some AI thing, but the only phones with AI NPU chips initially were from Huawei and Apple. Qualcomm followed through years later, and the OEMs that used Qualcomm never really utilised the NPU while calling their features AI.

            People fell hard for the AI meme without knowing what it is. But then, what do people even know?

      • @whatihear@lemmy.ml
        link
        fedilink
        23 years ago

        Blockchain is not a good fit for a distributed search engine, since each node needs to store the entire chain. It’s possible that some sort of system for using a blockchain based token to incentivize participation in an IPFS like network would help provide a funding model for publishing the index, but that would just be one small component in a decentralized search engine, and not even the most interesting one.

  • @Danrobi@lemmy.ml
    link
    fedilink
    19
    edit-2
    3 years ago

    Of course theres decentralized search engine. If everyone was using YaCy and would run a crawl of everything that is missing in YaCy, nobody would need Google search engine, period!

    New Edit:

    To run YaCy less demonic (low resources device)

    Controlling cpu usage :

    At the /PerformanceQueues_p.html page, you can limit some threads (light processes inside the JVM) maximum numbers (in the Thread Pool Settings table). When you are crawling, you can also control the Speed / PPM (Pages Per Minute) in the /Crawler_p.html page.

    • ReK2
      link
      fedilink
      33 years ago

      biggest problem with yacy is that is slow java, they should had done this on C or GO/RUST now a days

        • ReK2
          link
          fedilink
          -13 years ago

          it is slow if you “have to” install the java JDK etc on a “clean” system just to run a java app. and we can argue about java vs go another time.

    • Bilb!
      link
      fedilink
      33 years ago

      I have tried running YaCy as a senior node recently. I couldn’t get the crawler to work for some reason. I’ll have to look into it again some time.

  • Dreeg Ocedam
    link
    fedilink
    123 years ago

    when really the solution is decentralization

    Why would it be? It will always be faster to bring updates, improve algorithms on a centralized system, while also being better in terms of UX.

    We have some solutions for money with bitcoin

    Solution to what? The only solution Bitcoin brings is to decentralize centralized currencies, at the cost of privacy, lack of accessibility to most people, and unbelievable energy consumption.

    • @PyotrGrowpotkin@lemmy.ml
      link
      fedilink
      143 years ago

      energy consumption

      Bitcoin alone draws more electricity than the whole of Netherlands now. It’s network is basically a crime against humanity at this point. And I say this as someone with a (small, tiny even) stake in it.

      It’s negated all gains made by renewable energy, and for what. A “currency” that is even more centralized in the hands of few people than fiat money is.

      • @Bloodaxe@lemmy.ml
        link
        fedilink
        43 years ago

        I really like Nano for this exact reason (and quick/feeless payments ofc). Bitcoin is just too powerhungry… But who knows if any cryptocurrency could ever reliably replace fiat.

        • Dreeg Ocedam
          link
          fedilink
          43 years ago

          But who knows if any cryptocurrency could ever reliably replace fiat.

          The answer is never. Pretty much no one is able to keep a private both secret AND not lose it for a long period of time. It’s not a problem when people lose their PGP keys for example, as they can always create a new one and tell people to use the new one, but with crypto, losing your key means losing your money. Imagine if you lost your bank account because your computer burned in a house fire and you never backed-up your key. If cryptocurrencies became the norm, that would happen to way to many people.

          • @roastpotatothief@lemmy.ml
            link
            fedilink
            13 years ago

            Bitcoin is digital cash - this is a quite complete analogy.

            Like cash, you can keep it in your possession, so you can lose it in a fire, or else you can put it in a bank.

            • Dreeg Ocedam
              link
              fedilink
              13 years ago

              So you rely on a bank for your transactions, completely negating the only benefits of cryptocurrencies.

              • @roastpotatothief@lemmy.ml
                link
                fedilink
                1
                edit-2
                3 years ago

                Nah there are lots of benefits, both for the society and the individual. That’s getting off topic though.

                I’m just saying you have options. You can have the same anti fire security as with fiat. In fact you can do all the same things with crypto as you can do with fiat cash, if you want to.

      • @throwaway96581@lemmy.ml
        link
        fedilink
        33 years ago

        It’s negated all gains made by renewable energy

        Last time there were research it was driven by 70% of renewable energy. More than most industries.

        It actually increases investment into renewable energy by making it more profitable to produce renewable energy.

          • @throwaway96581@lemmy.ml
            link
            fedilink
            13 years ago

            You dont get it.

            Much of the energy used would be thrown away wasted. The mining use that energy that otherwise would just be overproduced and thrown away and convert it into coins, thus making production of renewable energy much more profitable than it would otherwise be and thus accelerating the expansion of renewable energy.

            Thus it is not a crime, it actually helps motivating building more renewable energy.

      • @throwaway284921384@lemmy.mlOP
        link
        fedilink
        23 years ago

        the main issue I see with bitcoin is that so many people are investing in it and not using it for its real purpose (an alternative to actual money). The fact that the fed prints money while bitcoin is finite shows that there will be less inflation issues. Although I am not an economist

        • @PyotrGrowpotkin@lemmy.ml
          link
          fedilink
          13 years ago

          It’s a “currency” where the majority of currency got handed out to very few people very early on. It’s has a more concentrated level of wealth than the real economy has. And the energy use is a far bigger issue than all others.

          • @throwaway96581@lemmy.ml
            link
            fedilink
            23 years ago

            It is way more distributed than wealth in the normal fiat system in which only a few owns 50% of all the wealth.

            Unlike that system you are also free not to use it.

            You also have the opportunity to get other coins or versions that are cheaper.

      • ghost_laptop
        link
        fedilink
        -33 years ago

        Although I know you are right, I kinda feel the whole energy consumption issue isn’t a big thing, or rather it wouldn’t be if miners would be able to use green energy for them, I don’t care if it consumes a lot of energy if it could help to create a decentralised and fungible currency.

        And while BTC certainly has it flaws at least it helped to the creation of better forms of the same concept which could help to achieve that, like Monero or Pirate Chain.

        • @PyotrGrowpotkin@lemmy.ml
          link
          fedilink
          23 years ago

          would be able to use green energy for them

          you do realize that producing green energy is quite energy intensive right and most of the materials are non recyclable?

          Using the green energy we produce to keep a network of money for speculators running is just beyond silly.

          The cryptocoin gang are so detached from reality its not even funny at this point.

          • @throwaway96581@lemmy.ml
            link
            fedilink
            13 years ago

            Proof of stake is simply giving new money for free to those who are already rich. Proof of work means that there was a verifiable cost behind each coin produced, so was not just handed out for free to the rich.

            • @roastpotatothief@lemmy.ml
              link
              fedilink
              1
              edit-2
              3 years ago

              I’ve always been curious about “proof of being a human” but in not sure if any system has seriously experimented with that.

              • @throwaway96581@lemmy.ml
                link
                fedilink
                13 years ago

                When we have an decentralised global anonymous or private ID system, it would be the best and most fair way to distibute an decentralized currency.

                Thus a decentralised global anonymous ID system would probably be the most important system in humanities evolution in order to create a fair world.

                • @roastpotatothief@lemmy.ml
                  link
                  fedilink
                  13 years ago

                  How would it work then, practically? How would you prove your ID corresponds to a real human? Even better, is it possible to prove every ID corresponds to a unique human?

    • @DrivingForce@lemmy.ml
      link
      fedilink
      23 years ago

      Why would it always be better in terms of UX? Nothing is stopping a decentralized system from having good intuitive UIs.

      • Dreeg Ocedam
        link
        fedilink
        1
        edit-2
        3 years ago

        Just the fact that you have many providers is a already a UX challenge. Either you have a “default” provider were everyone will flock (for example gmail for email), making decentralisation pointless or you force people to chose between many smaller providers, and most won’t want to make such a decision before even beginning to use the service and just leave.

        • @DrivingForce@lemmy.ml
          link
          fedilink
          13 years ago

          I don’t see how that is challenging for users unless they are so lazy that they won’t even change any setting on their device regardless of how annoyed they are. If the app has a directory of instances with their bios linked it can make it easier for them.

  • @Nevar@lemmy.ml
    link
    fedilink
    53 years ago

    What do you mean by decentralized? Searx actually works better than Google with it’s meta search capabilities and the fact you can host it anywhere, it is decentralized.

    Are you referring to some sort of decentralized indexing of the internet?

        • @leanleft@lemmy.ml
          link
          fedilink
          63 years ago

          pros:

          • powerful customization. intuitive and fine grained.
          • decentralized. huge power but not perfected.
          • crawler is simple and customizable. fairly raw.
          • solr/lucene benefits included from day 1.
          • website that covers the basics. and forum for help.

          cons:

          • frequently buggy and feels heavy
          • documentation. very little documentation. many good features that are difficult to discover or use.
          • consumes alot of storage. not dividable.
          • setup takes time
          • no foolproof simplicity. and less adoption due to setup time+difficulty.
          • not recognized as important and not very popular. which is a self-fulfilling prophecy.
          • not too many maintainers/contributors. slow development.

          alternatives:
          none
          there are many alternatives for more efficient small personalized search engines with medium startup time and skill level.
          a crawler can be more customizable if you script it yourself. (for yacy or whatever else)

          • @Danrobi@lemmy.ml
            link
            fedilink
            23 years ago

            To run YaCy less demonic (low resources device)

            Controlling cpu usage :

            At the /PerformanceQueues_p.html page, you can limit some threads (light processes inside the JVM) maximum numbers (in the Thread Pool Settings table). When you are crawling, you can also control the Speed / PPM (Pages Per Minute) in the /Crawler_p.html page.

        • @xe8@lemmy.ml
          link
          fedilink
          33 years ago

          https://arborist.wip2p.eth.link/#!/goyacy

          I’m new to YaCy and not aware of what may or may not be working but I just saw this mentioned as a “frontend for searching YaCy without having to remember which node to use”.

          Anyway, I’m gonna give it a try.

          What’s not working? Is it a matter of needing more crawlers as @Danrobi@lemmy.ml mentioned, or something else?

          • Bilb!
            link
            fedilink
            13 years ago

            Wow, 2/3 times I tried searching through this site I got a dead (or otherwise inaccessible) node.

            • @xe8@lemmy.ml
              link
              fedilink
              13 years ago

              Yeah, basically the same for me. Sometimes it works ok. Sometimes I get infinite loading.

  • ufra
    link
    fedilink
    43 years ago

    it’s a good question, I don’t know if any of the great minds of search have tried to do something decentralised and what kind of pushback it might receive from the search cartel. It seems like ipfs and peertube might be some fertile grounds for researching it further.

  • Serge Tarkovski
    link
    fedilink
    33 years ago

    Because it’s hard, requires A LOT of resources so that it’s way easier to ask “why is there still no decentralised search engine?” than actually implement it.

      • Serge Tarkovski
        link
        fedilink
        13 years ago

        Actually, maybe also because it requires even more resources as to build and maintain a proper decentralised software is technically harder than to do the same for a centralised search. And also because investing such resources means more donating them to the whole community rather than making profit, so those resources must not be the someone’s last penny.