Welcome to Capitalism, where you can lose your vision because some corporation didn’t get enough money.

  • FuckBigTech347
    link
    fedilink
    arrow-up
    2
    ·
    2 years ago

    some of which I wrote myself (search engine)

    Meta search engine or independent with its own crawler?

    • Arsen6331 ☭OP
      link
      fedilink
      arrow-up
      1
      ·
      2 years ago

      Metasearch engine that strips all identifying information and generates a random user agent for every request. I also have it going through a VPN so that my IP can’t be used for identification.

      • FuckBigTech347
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        2 years ago

        If you ever want to go independent, since some search engines (namely Google and DuckDuckGo) censor search results, there is always YaCy.

        If you do want to give it a try make sure to run it on decent machine (good performing multi-core CPU, at least 8 GB of free RAM and at least 1 TB of storage space).

        I actually have been running my own YaCy instance on my homelab Server for a few months now. Currently it has indexed about 13 million web pages. Right when this shit with Ukraine started and I read that DuckDuckGo is now censoring russian search results I had enough. And first thing I did was search for things like “China concentration camps” or “North Korea escape” and blacklisted all the US media that popped up. Like you said:

        These corporations are a plague upon this earth.

        • Arsen6331 ☭OP
          link
          fedilink
          arrow-up
          2
          ·
          2 years ago

          Yes, YaCy is great, but I currently don’t have a free machine with enough resources. I run most of my services from Single Board Computers because they’re very power efficient and cheap. Most services don’t use anywhere near their capacity, so I have plenty of room to expand. The unfortunate downside is that I can only run resource-intensive programs on my powerful servers that are all currently in use. I am getting some more powerful servers though, and might run YaCy when I do.