Thoughts and ideas on FOSS software that needs to be done. Personally i’ve been thinking on working in an offline marxist.org (like arch-wiki-docs)

  • Arsen6331 ☭
    link
    52 years ago

    Recursive wget seems to be working fine. I just had to add a 500ms request delay. I’ve already got 683 MB of data and I’m only downloading HTML, so it’s definitely massive.

    • Muad'DibberA
      link
      42 years ago

      Nice. Will be interested to see how big everything is after a first pass converting to markdown. Keep me posted.