Thoughts and ideas on FOSS software that needs to be done. Personally i’ve been thinking on working in an offline marxist.org (like arch-wiki-docs)

  • Arsen6331 ☭
    link
    fedilink
    arrow-up
    5
    ·
    3 years ago

    Recursive wget seems to be working fine. I just had to add a 500ms request delay. I’ve already got 683 MB of data and I’m only downloading HTML, so it’s definitely massive.

    • Muad'DibberA
      link
      fedilink
      arrow-up
      4
      ·
      3 years ago

      Nice. Will be interested to see how big everything is after a first pass converting to markdown. Keep me posted.