• kabi@lemm.ee
    link
    fedilink
    arrow-up
    9
    ·
    5 months ago

    I was going to mention ArchiveTeam’s warrior because I thought it wouldn’t be listed, since computing isn’t really the important thing you’re donating, more your virgin IP address and internet connection… but it’s third on the list!

    • Nighed@feddit.uk
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      5 months ago

      How much does it spam, if I run it am I likely to get ip banned anywhere?

      …Or in trouble for ‘visiting’ unsavoury sites?

      • kabi@lemm.ee
        link
        fedilink
        arrow-up
        5
        ·
        5 months ago

        There are always several projects to choose from.

        The URLs project plays it fast and loose and archives an assortment of random URLs. This one has an IP block warning.

        Some have NSFW warnings.

        Other projects aim to archive a single site as accurately as possible (possibly with a deadline when the site is shutting down), so they can’t afford to have their warriors blocked or rate limited. If you are, that would be because of an issue. You can choose to archive sites you don’t want to visit to avoid issues.

      • Appoxo@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        5 months ago

        Just limit it to one job per session.
        I ran 3 continuous jobs while archiving reddit and could still connect without issue.