Easiest way to archive an entire website subdirectory

This page summarizes the projects mentioned and recommended in the original post on /r/WaybackMachine

Scout Monitoring - Rennaisance engineers rejoice! 1 gem 5 min to app monitoring
5-minute onboarding. No sales team. Devs in the support channels. No DevOps team required. Get the free app insights every engineer deserves with Scout Monitoring.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • wayback_archiver

    Ruby gem to send URLs to Wayback Machine

  • HTTrack seems to be a popular option, but I don't have a Windows or Linux machine, as I exclusively work on a Mac, and it doesn't appear to be compatible with MacOS. I also found WaybackArchiver on GitHub, but I'm out of my depth just trying to follow the installation instructions. I like to think i'm tech literate, but I only have a vague understanding of sitemaps, let alone how to use a crawler or what a Gemfile even is.

  • Scout Monitoring

    Rennaisance engineers rejoice! 1 gem 5 min to app monitoring. 5-minute onboarding. No sales team. Devs in the support channels. No DevOps team required. Get the free app insights every engineer deserves with Scout Monitoring.

    Scout Monitoring logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Yahoo Answers to shut down May 4, 2021

    1 project | news.ycombinator.com | 5 Apr 2021
  • Is there a way to download all the files Internet Archive has captured for a domain? I am trying to recover tweets from a suspended twitter account, but the account as a whole was never captured in the Wayback Machine, just some individual tweets and json files.

    1 project | /r/DataHoarder | 27 Jun 2021
  • 简单run个脚本使用 wayback machine 接口批量备份知乎问题冲塔回答

    1 project | /r/CLTV | 29 Apr 2021
  • wayback-machine-scraper: NEW Data - star count:380.0

    1 project | /r/algoprojects | 10 Dec 2023
  • Scientist: A Ruby library for carefully refactoring critical paths

    1 project | /r/hackernews | 18 Nov 2023