wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication. (by ArchiveTeam)
Add to my DEV experience webarchiving warc wget Lua Archiving Crawler crawl Crawling Spider archiveteam wget-lua Zstd Ftp Scraper Scraping crawlers Downloader
Source Code
archiveteam.org
wget-lua Reviews
Suggest alternative
Edit details
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Wget-lua Alternatives

Similar projects and alternatives to wget-lua

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better wget-lua alternative or higher similarity.
Suggest an alternative to wget-lua

wget-lua reviews and mentions

Posts with mentions or reviews of wget-lua. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-02-10.
  • Alternative to HTTrack (website copier) as of 2023?
    4 projects | /r/DataHoarder | 10 Feb 2023
    You're using it wrong, rtfm, wget is still the standard. It's also extensible beyond the base feature set, take for example wget-lua ArchiveTeams well maintained go to for near all scraping projects by the group.
  • Kiwix - Access Wikipedia (And More) With no Internet
    1 project | /r/selfhosted | 4 Dec 2021
    There are updates changed names but still use more frequent updates than the dumps to get started. I know there is kiwix and xowa. Could probably build it up to current and use wget-at to scrap wikipedia solo. If you want it in html it'll proboy only be a hundred 100TB give or take. I'm wondering if any of the groups are still active on IRC. Saw mentions of a few but I lost my place in all the mobile chrome tabs.

Stats

Basic wget-lua repo stats
2
83
6.1
4 months ago

ArchiveTeam/wget-lua is an open source project licensed under GNU General Public License v3.0 only which is an OSI approved license.

The primary programming language of wget-lua is C.

Popular Comparisons

  1. wget-lua VS 7-Zip-zstd
  2. wget-lua VS grab-site
  3. wget-lua VS libarchive
  4. wget-lua VS Crawly
  5. wget-lua VS browsertrix-crawler
  6. wget-lua VS ArchiveBox
  7. wget-lua VS os

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com