Top 7 C# Crawler Projects

PuppeteerSharp

16 3,203 9.3 C#

Headless Chrome .NET API

Project mention: What do .NET devs use for web scraping these days? | /r/dotnet | 2023-06-13

PuppeteerSharp

abot

1 2,209 0.0 C#

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
TumblThree

4 576 8.1 C#

A Tumblr and Twitter Blog Backup Application
Infinity Crawler

0 239 5.0 C#

A simple but powerful web crawler library for .NET
custom-crawler

1 58 2.8 C#

🌌 High productivity semi-automatic crawler generator 🛠️🧰
Spidey

2 11 9.5 C#

A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
Scraper

1 2 10.0 C#

A simplistic web scraper which aims to make scrapping webpages and crawling links faster by utilizing parallel threading. (by 0x78f1935)
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C# Crawler related posts

I made a powerful crawler creation tool on c#!

2 projects | /r/csharp | 10 Nov 2022
Download videos in stream

2 projects | /r/freesoftware | 12 Aug 2022
Recursion needed in small crawler

1 project | /r/csharp | 15 May 2021