Skip to content

A simple c# web crawler using System.Threading.Channels

Notifications You must be signed in to change notification settings

mtsmith/WebCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

WebCrawler

A super simple c# web crawler using System.Threading.Channels

Creates a publisher (Channels writer) and subscriber (Channels Reader) and uses a queue for managing urls. By default it restricts crawling to a single domain.

About

A simple c# web crawler using System.Threading.Channels

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages