CrawlerLib.Engine
2.0.2
See the version list below for details.
dotnet add package CrawlerLib.Engine --version 2.0.2
NuGet\Install-Package CrawlerLib.Engine -Version 2.0.2
<PackageReference Include="CrawlerLib.Engine" Version="2.0.2" />
paket add CrawlerLib.Engine --version 2.0.2
#r "nuget: CrawlerLib.Engine, 2.0.2"
// Install CrawlerLib.Engine as a Cake Addin #addin nuget:?package=CrawlerLib.Engine&version=2.0.2 // Install CrawlerLib.Engine as a Cake Tool #tool nuget:?package=CrawlerLib.Engine&version=2.0.2
The Crawler-Lib.NET Crawler Engine is a general purpose task processor for crawling, data mining and web scraping. It is throughput optimized and can perform thousands of tasks per second on standard hardware. It has a build in support for the IAsync pattern and Task Parallel Library (TPL) Tasks. These different elements can be combined to complex workflows with several workflow control elements like group, retry and delay.
Please download the samples solution and watch the video tutorials on our YouTube channel:
http://www.youtube.com/user/CrawlerLib
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET Framework | net is compatible. |
-
- HtmlAgilityPack (>= 1.4.6)
- Newtonsoft.Json (>= 5.0.6)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on CrawlerLib.Engine:
Package | Downloads |
---|---|
CrawlerLib.Engine.TestHelper
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks. |
GitHub repositories
This package is not used by any popular GitHub repositories.
Version | Downloads | Last updated |
---|---|---|
2.3.5544.21265 | 2,567 | 3/7/2015 |
2.3.5538.27074 | 1,725 | 3/1/2015 |
2.3.5535.18986 | 2,022 | 2/26/2015 |
2.3.5529.650 | 2,062 | 2/20/2015 |
2.3.5515.2909 | 1,792 | 2/6/2015 |
2.3.5514.24037 | 1,730 | 2/5/2015 |
2.3.5513.24819 | 1,768 | 2/4/2015 |
2.3.5507.444 | 1,775 | 1/29/2015 |
2.3.5503.33731 | 1,753 | 1/25/2015 |
2.3.5503.4086 | 1,809 | 1/25/2015 |
2.2.5490.21676 | 1,759 | 1/12/2015 |
2.2.5367.17954 | 1,800 | 9/11/2014 |
2.1.5296.19510 | 1,806 | 7/2/2014 |
2.1.5291.40524 | 1,647 | 6/27/2014 |
2.1.5288.13218 | 1,849 | 6/24/2014 |
2.0.2 | 2,202 | 9/6/2013 |
2.0.1 | 1,942 | 6/25/2013 |
2.0.0 | 1,881 | 6/22/2013 |
Included License:
A license for the Anonymous Edition is included. A license for the more powerful free Community Edition can be generated on the project page.