ExcavatorSharp.WebScraper.x64 1.0.4

ExcavatorSharp is a multi-threaded server for scraping web data. It converts HTML code into a structured array of object data. The library allows scraping data from multiple sites simultaneously, in parallel, within a single running application. Create scraping tasks and perform data extraction on a schedule.

The library is designed for professional extraction and parsing of large volumes of data. Under the hood there are .css-selectors and xpath support, data export to .csv/.xlsx/.sql/.json, online data export, support for proxy servers, dynamic content crawling, interaction with the site via javascript and much more. The library uses .NET Sockets and Chromium Embedded Framework.

The library can be used separately as crawler or parser. Work with sitemap, robots.txt is supported. It supports working with gzip / deflate compression. Work with links by masks, automatic link re-indexing and so on.

Attention! Only x64 versions are supported for .NET 4.5.2 and 4.6 platforms. AnyCPU build does not support! You will NOT be able to run the library when building AnyCPU. This is caused by the features of CEF.

There is a newer version of this package available.
See the version list below for details.
Install-Package ExcavatorSharp.WebScraper.x64 -Version 1.0.4
dotnet add package ExcavatorSharp.WebScraper.x64 --version 1.0.4
<PackageReference Include="ExcavatorSharp.WebScraper.x64" Version="1.0.4" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add ExcavatorSharp.WebScraper.x64 --version 1.0.4
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Release Notes

Changes in the Crawler properties: properties validation, URLs respecting fixes. Updating linked libraries.

This package is not used by any popular GitHub repositories.

Version History

Version Downloads Last updated
1.2.3 39 5/20/2020
1.2.2 22 5/10/2020
1.2.1 30 5/5/2020
1.2.0 30 4/30/2020
1.1.0 35 4/23/2020
1.0.53 54 4/12/2020
1.0.52 56 4/11/2020
1.0.51 60 4/11/2020
1.0.6 30 4/23/2020
1.0.5 60 4/11/2020
1.0.4 95 4/3/2020
1.0.3 52 2/12/2020
1.0.2 112 1/30/2020
1.0.1 63 1/30/2020
1.0.0 45 1/23/2020
Show less