Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
33 packages returned for Tags:"Robots"
Sort by
Relevance
Downloads
Recently updated
Zanganeh.
RobotsTxtHandler
by:
zanganeh
.NET Framework 4.5
1,187 total downloads
last updated
12/30/2015
Latest version:
1.0.0
Robots
EPiServer
robots.text implementation for EPiServer
Nick.
RobotsParser
by:
nicholasb.za
.NET 6.0
3,424 total downloads
last updated
1/1/2023
Latest version:
2.0.6
robots
parse
robots
web
crawling
robots.txt
web
scraping
spider
sitemap
More tags
https://github.com/nicholasbergesen/RobotsParser/blob/master/README.md
Mechanize.
NET
by:
WilliamABradley
.NET 5.0
.NET Core 1.0
.NET Standard 1.4
.NET Framework 4.6.1
6,124 total downloads
last updated
12/8/2017
Latest version:
1.0.2
dotnet
dotnet-standard
analytics
spider
scaper
crawler
robots
html
htmlagilitypack
csharp
Stateful programmatic web browsing, based on Python-Mechanize, which is based on Andy Lester’s Perl module WWW::Mechanize.
Toimik.
RobotsProtocol
by:
nurhafiz
.NET 6.0
3,922 total downloads
last updated
12/22/2022
Latest version:
0.4.0
robots.txt
robots-txt
robotstxt
robots-exclusion-standard
robots-exclusion-protocol
robots-meta-tag
x-robots-tag
robots
Parsers for Robots Exclusion Standard (aka robots.txt), Robots Meta Tag, and X-Robots-Tag. Visit Project Site for documentation.
UnderAutomation.
UniversalRobots
by:
UnderAutomation
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 3.5
13,135 total downloads
last updated
3/27/2024
Latest version:
7.2.5
Universal
Robots
Cobot
industrial
robot
primary
interface
dashboard
server
RTDE
More tags
Implements communication with Universal Robots industrial robots (Primary interfaces, Dashboard Server, RTDE, SSH, SFTP, XML-RPC, Sockets, Interpreter Mode) - Fully-managed .NET commercial DLL without...
More information
Verndale.
Sitemap.
Robots.
Generator.
Core
by:
fquintanilla
Verndale
Deprecated
.NET Framework 4.6
1,455 total downloads
last updated
4/24/2019
Latest version:
1.0.0
EPiServer
Verndale
Sitemap
Robots
Dynamic
Generator
Core
Classes
Sitemap and robots dynamic generator core classes
CrawlCtrl
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
178 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
Deserialize robots.txt files
Sitemap.
NET
by:
LiveOrDevTrying
.NET 5.0
.NET Core 3.0
.NET Standard 2.1
9,425 total downloads
last updated
11/13/2021
Latest version:
2.1.5
sitemap
sitemap.xml
sitemap.net
sitemaps
sitemaps.net
robots
robot
robots.txt
SEO
search
More tags
A simple middleware built on reflection designed to support your Search Engine Optimized (SEO) app by dynamically creating a Sitemap.xml and Robots.txt. This package is designed to be very simple for simple use...
More information
Mechanize.
NET.
AngleSharp
by:
WilliamABradley
.NET 5.0
.NET Core 1.0
.NET Standard 1.4
.NET Framework 4.6.1
2,230 total downloads
last updated
12/8/2017
Latest version:
1.0.2
dotnet
dotnet-standard
analytics
spider
scaper
crawler
robots
html
AngleSharp
csharp
More tags
AngleSharp IHtmlParser Extension for Mechanize.NET
RoboDkApi
by:
RoboDK
.NET 5.0
.NET Core 3.1
.NET Framework 4.5
7,914 total downloads
last updated
1/15/2024
Latest version:
5.6.8
Simulation
Industrial
Robot
Arm
Offline
Programming
ABB
Fanuc
KUKA
Motoman
More tags
With RoboDK API allows you to interact with industrial robots and RoboDK Software. RoboDK Software allows you to simulate and program industrial robots for any manufacturing operation, such as robot machining,...
More information
CrawlCtrl.
Reader
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
71 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
Convenient wrapper for the CrawlCtrl deserializer, that makes it easy to load and deserialize robots.txt files
CrawlCtrl.
DependencyInjection.
DotNet
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
72 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
di
dependency
injection
.NET dependency injection support for CrawlCtrl
CrawlCtrl.
Reader.
DependencyInjection.
DotNet
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
72 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
di
dependency
injection
reader
.NET dependency injection support for CrawlCtrl.Reader
Previous
Next