Shift-it 1.9.0

A HTTP client that can accept a reasonable level of invalid protocol from servers. This is a blocking, synchronous library that uses only .Net sockets, not WebClient or HttpWebRequest, and has a lot of replaceable components.
High transfer speeds, and uses minimal memory.

An old and battle hardend FTP client library, works with many old and cranky FTP servers that the standard .Net libraries can't handle.

Install-Package Shift-it -Version 1.9.0
dotnet add package Shift-it --version 1.9.0
<PackageReference Include="Shift-it" Version="1.9.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Shift-it --version 1.9.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Shift-it

Collection of low-level HTTP and FTP file transfer tools

Why?

.Net has some pretty good FTP and HTTP libraries built in. However, they aren't amazingly unit-test friendly. They also wrap a lot of status results in exceptions.
The protocol strictness of the libraries is also problematic when dealing with the general internet.

FTP

An old and battle hardend FTP client library, works with many
old and cranky FTP servers that the standard .Net libraries can't handle.

HTTP

A HTTP client that can accept a reasonable level of invalid protocol from servers.
This is a blocking, synchronous library that uses only .Net sockets, not WebClient or HttpWebRequest, and has a lot of replaceable components.

Performance

Thanks to skolima for these:

=== 14MB file

Measured on Windows
Time taken        Mem        Method
->2849ms        29MB    Web client
->2657ms        20MB    Web Client - stream copy, no hash
->2647ms        16MB    Web Client - stream copy, Shift-It hash
->1575ms        0MB     ShiftIt [current]
->1592ms        0MB     ShiftIt - no hashing [current]
->1616ms        0MB     ShiftIt - no compression [current]
->1574ms        0MB     ShiftIt - no hashing, no compression [current]


Measured on Mono + Linux + fast connection
Time taken        Mem        Method
->1763ms        30MB    Web client
->403ms 1MB     Web Client - stream copy, no hash
->651ms 16MB     Web Client - stream copy, Shift-It hash
->755ms 0MB     ShiftIt [current]
->603ms 0MB     ShiftIt - no hashing [current]
->762ms 0MB     ShiftIt - no compression [current]
->669ms 0MB     ShiftIt - no hashing, no compression [current]
->833ms 0MB     ShiftIt [previous]
->602ms 0MB     ShiftIt - no hashing [previous]
->903ms 0MB     ShiftIt - no compression [previous]
->601ms 0MB     ShiftIt - no hashing, no compression [previous]

=== 191MB file

Measured on Windows
Time taken        Mem        Method
->35378ms       638MB   Web client
->34211ms       334MB   Web Client - stream copy, no hash
->35382ms       320MB   Web Client - stream copy, Shift-It hash
->20292ms       0MB     ShiftIt [current]
->20157ms       0MB     ShiftIt - no hashing [current]
->20446ms       0MB     ShiftIt - no compression [current]
->19689ms       0MB     ShiftIt - no hashing, no compression [current]

Measured on Mono + Linux + fast connection
Time taken        Mem        Method
->17435ms       383MB   Web client
->5843ms        69MB    Web Client - stream copy, no hash
->9327ms        260MB   Web Client - stream copy, Shift-It hash
->12948ms       0MB     ShiftIt [current]
->8529ms        0MB     ShiftIt - no hashing [current]
->13472ms       0MB     ShiftIt - no compression [current]
->8108ms       0MB     ShiftIt - no hashing, no compression [current]
->13584ms       0MB     ShiftIt [previous]
->8237ms        0MB     ShiftIt - no hashing [previous]
->10648ms       0MB     ShiftIt - no compression [previous]
->7308ms        0MB     ShiftIt - no hashing, no compression [previous]

Todo

  • Digest authentication
  • chunked upload

Shift-it

Collection of low-level HTTP and FTP file transfer tools

Why?

.Net has some pretty good FTP and HTTP libraries built in. However, they aren't amazingly unit-test friendly. They also wrap a lot of status results in exceptions.
The protocol strictness of the libraries is also problematic when dealing with the general internet.

FTP

An old and battle hardend FTP client library, works with many
old and cranky FTP servers that the standard .Net libraries can't handle.

HTTP

A HTTP client that can accept a reasonable level of invalid protocol from servers.
This is a blocking, synchronous library that uses only .Net sockets, not WebClient or HttpWebRequest, and has a lot of replaceable components.

Performance

Thanks to skolima for these:

=== 14MB file

Measured on Windows
Time taken        Mem        Method
->2849ms        29MB    Web client
->2657ms        20MB    Web Client - stream copy, no hash
->2647ms        16MB    Web Client - stream copy, Shift-It hash
->1575ms        0MB     ShiftIt [current]
->1592ms        0MB     ShiftIt - no hashing [current]
->1616ms        0MB     ShiftIt - no compression [current]
->1574ms        0MB     ShiftIt - no hashing, no compression [current]


Measured on Mono + Linux + fast connection
Time taken        Mem        Method
->1763ms        30MB    Web client
->403ms 1MB     Web Client - stream copy, no hash
->651ms 16MB     Web Client - stream copy, Shift-It hash
->755ms 0MB     ShiftIt [current]
->603ms 0MB     ShiftIt - no hashing [current]
->762ms 0MB     ShiftIt - no compression [current]
->669ms 0MB     ShiftIt - no hashing, no compression [current]
->833ms 0MB     ShiftIt [previous]
->602ms 0MB     ShiftIt - no hashing [previous]
->903ms 0MB     ShiftIt - no compression [previous]
->601ms 0MB     ShiftIt - no hashing, no compression [previous]

=== 191MB file

Measured on Windows
Time taken        Mem        Method
->35378ms       638MB   Web client
->34211ms       334MB   Web Client - stream copy, no hash
->35382ms       320MB   Web Client - stream copy, Shift-It hash
->20292ms       0MB     ShiftIt [current]
->20157ms       0MB     ShiftIt - no hashing [current]
->20446ms       0MB     ShiftIt - no compression [current]
->19689ms       0MB     ShiftIt - no hashing, no compression [current]

Measured on Mono + Linux + fast connection
Time taken        Mem        Method
->17435ms       383MB   Web client
->5843ms        69MB    Web Client - stream copy, no hash
->9327ms        260MB   Web Client - stream copy, Shift-It hash
->12948ms       0MB     ShiftIt [current]
->8529ms        0MB     ShiftIt - no hashing [current]
->13472ms       0MB     ShiftIt - no compression [current]
->8108ms       0MB     ShiftIt - no hashing, no compression [current]
->13584ms       0MB     ShiftIt [previous]
->8237ms        0MB     ShiftIt - no hashing [previous]
->10648ms       0MB     ShiftIt - no compression [previous]
->7308ms        0MB     ShiftIt - no hashing, no compression [previous]

Todo

  • Digest authentication
  • chunked upload

  • .NETFramework 4.0

    • No dependencies.
  • .NETFramework 4.6.2

    • No dependencies.
  • .NETStandard 2.0

    • No dependencies.

This package is not used by any popular GitHub repositories.

Version History

Version Downloads Last updated
1.9.0 139 2/12/2019
1.8.1 135 11/30/2018
1.8.0 242 5/22/2018
1.7.0 776 2/16/2015
1.6.0 629 4/17/2014
1.5.0 736 11/7/2013
1.4.4 483 11/7/2013
1.4.2 491 10/25/2013
1.4.1 479 10/22/2013
1.4.0 494 10/15/2013
1.3.1 471 10/1/2013
1.3.0 713 9/19/2013
1.2.5 477 9/10/2013
1.2.4 394 9/10/2013
1.2.3 415 9/3/2013
1.2.2 419 9/2/2013
1.2.1 448 7/2/2013
1.2.0 430 6/25/2013
1.1.1 470 4/22/2013
1.1.0 438 4/16/2013
1.0.2 428 4/15/2013
1.0.1 453 3/6/2013
1.0.0 443 3/6/2013