Parquet.Net 1.3.0

A .NET library to read and write Apache Parquet files.

There is a newer version of this package available.
See the version list below for details.
Install-Package Parquet.Net -Version 1.3.0
dotnet add package Parquet.Net --version 1.3.0
<PackageReference Include="Parquet.Net" Version="1.3.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Parquet.Net --version 1.3.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Release Notes

v1.3
new features:
- .NET byte and sbyte type is supported
- DataSet has got a new .Merge method that allows to merge two datasets, even if rows and columns are incompatible

improvements:
- we have removed a dependency on Snappy.Sharp completely which conflicted with projects targeting .NET 4.5
- dependency on System.ValueTuple is removed
- Apache Thrift dependency was replaced by a custom build which has zero downstream dependencies now. This was causing problems for projects using ASP.NET Core and specific Kestrel version, as stupidly enough Apache Thrift was referencing web hosting framework!

v1.2
new features:
- INT64 (C# long) type is supported (#194)
- Decimal datatype is fully supported (#209). This includes support for simple System.Decimal, and decimal types with different scales and precisions. Decimals are encoded by utilising all three encodings from parquet specs, however this can be switched off for compatibility with older system. Decimals are fully compatible with Hive and Impala which have some edge cases not complying with parquet specifications. Thanks to @dmitryPavliv and @nzapolski for making this possible

bugs fixed:
- fixed a flaw in dictionary encoding implementation affecting files written for AWS Impala (#193)
- when a column contains only single value and it's null Parquet.Net was crashing (#198)

v1.1
new features:
- Reader supports nested structures.
- Parquet output is now compatible with AWS Athena
- Writer can append data to existing file

improvements:
- Parquet metadata sets page sizes according to standard
- Schema and SchemaElement has Show method allowing to get user readable representation

bug fixes:
- some files mix encodings between data pages resulting in wrong count of rows and occasional crashes (#183)
- some string encoded fields not annotated properly were crashing Parquet.Net reader (#138)

Showing the top 1 GitHub repositories that depend on Parquet.Net:

Repository Stars
dotnet/machinelearning
ML.NET is an open source and cross-platform machine learning framework for .NET.

Read more about the GitHub Usage information on our documentation.

Version History

Version Downloads Last updated
3.6.0 1,833 1/23/2020
3.5.3 3,205 1/8/2020
3.5.2 260 1/3/2020
3.5.1 176 12/31/2019
3.5.0 1,525 12/18/2019
3.4.3 337 12/16/2019
3.4.2 146 12/13/2019
3.4.1 121 12/11/2019
3.4.0 67 12/11/2019
3.3.11 1,848 12/1/2019
3.3.10 4,374 11/6/2019
3.3.9 51,416 8/15/2019
3.3.8 3,638 8/1/2019
3.3.7 100 8/1/2019
3.3.6 105 7/31/2019
3.3.5 4,744 7/5/2019
3.3.4 89,373 3/11/2019
3.3.3 8,715 2/1/2019
3.3.2 11,901 1/21/2019
3.3.1 985 1/14/2019
3.3.0 409 1/11/2019
3.2.6 203 1/11/2019
3.2.5 1,978 1/3/2019
3.2.4 2,166 11/21/2018
3.2.3 8,317 11/7/2018
3.2.2 828 10/30/2018
3.2.1 192 10/30/2018
3.2.0 697 10/24/2018
3.1.4 364 10/15/2018
3.1.3 187 10/15/2018
3.1.2 2,471 10/11/2018
3.1.1 528 10/4/2018
3.1.0 268 10/3/2018
3.1.0-preview-390 172 10/3/2018
3.1.0-preview-373 285 10/2/2018
3.0.5 4,064 8/13/2018
3.0.4 353 7/25/2018
3.0.3 217 7/25/2018
3.0.2 711 7/24/2018
3.0.1 215 7/24/2018
3.0.0 751 7/19/2018
2.1.4 27,302 6/7/2018
2.1.3 171,781 3/30/2018
2.1.2 13,228 1/10/2018
2.1.1 21,842 12/1/2017
2.1.0 513 11/29/2017
2.0.1 278 11/27/2017
2.0.0 337 11/27/2017
1.5.1 857 11/14/2017
1.4.0 2,827 10/23/2017
1.3.0 1,750 9/12/2017
1.2.139 380 9/6/2017
1.1.128 361 8/15/2017
1.0.114 332 7/31/2017
Show less