nicopon 

A simple CLI for performance-focused data streaming and anonymization.

High-performance data pipeline engine.

Database and file adapters for DtPipe.Core (PostgreSQL, Oracle, SQL Server, SQLite, DuckDB, CSV, Parquet, JsonL, Apache Arrow).

Stream processors for DtPipe pipelines (DuckDB SQL, Merge/UNION ALL).

High-level object serialization for Apache Arrow in .NET.

ADO.NET to Apache Arrow adapter — converts DbDataReader to Arrow RecordBatches via typed column consumers. Equivalent of arrow-jdbc for .NET.

Row and columnar data transformers for DtPipe pipelines (expand, filter, compute, anonymize, fake data generation).

TransportR core: the wire protocol, contracts and network-free hub services for moving record sets between .NET applications through a hub

TransportR client: streams typed records to another .NET application through a TransportR hub, resuming after network cuts, with opt-in backpressure

TransportR hub for ASP.NET Core: relays transfers between clients over SignalR and HTTP streaming, without decoding or keeping the data

Package Description

MessagePack + LZ4 batch serializer for TransportR: any POCO, no schema needed

Apache Arrow RecordBatch serializer for TransportR (Arrow IPC, LZ4)

Redis-backed state store for TransportR: shares client registrations and transfer sessions between hubs behind a sticky load balancer

Protobuf-net + Zstd batch serializer for TransportR: annotated contracts, the most compact payload

System.Text.Json batch serializer for TransportR, Zstd-compressed or plain JSON for debugging