Dommel.Bulk 2.0.2-beta

Dommel.Bulk 🚢

The highest performing library for bulk inserting into a relational database. Fast. Simple. Flexible.

Dommel.Bulk provides a convenient API for bulk insert operations using extension methods on the IDbConnection interface. The SQL queries are generated based on your POCO entities. Dommel.Bulk translates your entities to SQL expressions. Dapper is used for query execution and object mapping. Dommel is used for table and column names conventions.

Installing Dommel.Bulk

Dommel.Bulk is available on NuGet.

dotnet add package Dommel.Bulk

Install-Package Dommel.Bulk

Dommel.Bulk basic usage 🛸

Bulk insert using type mappers

var products = await connection.BulkInsertAsync<Product>(products);

Generates simple SQL expression using database specific type mappers. Supports MySql, PostgreSql and SqLite databases. Has high performance solutions inside.

Bulk insert using SQL parameters

int insertedCount = await connection.BulkInsertParametersAsync<Product>(products);

Use SQL parameters for insert values. Support for all databases. Has middle performance.

Dommel.Bulk extended usage

Transaction

All extension methods supports database transaction usage. Example:

using (IDbTransaction transaction = _connection.BeginTransaction())
{
    await _connection.BulkInsertAsync(data, transaction);
}

ExecutionFlags 🚩

Dommel.Bulk supports flags that allow additional database functionality to control bulk insertion.

Example:

await _connection.BulkInsertAsync(data, flags: ExecutionFlags.IgnoreErrors);

Properties to update

You can specify which properties to update if there are inserting conflicts.

await _connection.BulkInsertAsync(data, null, default, null, flags: ExecutionFlags.IgnoreErrors, nameof(Person.FirstName), nameof(Person.LastName));

Type mappers 🗿

Mapping C# Types to Database Type Literals Support CLR types: bool, byte, char, double, float, int, long, sbyte, short, uint, ulong, ushort, decimal, DateTime, Guid, string, TimeSpan, byte[], enum and nullable types. For concrete type specification check sql provider:

▪️TimeOnly and DateOnly exist only in .NET6

▪️ Guid in SQLite should be implemented with custom handler. SqlMapper.TypeHandler<T>

▪️ DateTime in SQLite currenlty supported only in text format.

▪️ SQLite ConstraintName should contains conflict column names. (first_name, last_name)

▪️ PostgreSQL ConstraintName should contains constraint name. unique_user_key

Async and non-async ⚙️

All Dommel.Bulk methods have async and non-async variants, such as as BulkInsert & BulkInsertAsync, BulkInsertParameters & BulkInsertParametersAsync.

Extensibility ➿

Type mapper

Use the AddTypeMapper() method to register the custom type mapper.

DommelBulkMapper.AddTypeMapper(typeof(MySqlConnection), new GenericTypeMapper<JsonElement>((e, tw) => tw.Write(e.ToString())));

Database adapter 🔗

Use the AddTypeMapper() method to register the custom type mapper.

DommelBulkMapper.AddDatabaseAdapter(typeof(NpgsqlConnection), new NpgDatabaseAdapter());

Performance 🚀

Performance comparison between bulk methods and InsertAll from Dommel library

BenchmarkDotNet=v0.13.1, OS=Windows 10.0.19044.1586 (21H2)
Intel Core i5-7300HQ CPU 2.50GHz (Kaby Lake), 1 CPU, 4 logical and 4 physical cores
.NET SDK=6.0.100
  [Host]     : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT
  DefaultJob : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT

Disclaimer ❗️

The material embodied in this software is provided to you "as-is" and without warranty of any kind, express, implied or otherwise, including without limitation, any warranty of fitness for a particular purpose. In no event shall the Centers for Disease Control and Prevention (CDC) or the United States (U.S.) government be liable to you or anyone else for any direct, special, incidental, indirect or consequential damages of any kind, or any damages whatsoever, including without limitation, loss of profit, loss of use, savings or revenue, or the claims of third parties, whether or not CDC or the U.S. government has been advised of the possibility of such loss, however caused and on any theory of liability, arising out of or in connection with the possession, use or performance of this software.