NLog.Azure.Kusto
2.0.1
See the version list below for details.
dotnet add package NLog.Azure.Kusto --version 2.0.1
NuGet\Install-Package NLog.Azure.Kusto -Version 2.0.1
<PackageReference Include="NLog.Azure.Kusto" Version="2.0.1" />
paket add NLog.Azure.Kusto --version 2.0.1
#r "nuget: NLog.Azure.Kusto, 2.0.1"
// Install NLog.Azure.Kusto as a Cake Addin #addin nuget:?package=NLog.Azure.Kusto&version=2.0.1 // Install NLog.Azure.Kusto as a Cake Tool #tool nuget:?package=NLog.Azure.Kusto&version=2.0.1
NLog.Azure.Kusto
An Azure Data Explorer(ADX) custom target that writes log events to an Azure Data Explorer (Kusto) cluster.
Package - NLog.Azure.Kusto | Platforms - .Net 6.0
You can now use the Kusto NLog connector with free Kusto cluster and Microsoft Fabric cluster URLs by providing the cluster URL in the
ConnectionString
parameter of theADXTarget
configuration.
!! BREAKING CHANGE !!
IngestionEndpoint will not be supported from verison 2.0.0. It has been replaced with Connection String based authentication. With Connection String based authentication, you can use different modes of authentication, such as User Prompt Authentication, User Token Authentication, and more. To learn more about Kusto connection strings and the authentication modes they support, please visit Kusto connection strings.
Getting started
Install from NuGet:
dotnet add package NLog.Azure.Kusto --version 2.0.1
Configuration
Add the ADX target to your NLog configuration:
<nlog>
<extensions>
<add assembly="NLog.Azure.Kusto"/>
</extensions>
<targets>
<target name="adxtarget" type="ADXTarget"
ConnectionString="<ADX connection string>"
Database="<ADX database name>"
TableName="<ADX table name>">
<contextproperty name="HostName" layout="${hostname}" />
</target>
</targets>
<rules>
<logger minlevel="Info" name="*" writeTo="adxtarget"/>
</rules>
</nlog>
Available Configuration Options
Destination Option | Description |
---|---|
ConnectionString | Kusto connection string. Eg: Data Source=https://ingest-<clustername>.<region>.kusto.windows.net;Fed=True . Read about Kusto Connection String |
Database | The name of the database to which data should be ingested into. |
TableName | The name of the table to which data should be ingested. |
ManagedIdentityClientId | In case of ManagedIdentity Authentication, this need to be set for user assigned identity ("system" = SystemManagedIdentity) |
AzCliAuth | Enable ADX connector to use Azure CLI authentication |
FlushImmediately | In case queued ingestion is selected, this property determines if is needed to flush the data immediately to ADX cluster. Not recommended to enable for data with higher workloads. The default is false. |
MappingNameRef | Use a data mapping configured in ADX. |
ApplicationName | Override default application-name |
ApplicationVersion | Override default application-version |
Payload Option | Description |
---|---|
Layout | Formatting of the ADX-event FormattedMessage. The default is: ${logger}${message} |
IncludeEventProperties | Include LogEvent Properties in the ADX-event. The default is true |
ContextProperty | Include additional ContextProperties in the ADX-event. The default is empty collection. |
BatchSize | Gets or sets the number of log events that should be processed in a batch by the lazy writer thread. (Default 1) |
TaskDelayMilliseconds | How many milliseconds to delay the actual send payload operation to optimize for batching (Default 1 ms) |
QueueLimit | Gets or sets the limit on the number of requests in the lazy writer thread request queue (Default 10000) |
OverflowAction | Gets or sets the action (Discard, Grow, Block) to be taken when the lazy writer thread request queue count exceeds the set limit (Default Discard) |
IngestionEndpointUri
is longer supported with Version 2.0.0, as it has been replaced by Connection String based authentication. Read more about Kusto connection strings
Mapping
Azure Data Explorer provides data mapping capabilities, allowing the ability to extract data rom the ingested JSONs as part of the ingestion. This allows paying a one-time cost of processing the JSON during ingestion, and reduced cost at query time.
By default, the sink uses the following data mapping:
Column Name | Column Type | JSON Path |
---|---|---|
Timestamp | datetime | $.Timestamp |
Level | string | $.Level |
Message | string | $.Message |
FormattedMessage | dynamic | $.FormattedMessage |
Exception | string | $.Exception |
Properties | dynamic | $.Properties |
This mapping can be overridden using the following options:
- MappingNameRef: Use a data mapping configured in ADX.
Authentication
Authentication will be taken according to the kusto connection string passed in the nlog target configuration.
There are few cases to keep in mind for the following authentication modes:
Managed Identity Authentication
- This authentication mode can be of two types System Assigned Managed Identity and User Assigned Managed Identity. In case of User Assigned Managed Identity, it requires the following properties to be set in the nlog target configuration::
ManagedIdentityClientId
:system
: This will enable managed identity authentication for system assigned managed identity.<clientId>
: SettingManagedIdentityClientId
to a specific clientId will enable managed identity authentication for user assigned managed identity.
- This authentication mode can be of two types System Assigned Managed Identity and User Assigned Managed Identity. In case of User Assigned Managed Identity, it requires the following properties to be set in the nlog target configuration::
AzCliAuth
- This authentication mode will use the Azure CLI to authenticate. This authentication mode will only work when the application is running on a machine with Azure CLI installed and logged in. Accepted values
true
orfalse
. Default value isfalse
.
- This authentication mode will use the Azure CLI to authenticate. This authentication mode will only work when the application is running on a machine with Azure CLI installed and logged in. Accepted values
Running tests
To run the tests locally, you need to have an ADX cluster created.
Export environment variables for the following:
For Windows:
$env:CONNECTION_STRING="<connectionString>" $env:DATABASE="<databaseName>"
For Mac/Linux:
export CONNECTION_STRING="<connectionString>" export DATABASE="<databaseName>"
Run the tests using the following command:
dotnet test
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net6.0 is compatible. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
-
net6.0
- Microsoft.Azure.Kusto.Data (>= 11.3.3)
- Microsoft.Azure.Kusto.Ingest (>= 11.3.3)
- Microsoft.IO.RecyclableMemoryStream (>= 2.3.2)
- NLog (>= 5.1.4)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.