Microsoft.ML.Scoring 1.1.0

Microsoft Machine Learning Scoring library for deep learning model inference. Current version of the library supports inferencing on pretrained models of ONNX v1.2 and TensorFlow v1.5.0. The library utilizes CPU devices only, with MKL/MKLDNN acceleration. This package provides a .Net standard 1.3 compatible module for maximum portability. Currently supported platforms include x64 CPU on Windows OS only.

There is a newer version of this package available.
See the version list below for details.
Install-Package Microsoft.ML.Scoring -Version 1.1.0
dotnet add package Microsoft.ML.Scoring --version 1.1.0
<PackageReference Include="Microsoft.ML.Scoring" Version="1.1.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Microsoft.ML.Scoring --version 1.1.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Microsoft.ML.Scoring library is a Model Inference Library that can used for scoring DNN models saved in either ONNX or TensorFlow format.. The library is .NET Standard 1.3 compatible library, with API for both managed as well as native application development. The following versions of ONNX and TensorFlow models are supported:

ONNX:

  • ONNX Version: 1.2
  • CPU only, with MKLDNN acceleration

TensorFlow:

  • TensorFlow Version: 1.5.0
  • CPU only, with MKL acceleration
  • Model formats: checkpoint and saved model only. Frozen model is not supported.
    • For TensorFlow Checkpoint - all files including a checkpoint file, a meta file, and data files should be stored under the same folder. If your model contains TensorFlow lookup operations, please copy your vocabulary file to this folder as well.
    • For TensorFlow SavedModel - all files including a pb file, data files and asset files should be stored under the same folder. Please do not import SavedModel files that were previously optimized by the library -this can result in unexpected errors.

Note: This library contains third party software. For more details, refer to ThirdPartyNotices.txt in the package.

Microsoft.ML.Scoring library is a Model Inference Library that can used for scoring DNN models saved in either ONNX or TensorFlow format.. The library is .NET Standard 1.3 compatible library, with API for both managed as well as native application development. The following versions of ONNX and TensorFlow models are supported:

ONNX:

  • ONNX Version: 1.2
  • CPU only, with MKLDNN acceleration

TensorFlow:

  • TensorFlow Version: 1.5.0
  • CPU only, with MKL acceleration
  • Model formats: checkpoint and saved model only. Frozen model is not supported.
    • For TensorFlow Checkpoint - all files including a checkpoint file, a meta file, and data files should be stored under the same folder. If your model contains TensorFlow lookup operations, please copy your vocabulary file to this folder as well.
    • For TensorFlow SavedModel - all files including a pb file, data files and asset files should be stored under the same folder. Please do not import SavedModel files that were previously optimized by the library -this can result in unexpected errors.

Note: This library contains third party software. For more details, refer to ThirdPartyNotices.txt in the package.

Release Notes

New additions in the version 1.1.0 release are -- .Net standard C# module; faster ONNX runtime with mkldnn acceleration, supporting ONNX models of version 1.2

Dependencies

This package has no dependencies.

Showing the top 1 GitHub repositories that depend on Microsoft.ML.Scoring:

Repository Stars
microsoft/samples-for-ai
Samples for getting started with deep learning across TensorFlow, CNTK, Theano and more.

Version History

Version Downloads Last updated
1.2.0 10,617 11/16/2018
1.1.0 23,678 9/28/2018
1.0.3 5,700 5/4/2018