TextNormalizer 1.0.1

TextNormalizer

An open-source .NET library for standardizing English text and numbers. It automatically handles issues like number conversion, abbreviation expansion, and format unification in unstructured English content, making it suitable for scenarios such as data cleaning and NLP preprocessing.

📸 Visual Example of Results

Below are the core functionality results of the library (input text on the left, normalized output on the right), covering common text issues in real-world scenarios:

1. Number Normalization (Text → Numerals + Standard Format)

2. Text Abbreviation & Title Expansion

3. Punctuation & Format Cleaning

🚀 Quick Start in 3 Steps

1. Prerequisites

Supported .NET frameworks:

• .NET Framework 4.8
• .NET Standard 2.0+
• .NET 6.0+ (compatible via .NET Standard)

2. Installation

Option 1: Install via NuGet (Recommended)

# .NET CLI
dotnet add package TextNormalizer

# Package Manager Console
Install-Package TextNormalizer

Option 2: Reference Source Code

1. Clone the repository: git clone https://github.com/manyeyes/TextNormalizer.git
2. Add the TextNormalizer project to your solution and reference it.

3. Core Code Example

Complete normalization can be achieved with just 3 lines of code:

using TextNormalizer;

// 1. Create normalizer instances
var textNormalizer = new EnglishTextNormalizer();
var spellingNormalizer = new EnglishSpellingNormalizer();

// 2. Input text to be processed
string input = "Mr. Park said sales exceeded three million yuan on july fifth twenty twenty three.";

// 3. Perform normalization (text + spelling processing)
string normalizedText = textNormalizer.GetEnglishTextNormalizer(input);
normalizedText = spellingNormalizer.GetEnglishSpellingNormalizer(normalizedText);

// Output result: "mister park said sales exceeded 3000000 yuan on july 5th 2023."
Console.WriteLine(normalizedText);

🔧 Core Capabilities

✅ Test Validation

The project includes built-in unit tests covering all core scenarios to ensure stability:

• Number Normalization: Validates 30+ scenarios (including currency, dates, and special formats like "double zero seven"→"007")
• Text Processing: Covers common abbreviations (Mr./Prof./Jr.) and contractions (Let's/He's)
• Format Compatibility: Handles text with interfering characters like parentheses and commas

To run tests:

dotnet test TextNormalizer.Tests.csproj