Together.AI 1.1.0

A unofficial .NET client for Together's API platform.

Getting started:

Prerequisites

If you'd like to use the Together.AI .NET client library you'll need an API key from a developer account at Together's API.

Install the package

Install the client library for .NET with NuGet:

dotnet add package Together.AI

Authenticate the client

In order to interact with Together's API, you'll need to create an instance of the IHttpClient class that points to Together's api endpoint URI using a valid Authorization API key.

The easiest way to do this is by using the SetupClient extension method.

using Together.AI;

var client = new HttpClient();
client.SetupClient(apiKey: "your-api-key-from-together");

Then creates a instance of TogetherAIClient using the configured HttpClient.

var togetherAI = new TogetherAIClient(client);

Start Querying

Getting completion results

To simply get text completion results, you can use the GetCompletionAsync method.

using Together.AI;

// ...

// Setup Request Arguments
var togetherAIArgs = new TogetherAIRequestArgs()
{
    Model = "togethercomputer/RedPajama-INCITE-7B-Instruct",
    MaxTokens = 128,
    Prompt = "Alan Turing was "
};

var result = await togetherAI.GetCompletionAsync(togetherAIArgs);

// Print generated text
Console.WriteLine(result.Output.Choices[0].Text);

Streaming tokens

To get tokens as the model generates, you can use the GetCompletionStreamAsync method.

using Together.AI;

// ...

var togetherAIArgs = new TogetherAIRequestArgs()
{
    Model = MODEL_ID,
    MaxTokens = 128,
    Prompt = "Alan Turing was "
};

await foreach (var streamResult in togetherAI.GetCompletionStreamAsync(togetherAIArgs))
{
    var token = streamResult.Choices[0].Text;

    // Print generated token
    Console.Write(token);
}

Examples

Looking for Grammar errors

using Together.AI;

const string API_KEY = "your-api-key-from-together";
const string MODEL_ID = "Open-Orca/Mistral-7B-OpenOrca";
const string PROMPT_TEMPLATE =
    "<|im_start|> system\nDoes the text contain grammar errors? Answer with (Y/N)\n\n'{{$input}}'\n<|im_end|>\n<|im_start|> assistant\n";

var client = new HttpClient();
client.SetupClient(apiKey: API_KEY);

var togetherAI = new TogetherAIClient(client);

var promptInput = PROMPT_TEMPLATE.Replace(
    oldValue: "{{$input}}",
    newValue: "I mised the training session this morning"
);

var togetherAIArgs = new TogetherAIRequestArgs()
{
    Model = MODEL_ID,
    MaxTokens = 8,
    Prompt = promptInput
};

var result = await togetherAI.GetCompletionAsync(togetherAIArgs);

Console.WriteLine(result.Output.Choices[0].Text);

// Result: 'Y'