OpenAI Compatible Data Service

Purpose

In the OpenAI Compatible Data Service, an LLM chat service and credentials are configured. The service is used by the AskAI task template. A list of verified models is supplied at the end of this document.

Prerequisites

OpenAI needs to be enabled in Openprise to be available to use.

Navigate to Administration and select System Settings

Select the Features tab

Click on the AskAI feature to turn it on and Click Save

Create OpenAI Data Service in Openprise

Navigate to Data -> Data Services.

Select Add Data Service.

Give your Data Service a name, optional description, assign data service administrators, and labels. Select OpenAI in the select Technology section. Click Add Account Information. Select a registered account, or add a new account using your OpenAI credentials. 

To add a new Account, follow the steps below:

1. Email: Enter the email address for the account.
2. AI Model: Set to gpt-4
3. API key: Enter your API key

You will now see a new Data Service tile created on the main Data Services screen in Openprise. 

Verified Models

Openprise LLM:
Openprise hosts our own LLM (Large Language Model) for use within the Openprise workbench. Please contact your Customer Success Team to find out more about our hosted LLM service.

Note that for any of the following public model providers, you will need to create an account and generate an API key specific to that model provider. Because these services are not managed by Openprise, the links and instructions below may become out of date.

1. ChatGPT:
   • Endpoint: https://api.openai.com/v1/chat/completions
   • Available Models: https://platform.openai.com/docs/models/model-endpoint-compatibility
     • Within the section for “/v1/chat/completions”, select an available model to use as input to the “AI Model” field when authenticating an OpenAI data service via Openprise.
2. Groq:
   • Endpoint: https://api.groq.com/openai/v1/chat/completions
   • Available Models: https://console.groq.com/docs/models
     • Use the “ModelID” as input to the “AI Model” field when authenticating an OpenAI data service via Openprise. For example, the LLaMA3 8b model to use in the “AI Model” field is llama3-8b-8192.
3. Mistral AI:
   • Endpoint: https://api.mistral.ai/v1/chat/completions
   • Available Models: https://docs.mistral.ai/getting-started/models/
     • Use the value of “API Endpoint” as input to the “AI Model” field when authenticating an OpenAI data service via Openprise.
4. Together AI:
   • Endpoint: https://api.together.xyz/v1/chat/completions 
   • Available Models: https://docs.together.ai/docs/inference-models
     • Under the Chat Models section, use the “Model String for API” as input to the “AI Model” field when authenticating an OpenAI data service via Openprise.