Purpose
In the Microsoft Foundry Data Service, an LLM chat service and credentials need to be configured. The service is used by the AskAI task template.
Prerequisites
- You must have an active Azure subscription with a valid payment method in order to sign-in with your Microsoft account credentials.
- You will need to deploy a model in Microsoft Azure AI Foundry prior to creating a data service in Openprise.
Detailed instructions on how to deploy a model in your Azure AI Foundry environment can be found HERE. Additional instructions regarding deploying a fine-tuned model can be found HERE.
Locate Model-specific Information From Deployed Model
You will need the following model-specific information from the deployed model you want to connect to Openprise:
- Target URI
- Model name
- API Key
Select the resource group to which your model belongs. This can be changed by navigating to the selection drop-down in the top left and selecting the desired resource group.
- Select Build in the top right corner.
- Select Deployments on the left menu bar.
- Select Deployed models and then select the model name (e.g. gpt-5-mini model).
- Navigate to Playground under the model name.
- Select Code.
- Select Python from the Language dropdown. Select OpenAI SDK from the SDK dropdown.
- Select an API type from the dropdown. If Responses API is listed, the model supports web search and you will be able to configure whether or not to use web search when creating a data service in Openprise. If Completions API is only available, web search will NOT be supported by the model.
Copy the endpoint and deployment name. You will need them for when you configure your data service. NOTE: Only copy the text within the quotes NOT the quotes themselves.
Navigate to Details under the model name. Make note of the following information:
- Target URI: Copy the provided URI for authentication in Openprise. You will only enter a portion of this URL up to and including the “/openai/” segment (e.g. https://op-azureopenai.openai.azure.com/openai/).
- Copy the associated model API key. Store this key in a secure location.
- Model name: note the name of the model you are trying to connect to in Openprise (e.g. gpt-4o-mini)
Create Microsoft Foundry Data Service in Openprise
Navigate to Data > Data Services.
Select Add Data Service.
Give your Data Service a name, optional description, assign data service administrators, and labels. Select Microsoft Foundry in the Select technology section. Click Add Account Information. Select a registered account, or add a new account using your Microsoft Azure AI Foundry credentials.
To add a new Account, follow the steps below:
- Email: Enter your Microsoft Azure AI Foundry email address.
- AI model: Enter the name of the AI model you want Openprise to connect to.
- API Key: Paste the API Key from your Microsoft Foundry account.
- Use Web Search: Select "Yes" from the dropdown if your model supports web search. Select "No" if your model does not support web search.
- API Endpoint: Paste the Target URI from your Microsoft Foundry account. Only enter a portion of this URL up to and including the “/openai/” segment (e.g. https://op-azureopenai.openai.azure.com/openai/).
Click Save in the top right corner to save your data service configuration. You will now see a new Data Service tile created on the main Data Services screen in Openprise.