getting no LLM found error

technical-ivory · 2025-04-10T12:48:30.526Z

how to chose Azure open ai llm as I am getting no LLM found error

V

Hi there!

I see you're encountering a "no LLM found error" when trying to use Azure OpenAI. I can definitely help you with that!

Based on the information I have, here's how you can configure Azure OpenAI LLM to resolve this error:

Set Up Azure OpenAI Credentials

First, you need to configure your Azure OpenAI credentials in the Vapi dashboard:

Go to the Provider Keys dashboard tab at dashboard.vapi.ai/keys
Add your Azure OpenAI credentials with the following information:
- Set provider to "azure-openai"
- Specify the model(s) you want to use (e.g., "gpt-4o-2024-08-06")
- Set the correct Azure region for your deployment
- Provide your Azure OpenAI endpoint and API key

Here's an example of how to add these credentials via API:

curl --location 'https://api.vapi.ai/credential' \
--header 'authorization: Bearer YOUR_API_KEY_HERE' \
--header 'content-type: application/json' \
--data '{
    "provider": "azure-openai",
    "models": [
        "gpt-4o-2024-08-06"
    ],
    "region": "YOUR_REGION",
    "openAIEndpoint": "YOUR_ENDPOINT",
    "openAIKey": "YOUR_API_KEY"
}'

curl --location 'https://api.vapi.ai/credential' \
--header 'authorization: Bearer YOUR_API_KEY_HERE' \
--header 'content-type: application/json' \
--data '{
    "provider": "azure-openai",
    "models": [
        "gpt-4o-2024-08-06"
    ],
    "region": "YOUR_REGION",
    "openAIEndpoint": "YOUR_ENDPOINT",
    "openAIKey": "YOUR_API_KEY"
}'

curl --location 'https://api.vapi.ai/credential' \
--header 'authorization: Bearer YOUR_API_KEY_HERE' \
--header 'content-type: application/json' \
--data '{
    "provider": "azure-openai",
    "models": [
        "gpt-4o-2024-08-06"
    ],
    "region": "YOUR_REGION",
    "openAIEndpoint": "YOUR_ENDPOINT",
    "openAIKey": "YOUR_API_KEY"
}'

curl --location 'https://api.vapi.ai/credential' \
--header 'authorization: Bearer YOUR_API_KEY_HERE' \
--header 'content-type: application/json' \
--data '{
    "provider": "azure-openai",
    "models": [
        "gpt-4o-2024-08-06"
    ],
    "region": "YOUR_REGION",
    "openAIEndpoint": "YOUR_ENDPOINT",
    "openAIKey": "YOUR_API_KEY"
}'

Important Configuration Details

**Endpoint Format**: The endpoint should be the shorter resource endpoint, not the longer deployment endpoint. It should go up to `chat/completions?api-version=` without including the version number ([source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1338649953102463038)).
**Model Name**: Ensure the deployment name matches exactly the model name provided in the VAPI menu (e.g., "gpt-4o-2024-08-06") ([source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1339956981297057892)).

V

Vapi Support BotAPP•4/10/25, 12:50 PM

Region Availability: Verify that your selected model is available in your configured region. For example, "gpt-4o-2024-08-06" might not be available in all regions (source).

### 3. Resolve Credential Conflicts

If you have both OpenAI and Azure OpenAI credentials configured, the system might favor regular OpenAI. To ensure Azure OpenAI is used, consider removing the regular OpenAI credential if you want to exclusively use Azure OpenAI (source).

Specify Provider in Assistant Configuration

When configuring your assistant, make sure to set the provider to "azure-openai":

{
  "model": {
    "provider": "azure-openai",
    "model": "gpt-4o-2024-08-06"
  }
}

{
  "model": {
    "provider": "azure-openai",
    "model": "gpt-4o-2024-08-06"
  }
}

{
  "model": {
    "provider": "azure-openai",
    "model": "gpt-4o-2024-08-06"
  }
}

{
  "model": {
    "provider": "azure-openai",
    "model": "gpt-4o-2024-08-06"
  }
}

Is there anything specific about your setup that you'd like me to help troubleshoot further?

Sources:

⤵️ Mention @Vapi for follow-ups 🐥

E

extreme-purple•4/10/25, 2:18 PM

@Manish was this guild helpful

V

VapiAPP•4/11/25, 7:03 PM

checking if this is resolved/solved for you?

T

technical-ivoryOP•4/25/25, 2:07 PM

I am able to add credentials but it is not able to find the model

T

technical-ivoryOP•4/25/25, 2:08 PM

@Shubham Bajaj @Kings_big

T

technical-ivoryOP•4/25/25, 2:11 PM

T

technical-ivoryOP•4/25/25, 2:27 PM

see the error

V

VapiAPP•4/27/25, 8:26 PM

Hey! To help track down this issue, could you share:

The call IDThis would really help us figure out what went wrong!

T

technical-ivoryOP•4/28/25, 11:21 AM

aaa9b433-dd56-4f8b-b3e6-79739c953e7a

T

technical-ivoryOP•4/29/25, 5:06 AM

@Shubham Bajaj did you look into this

V

VapiAPP•5/1/25, 9:14 PM

I am currently looking into this

T

technical-ivoryOP•5/2/25, 3:21 PM

Hi Kyle
any update on this?

V

VapiAPP•5/2/25, 9:13 PM

Not yet, still investigating. Thank you for your patience while I research this

D

dangerous-fuchsia•7/7/25, 11:09 AM

Any Update on this?

V

VapiAPP•7/7/25, 11:06 PM

This ticket has been marked as solved, and as a result, you will no longer receive any further responses. Kindly create a new support ticket to escalate your inquiry. 

getting no LLM found error

Set Up Azure OpenAI Credentials

Important Configuration Details

Specify Provider in Assistant Configuration

Similar Threads

Similar Threads

Set Up Azure OpenAI Credentials

Important Configuration Details

Specify Provider in Assistant Configuration

Similar Threads