VAPI•3w ago

Custom LLM option doesn't have a URL field??!?

The URL for your Custom LLM isn't set in the credentials sectionâit's specified when you create or update an assistant. Use the following JSON structure in your assistant's model configuration to set the endpoint:

{
  "name": "My Assistant",
  "model": {
    "provider": "custom-llm",
    "url": "<YOUR OPENAI COMPATIBLE ENDPOINT BASE URL>",
    "model": "my-cool-model"
  }
}

{
  "name": "My Assistant",
  "model": {
    "provider": "custom-llm",
    "url": "<YOUR OPENAI COMPATIBLE ENDPOINT BASE URL>",
    "model": "my-cool-model"
  }
}

{
  "name": "My Assistant",
  "model": {
    "provider": "custom-llm",
    "url": "<YOUR OPENAI COMPATIBLE ENDPOINT BASE URL>",
    "model": "my-cool-model"
  }
}

{
  "name": "My Assistant",
  "model": {
    "provider": "custom-llm",
    "url": "<YOUR OPENAI COMPATIBLE ENDPOINT BASE URL>",
    "model": "my-cool-model"
  }
}

Set credentials first, then add the URL in the assistant's model config as shown above.
For more details, see the documentation I have found: https://docs.vapi.ai/customization/custom-llm/fine-tuned-openai-models.

Source:

Using Fine-Tuned OpenAI Models

â¤µï¸ Mention @Vapi Support Bot for follow-ups ð¥

Custom LLM option doesn't have a URL field??!?

Similar Threads

Similar Threads

Similar Threads