VAPI•5mo ago

VAPI assistant misunderstood the words over the calls

like i said fiat uno but it read it as fiat or no. which is not what i want

To improve recognition of phrases like "Fiat Uno," try switching your assistant's speech-to-text provider to a more accurate model or a custom transcriber. For example, you can configure Deepgram as your custom transcriber in your assistant setup:

"transcriber": {
  "provider": "custom-transcriber",
  "server": { "url": "wss://your-server.ngrok.io/api/custom-transcriber" }
}

"transcriber": {
  "provider": "custom-transcriber",
  "server": { "url": "wss://your-server.ngrok.io/api/custom-transcriber" }
}

This allows you to leverage advanced transcription services that may better handle brand names and uncommon phrases. See more in the Vapi documentation.

Source:

Custom transcriber | Vapi Documentation

⤵️ Mention @Vapi Support Bot for follow-ups 🐥

sour-pinkOP•8/12/25, 1:26 PM

@Duckie
its not about the transcribe but also listens the data and passes the data incorrectly to the function tools attached

Vapi Support BotAPP•8/12/25, 1:28 PM

To help ensure the correct data is passed to your function tools, try refining your assistant's system prompt to explicitly instruct the model on when and how to trigger each tool. For example:

"messages": [
  {
    "role": "system",
    "content": "[TASK] Only trigger the function tool if the user's input exactly matches a known brand or model (e.g., 'Fiat Uno'); otherwise, ask for clarification."
  }
]

"messages": [
  {
    "role": "system",
    "content": "[TASK] Only trigger the function tool if the user's input exactly matches a known brand or model (e.g., 'Fiat Uno'); otherwise, ask for clarification."
  }
]

This can help reduce accidental tool calls from ambiguous or misheard phrases. See more on customizing tool behavior.

Source:

Integrating Tools with Vapi

KyleAPP•8/14/25, 7:06 AM

Hi kd,

If the VAPI assistant is misunderstanding words during calls, it could be linked to issues in speech recognition accuracy. Here are some steps you can take to improve this:

Transcription Accuracy: If incorrect transcription is a problem, consider switching to a more accurate speech-to-text service provider.
Check Call Logs: Review call logs for transcripts and any error messages to identify the source of misunderstandings. More details on troubleshooting can be found here.
Model Configuration: Ensure that the language model being used is appropriate and configured with optimal settings like context window size and allowable token limits.
Test and Debug: Utilize the dashboard's testing tools to simulate calls and verify how the assistant handles specific inputs.
Voice Quality: If the assistant sounds robotic or unnatural, consider switching to a different voice provider or tweaking your current voice settings.

For systematic troubleshooting, refer to the detailed steps for debugging issues with voice and understanding in our guide.

These actions should help in diagnosing and improving the assistant's speech recognition performance.

"messages": [ { "role": "system", "content": "[TASK] Only trigger the function tool if the user's input exactly matches a known brand or model (e.g., 'Fiat Uno'); otherwise, ask for clarification." } ]

VAPI assistant misunderstood the words over the calls

Similar Threads

Similar Threads

Similar Threads