VAPI•2y ago

Bot says random words

I have a few issues with the bot I am building. I say my name is JJ and bot always reponds by saying some variation of how are yout today JJJ, JJ Jet , and so on. It rarely says JJ correctly. Also, I have no back channelling enabled and I had the bot respond with some random words. like thank you, followed by you.

Vapi•7/29/24, 8:45 PM

@Mamata Kondapally
It sounds like you're experiencing a couple of issues with your bot's response accuracy and back-channeling behavior. To address the first issue with the bot not recognizing the name "JJ" correctly, you may need to adjust the speech recognition settings or train the bot with the correct pronunciation and context.

For the second issue regarding the bot's random back-channeling words, you might need to review the dialogue management settings or the script that controls the bot's responses to ensure it's not generating unintended words.

If you could provide me with more details or access to the bot's configuration, I could give you more specific guidance on how to resolve these issues. Otherwise, if these are issues that require a deeper look into the system, please ask support for more info on this.

Vapi•7/29/24, 8:45 PM

You can continue this conversation by mentioning me in the message.

few-sapphireOP•7/29/24, 8:49 PM

@Vapi - here's the call id if that helps 3bd2c543-4758-440e-9e15-99ab29a68e9b.

Vapi•7/29/24, 8:49 PM

@Mamata Kondapally
Thank you for providing the call ID. However, as a support bot for VAPI, I don't have the capability to directly access call records or logs. To address the issues you're facing with the bot's response to your name and the random back-channeling words, you may need to review and adjust the bot's speech recognition and response generation settings.

If you have access to the bot's configuration, look for areas where you can train the bot with the correct pronunciation of "JJ" and ensure that the response templates do not include unintended filler words. If the problem persists or you're unsure how to make these adjustments, please reach out to the support team for more detailed assistance. They will be able to access the call ID and provide you with specific guidance based on the bot's performance during that interaction.

few-sapphireOP•7/29/24, 8:52 PM

@Vapi I dont have the randon words in my script.

Vapi•7/29/24, 8:52 PM

@Mamata Kondapally
I understand that the random words are not part of your script. This could indicate that there might be an issue with the bot's natural language processing or response generation algorithms. It's possible that the bot is attempting to predict or generate responses based on incomplete data or misinterpretation of the user input.

To resolve this, you may need to:

Review the bot's language model and ensure it's properly trained to understand and respond to user inputs.
Check if there is any machine learning component that might be generating these responses and retrain it with the correct dataset.
Look into the bot's settings to see if there is an option that inadvertently enables such behavior and disable it.
If you're using a third-party API or service for the bot's responses, check their documentation for any known issues or contact their support.

If these steps do not help or if you need more specific assistance, please reach out to the support team with details of the issue and the call ID you provided. They will be able to investigate further and provide you with the necessary support to fix the problem.

few-sapphireOP•7/29/24, 8:53 PM

@Vapi I am using Deepgram, chat GPT-4o and playht as my stack.

Vapi•7/29/24, 8:53 PM

@Mamata Kondapally
It's great that you're using a robust stack with Deepgram for speech recognition, GPT-4 for conversational AI, and Play.ht for text-to-speech. Here are some steps you can take to troubleshoot the issues you're experiencing:

Deepgram Misinterpretation: Ensure that Deepgram is accurately transcribing "JJ." If it's transcribing it incorrectly as "JJJ" or "JJ Jet," it could be a pronunciation issue or an audio quality problem. You might need to provide more training data or adjust the acoustic models if possible.
GPT-4 Response Generation: If Deepgram's transcriptions are accurate, the issue might be with how GPT-4 is generating responses. Make sure that the prompts sent to GPT-4 include the correct name, and check if there's any pattern in the data that might lead to these variations in the name.
Play.ht Pronunciation: If the issue is with the text-to-speech output from Play.ht, you might need to customize the pronunciation settings to ensure "JJ" is spoken correctly.
Random Words: For the random back-channeling words like "thank you, followed by you," this could be a problem with the conversational model's training. You might need to fine-tune the model with more examples of the desired behavior or adjust the settings to prevent these random insertions.

If you've checked these areas and the issues persist, you may need to reach out to the support teams for each component of your stack:

Contact Deepgram support to ensure their service is accurately transcribing the audio.
Reach out to OpenAI support for assistance with GPT-4's response patterns.
Get in touch with Play.ht support to address any text-to-speech pronunciation issues.

Remember to provide them with specific examples and the call ID you mentioned for more targeted help.

dangerous-fuchsia•7/30/24, 1:38 PM

@Mamata Kondapally can you please disable hippa for one call to debug the issue because call logs/recordings are not stored.

few-sapphireOP•7/30/24, 6:34 PM

@Shubham Bajaj - thanks for getting back. we disabled Hippa today for our testing and found a few issues that I am hoping that you can look at:
call Id: fde8a171-459a-4c38-a710-48fa1b83555f Bot repeated questions and changed name in the middle
call id: 847b0fac-079d-4e37-a16d-4cce253054e1 :
call id 30a0a9dd-b3e4-4106-9100-33acd36f6687 Latency before bot speaks for the first time. I had to increase the silence timeout to prevent calls from dropping.
Latency at the beginning of the call is of concern.

few-sapphireOP•7/30/24, 9:35 PM

Here' a call-id where the bot said random words like puss up, mina, you net
callId: a79abe27-2d75-4497-991a-c2054573ea0b

Ffew-sapphire Here' a call-id where the bot said random words like puss up, mina, you net call...

dangerous-fuchsia•7/30/24, 9:38 PM

timestamp please.

few-sapphireOP•7/30/24, 9:50 PM

callId: a79abe27-2d75-4497-991a-c2054573ea0b 2.30 PM pacific time.

unique-blue•7/30/24, 9:54 PM

bumping this

dangerous-fuchsia•7/30/24, 10:22 PM

@Mamata Kondapally words lie puss up mina you net are from TTS either becase if halcuinations or inputPreprocessingEnabled.
can you please try inputPreprocessingEnabled set to false.

few-sapphireOP•7/30/24, 10:28 PM

I have both
inputPreprocessingEnabled: true,
inputReformattingEnabled: true,
Do you suggest to only disable the inputPreprocessingEnabled or both?

few-sapphireOP•7/31/24, 1:15 AM

@Shubham Bajaj I have set only inputPreprocessingEnabled=false . I still had a call with random word . callid 6d678abf-6e9f-4104-b3e0-af68126da1d0 time: 6.10 PM PT. It said the word "make"

unique-blue•7/31/24, 1:02 PM

@Shubham Bajaj
call:a8e6445d-4976-4070-af40-c68dc7d88497 8:59 AM EST . It said the word "Puss Up"

unique-blue•7/31/24, 6:14 PM

@Shubham Bajaj
call:5d4b0f22-f51d-467e-bc3e-8db806c84c99 11:06am EST. It said Gasset

dangerous-fuchsia•7/31/24, 9:10 PM

can you try changing your TTS provider @Ami / @Mamata Kondapally because its generating these extra words or making tweaks in tts config if possible.

few-sapphireOP•7/31/24, 11:03 PM

We are using 11labs, playht , and cartesia , and we see the same issue with all 3.

Ffew-sapphire We are using 11labs, playht , and cartesia , and we see the same issue with all ...

dangerous-fuchsia•8/1/24, 6:58 PM

can you please disable(inputPreprocessingEnabled, inputReformattingEnabled) both because its from TTS only.

dangerous-fuchsia•8/1/24, 6:58 PM

also check your DM.

Bot says random words

Similar Threads

Similar Threads

Similar Threads