VAPI•2y ago

assistant performance gets worse inside a squad

I am using a squad of three assistants. After testing each assistant when i grouped them into a squad, I saw that they were not following the system prompts like they do when run alone. They are hallucinating a lot in the squads.

sad-indigoOP•7/10/24, 1:04 AM

@Sahil please suggest

Vapi•7/10/24, 1:05 AM

@CTO - Bytebricks
I'm sorry to hear that you're experiencing issues with the assistants in your squad. When assistants are grouped into a squad, their interactions can sometimes lead to unexpected behaviors due to the complexity of managing multiple contexts and tasks.

Here are a few steps you can take to improve the performance of your squad:

Review Squad Configuration: Ensure that the assistants in the squad are closely related in terms of the tasks they perform. This can help reduce confusion and improve context handling.
Simplify Tasks: If possible, simplify the tasks each assistant is responsible for. This can help reduce errors and improve the accuracy of responses.
Test Individually and in Pairs: Test each assistant individually and in pairs within the squad to identify which interactions are causing the issues.
Adjust Context Handling: Make sure that the context provided to each assistant is clear and relevant to the tasks they are designed to perform.
Check for Overlaps: Ensure that there is no overlap in the functionality of the assistants that could cause conflicts or ambiguity in the squad's responses.
Update Training Data: If the assistants are machine learning-based, consider retraining them with data that reflects their use in a squad environment.
Contact Support: If the issue persists, it may be helpful to reach out to the support team for assistance. They can provide more targeted advice and help troubleshoot the problem.

If you need further assistance or have specific questions about the squad's behavior, please don't hesitate to ask.

Vapi•7/10/24, 1:05 AM

You can continue this conversation by mentioning me in the message.

sad-indigoOP•7/10/24, 1:05 AM

@Shubham Bajaj please suggest

VVapi You can continue this conversation by mentioning me in the message.

VapiAPP•7/10/24, 1:05 AM

Got it. Tagging @Vapi Team for additional help.

living-lavender•7/10/24, 4:40 AM

@Shubham Bajaj can you please help out?

dangerous-fuchsia•7/10/24, 11:26 AM

@CTO - Bytebricks please share the callids.

sad-indigoOP•7/10/24, 11:26 AM

Sure

sad-indigoOP•7/10/24, 11:34 AM

With squad, using Sarah: 8ba0610b-7012-4e17-95fd-e859af10987f

sad-indigoOP•7/10/24, 11:35 AM

18aa8750-08ca-4bff-8428-bee7c04c9d9b same agent without squad

sad-indigoOP•7/10/24, 11:37 AM

There have been inconsistencies for the same agent on call vs web too.

sad-indigoOP•7/10/24, 11:38 AM

It seems like system prompt gets not fully captured when talking on call.

sad-indigoOP•7/10/24, 11:52 AM

@Shubham Bajaj

sad-indigoOP•7/10/24, 11:52 AM

Please check

sad-indigoOP•7/10/24, 1:19 PM

@Shubham Bajaj

sad-indigoOP•7/10/24, 1:19 PM

@Sahil

dangerous-fuchsia•7/10/24, 1:20 PM

@CTO - Bytebricks buddy I am in call will check in few minutes.

sad-indigoOP•7/10/24, 1:20 PM

okay i am waiting

sad-indigoOP•7/10/24, 1:29 PM

available now ? Its quite urgent i have a client lined up actually, it will be highly appreciated if you can spare few mins for me. @Shubham Bajaj

Ssad-indigo available now ? Its quite urgent i have a client lined up actually, it will be h...

dangerous-fuchsia•7/10/24, 1:29 PM

check DM.

LinearAPP•7/10/24, 2:43 PM

Issue VAP-1579 created.

VAP-1579 - Assistant looses Identity

Using Squad, after transfer to assistant named sarah system/agent still uses the previous assistant named 'rina' identity

Status

Triage

Vapi

•

7/10/24, 2:43 PM

assistant performance gets worse inside a squad

Similar Threads

Similar Threads

Similar Threads