extended-yellow•14mo ago
assistant performance gets worse inside a squad
I am using a squad of three assistants. After testing each assistant when i grouped them into a squad, I saw that they were not following the system prompts like they do when run alone. They are hallucinating a lot in the squads.
11 Replies
extended-yellowOP•14mo ago
@Sahil please suggest
@CTO - Bytebricks
I'm sorry to hear that you're experiencing issues with the assistants in your squad. When assistants are grouped into a squad, their interactions can sometimes lead to unexpected behaviors due to the complexity of managing multiple contexts and tasks.
Here are a few steps you can take to improve the performance of your squad:
1. Review Squad Configuration: Ensure that the assistants in the squad are closely related in terms of the tasks they perform. This can help reduce confusion and improve context handling.
2. Simplify Tasks: If possible, simplify the tasks each assistant is responsible for. This can help reduce errors and improve the accuracy of responses.
3. Test Individually and in Pairs: Test each assistant individually and in pairs within the squad to identify which interactions are causing the issues.
4. Adjust Context Handling: Make sure that the context provided to each assistant is clear and relevant to the tasks they are designed to perform.
5. Check for Overlaps: Ensure that there is no overlap in the functionality of the assistants that could cause conflicts or ambiguity in the squad's responses.
6. Update Training Data: If the assistants are machine learning-based, consider retraining them with data that reflects their use in a squad environment.
7. Contact Support: If the issue persists, it may be helpful to reach out to the support team for assistance. They can provide more targeted advice and help troubleshoot the problem.
If you need further assistance or have specific questions about the squad's behavior, please don't hesitate to ask.
You can continue this conversation by mentioning me in the message.
extended-yellowOP•14mo ago
@Shubham Bajaj please suggest
Got it. Tagging @Vapi Team for additional help.
extended-salmon•14mo ago
@Shubham Bajaj can you please help out?
fascinating-indigo•14mo ago
@CTO - Bytebricks please share the callids.
extended-yellowOP•14mo ago
Sure
With squad, using Sarah: 8ba0610b-7012-4e17-95fd-e859af10987f
18aa8750-08ca-4bff-8428-bee7c04c9d9b same agent without squad
There have been inconsistencies for the same agent on call vs web too.
It seems like system prompt gets not fully captured when talking on call.
@Shubham Bajaj
Please check
@Shubham Bajaj
@Sahil
fascinating-indigo•14mo ago
@CTO - Bytebricks buddy I am in call will check in few minutes.
extended-yellowOP•14mo ago
okay i am waiting
available now ? Its quite urgent i have a client lined up actually, it will be highly appreciated if you can spare few mins for me. @Shubham Bajaj
fascinating-indigo•14mo ago
check DM.
VAP-1579 - Assistant looses Identity
Using Squad, after transfer to assistant named sarah system/agent still uses the previous assistant named 'rina' identity
Status
Triage
Vapi