SUMMARY AND SUCCESS EVALUATION NOT UPDATING IN VAPI UI
I have tried several times to publish the summary and success evaluation, but it's not saving. It gets wiped out when i refresh and doesnt show option to publish when i put in the prompt
But i noticed a new update in the analysis plan when i used API to get the assistant. There is a new structure that's supposed to input the transcript but it doesn't work.
why is not saving and how does this new analysis feature work?
{
"analysisPlan": {
"summaryPlan": {
"messages": [
{
"content": "Summarize the outcome of the call with a focus on lead quality.\n\n- If the AI Assistant reached a live person, note that as "Live Answer".\n- If the caller was open to hearing more, asked follow-up questions, requested a call back, or expressed interest in funding, label this as a "Good Lead".\n- If the caller said things like “Not interested,” “I don’t need money,” or ended the call abruptly, label it as a "Declined Lead".\n- If the call was routed to voicemail, a robot, or no one answered, label it as "No Contact". Answering machines often say the words "leave a message" or "leave your name and number"\n\nEnd the summary with one of the following tags: [Good Lead], [Declined Lead], [No Contact]\n",
"role": "system"
},
{
"content": "Here is the transcript:\n\n{{transcript}}\n\n. Here is the ended reason of the call:\n\n{{endedReason}}\n\n",
"role": "user"
}
]
},
"successEvaluationPlan": {
"rubric": "NumericScale",
"messages": [
{
"content": "Evaluate the call outcome using the following criteria:\n\n- Was a live person reached? If yes, proceed.\n- Did the person express interest, ask questions, or agree to a follow-up? → Mark as a "Good Lead".\n- Did the person say “Not interested”, “Don’t need funding”, or hang up without engaging? → Mark as a "Declined Lead".\n- If the call went to voicemail, a phone tree, or had no human interaction → Mark as "No Contact".\nSome clues that it is a voicemail are words that say "at the tone". Answering machines often say the words "leave a message" or "leave your name and number"\n\nLabel each call as: [Good Lead], [Declined Lead], or [No Contact]\n\n\nRubric:\n\n{{rubric}}\n\nOnly respond with the evaluation result.",
"role": "system"
},
{
"content": "Here is the transcript of the call:\n\n{{transcript}}\n\n. Here is the ended reason of the call:\n\n{{endedReason}}\n\n",
"role": "user"
},
{
"content": "Here was the system prompt of the call:\n\n{{systemPrompt}}\n\n",
"role": "user"
}
]
}
}
}
But i noticed a new update in the analysis plan when i used API to get the assistant. There is a new structure that's supposed to input the transcript but it doesn't work.
why is not saving and how does this new analysis feature work?
{
"analysisPlan": {
"summaryPlan": {
"messages": [
{
"content": "Summarize the outcome of the call with a focus on lead quality.\n\n- If the AI Assistant reached a live person, note that as "Live Answer".\n- If the caller was open to hearing more, asked follow-up questions, requested a call back, or expressed interest in funding, label this as a "Good Lead".\n- If the caller said things like “Not interested,” “I don’t need money,” or ended the call abruptly, label it as a "Declined Lead".\n- If the call was routed to voicemail, a robot, or no one answered, label it as "No Contact". Answering machines often say the words "leave a message" or "leave your name and number"\n\nEnd the summary with one of the following tags: [Good Lead], [Declined Lead], [No Contact]\n",
"role": "system"
},
{
"content": "Here is the transcript:\n\n{{transcript}}\n\n. Here is the ended reason of the call:\n\n{{endedReason}}\n\n",
"role": "user"
}
]
},
"successEvaluationPlan": {
"rubric": "NumericScale",
"messages": [
{
"content": "Evaluate the call outcome using the following criteria:\n\n- Was a live person reached? If yes, proceed.\n- Did the person express interest, ask questions, or agree to a follow-up? → Mark as a "Good Lead".\n- Did the person say “Not interested”, “Don’t need funding”, or hang up without engaging? → Mark as a "Declined Lead".\n- If the call went to voicemail, a phone tree, or had no human interaction → Mark as "No Contact".\nSome clues that it is a voicemail are words that say "at the tone". Answering machines often say the words "leave a message" or "leave your name and number"\n\nLabel each call as: [Good Lead], [Declined Lead], or [No Contact]\n\n\nRubric:\n\n{{rubric}}\n\nOnly respond with the evaluation result.",
"role": "system"
},
{
"content": "Here is the transcript of the call:\n\n{{transcript}}\n\n. Here is the ended reason of the call:\n\n{{endedReason}}\n\n",
"role": "user"
},
{
"content": "Here was the system prompt of the call:\n\n{{systemPrompt}}\n\n",
"role": "user"
}
]
}
}
}
