wispy-yellowW
VAPI•5mo ago
wispy-yellow

Script not matching Transcript in Test Suite API

I'm running vapi test suites through the API with this call:

      console.log("item.input", item.input)
      const createdTest = await vapi.testSuiteTests.testSuiteTestControllerCreate(testSuite.id, {
        scorers: [{ type: "ai", rubric: scorer }],
        type: "chat",
        script: item.input,
        numAttempts: 1,
        name: `${experimentName} - Script ${i + 1}`,
      })


I can see that the item.input is unique every time it's created and it shows the different scripts on the dashboard as well. But the transcript shows the same test user script for every single one.

Is there a caching bug or creation bug occuring on VAPIs endpoint or am I invoking this incorrectly?
Was this page helpful?