wet-aquaW
VAPI3mo ago
wet-aqua

System Messages and Variable Data ignored

Some time around October 15 system messages and variable data sent over the create chat endpoint have become completely ignored or at best very unreliable between turns in a conversation.

Very easy to re-produce with just 2 messages. The system message remains in the chat messages history yet is ignored completely. Likewise the liquid js variables which may inject that data into the main prompt are also ignored.


Create a new chat:
{
  "assistantId": "92ff7248-0468-423e-a2b5-9e549bb45d3f",
  "input": [
    {
      "role": "system",
      "content": "You are in a chat session with a user named Bob"
    },
    {
      "role": "user",
      "content": "Hi, I need help!"
    }
  ],
  "assistantOverrides": {
    "variableValues": {
      "firstName": "Bob",
      "lastName": "McTester"
    }
  },
  "stream": false
}


Then create a follow up chat:

{
  "assistantId": "92ff7248-0468-423e-a2b5-9e549bb45d3f",
  "previousChatId": "a5bd1686-b98f-41e9-a447-0c9f40c35058",
  "input": "First, please confirm that you know my first name?",
  "stream": false
}


Response:

...    "output": [
        {
            "role": "assistant",
            "content": "Your first name is Angela. Is that correct?"
        }
    ],



This worked reliably for thousands of chats over the last month and is now un-usable. I see no updates in your changelog since September.
Was this page helpful?