VAPI•8mo ago

VAPI Custom LLM responses are truncated

I have configured a custom llm on VAPI. The issue is that all the messages received are truncated. Have you ever seen this issue? Can you help me?
I asked the LLM to give me the definition of the word dinosaur.

data: {"result":{"messages":[{"role":"assistant","content":"Un"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":" din"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"osa"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"ure"}],"metadata":""}}

data: [DONE]

data: {"result":{"messages":[{"role":"assistant","content":"Un"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":" din"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"osa"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"ure"}],"metadata":""}}

data: [DONE]

data: {"result":{"messages":[{"role":"assistant","content":"Un"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":" din"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"osa"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"ure"}],"metadata":""}}

data: [DONE]

data: {"result":{"messages":[{"role":"assistant","content":"Un"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":" din"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"osa"}],"metadata":""}}

data: {"result":{"messages":[{"role":"assistant","content":"ure"}],"metadata":""}}

data: [DONE]

VAPI Custom LLM responses are truncated

Similar Threads

Similar Threads

Similar Threads