blank-aquamarine•16mo ago
is it possible to get an audio stream of an ongoing call ?
I am working on a demo for an event and I would like to perform an audio visualization of the conversation but looking through the docs I am not sure if I can get a stream of the audio in order to perform the visualization.
https://audiomotion.dev/demo/fluid.html
3 Replies
@Raju
Absolutely, you can create an audio visualization for your demo! While VAPI itself does not directly provide a streaming audio service, you can certainly use the audio data you obtain through VAPI to create visualizations.
For real-time audio visualization, you typically need access to the raw audio stream. If you're using VAPI to process voice input, you would capture the raw audio on the client device, and then you could use a library like AudioMotion.js, as you've linked, to perform the visualization in real-time.
Here's a high-level overview of the steps you might take:
1. Capture the raw audio from the microphone on the client device.
2. Use the AudioMotion.js library (or any other visualization library) to create a real-time visualization of the audio stream.
3. If you need to transcribe the audio, send it to a server for transcription and then feed the transcript text into the LLM for further processing.
Remember that for the transcription and LLM inference steps, you would not be visualizing the audio in real-time, as these processes involve some latency.
If you need further assistance with integrating VAPI into your audio visualization workflow or have specific questions about the capabilities, please let me know!
You can continue this conversation by mentioning me in the message.
passive-yellow•16mo ago
@Raju No not possible as of now.
blank-aquamarineOP•16mo ago
@Shubham Bajaj can you answer this one ? https://discord.com/channels/1211482211119796234/1260975942092853358
it's an alternate solution that I found