rival-black•15mo ago
Enhancing VAPI-Assistant with Lip-Sync Data for Virtual Avatars
Could you please add lip-sync data in response with VAPI-Assistant (https://github.com/DanielSWolf/rhubarb-lip-sync)
As the above mention linked, help for that but, If we get the same data from Vapi's side then many business continue Vapi's service.
If we get the lip-sync data as well, we can add a virtual avatar and create a more elegant application, as our client is requesting this feature and many developers are looking for the same.
GitHub
GitHub - DanielSWolf/rhubarb-lip-sync: Rhubarb Lip Sync is a comman...
Rhubarb Lip Sync is a command-line tool that automatically creates 2D mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other p...
3 Replies
@rudra
I'm glad to hear that you're interested in integrating lip-sync data with VAPI to enhance your applications with virtual avatars. Currently, VAPI does not natively provide lip-sync data as part of its service. However, I understand how valuable this feature would be for creating more immersive and interactive experiences.
To achieve lip-sync functionality, you would typically need to use a third-party service like Rhubarb Lip Sync, as you mentioned, or develop a custom solution that analyzes the audio from VAPI and generates the corresponding lip-sync data.
If you're looking for a more integrated solution within VAPI, I would recommend reaching out to our support team or providing feedback through our community channels. Your input is crucial for us to understand the demand for such features and to consider them for future updates.
For now, you may continue using Rhubarb Lip Sync or a similar service in conjunction with VAPI to create the desired experience for your clients. If you need further assistance or have specific questions about integrating these services, please let me know, and I'll do my best to assist you.
You can continue this conversation by mentioning me in the message.
rare-sapphire•14mo ago
please raise the feature request over here https://vapi.canny.io/
Vapi
Give feedback to the Vapi team so we can make more informed product decisions. Powered by Canny.
rival-blackOP•14mo ago
Yes, I did.
I also had a word with Nikhil, he told me the same.