like-gold•2mo ago
LangSmith observability provider
Is it possible to use LangSmith as an observability provider instead of LangFuse?
3 Replies
Hi there,
Thank you for your message. Our team is currently out of the office. We operate Monday through Friday, from 9:00 AM to 8:00 PM Pacific Standard Time (PST).
We’ll get back to you as soon as possible during our normal business hours.
If your message is urgent, please mark it accordingly or include “URGENT” in the subject line, and we’ll do our best to respond promptly.
Warm regards,
Vapi
Customer Support Team Hi dudleykong, Thanks for your question! Here’s the current state of observability support in Vapi: Current Status - Langfuse Integration: Vapi has native integration with Langfuse, an open-source observability platform for AI applications. This is currently the primary officially supported option. Custom Observability Options While Vapi doesn’t yet offer native support for other providers like LangSmith, you do have a few paths to implement custom observability: 1. Vapi’s Built-in Features - Vapi assistants include an
Vapi
Customer Support Team Hi dudleykong, Thanks for your question! Here’s the current state of observability support in Vapi: Current Status - Langfuse Integration: Vapi has native integration with Langfuse, an open-source observability platform for AI applications. This is currently the primary officially supported option. Custom Observability Options While Vapi doesn’t yet offer native support for other providers like LangSmith, you do have a few paths to implement custom observability: 1. Vapi’s Built-in Features - Vapi assistants include an
observabilityPlan system.
- The platform also exposes boards, evals, and scorecard features in the documentation that may be helpful for tracking and evaluating behavior.
2. OpenTelemetry Integration
- You can capture logs, metrics, and traces from Vapi’s operations.
- Export telemetry data to any platform that supports the OpenTelemetry standard (including LangSmith).
3. Webhook-based Monitoring
- Vapi supports webhooks, which can capture call events in real-time.
- You could forward these events into your observability platform and build your own dashboards.
Recommendation
If you want to go beyond the official Langfuse integration, I’d suggest:
- Reviewing the latest observability docs in Vapi.
- Exploring webhook setups for call event monitoring.
- Using OpenTelemetry as a bridge if your preferred observability provider supports it.
This way, you can extend observability to LangSmith (or any other platform) while continuing to use Vapi.like-goldOP•2w ago
Thanks Kyle
Glad you were able to get this resolved. If anything else comes up or you need further assistance, we’re here to help.