OpenTelemetry for GenAI and the OpenLLMetry project - OpenObservability Talks S6E06

About this episode

The episode discusses monitoring and observability for Generative AI using OpenTelemetry and features insights from Nir Gazit on the OpenLLMetry project.

Generative AI is everywhere, but how do we monitor and observe it? OpenTelemetry has been a prominent tool and standard for observability, and recently the OTel community has been aiming to expand its scope and cover GenAI workloads with semantic conventions and tools. In this episode, Horovits is joined by Nir Gazit, creator of the OpenLLMetry project, and member of the OpenTelemetry Generative AI SIG. We discuss new semantic conventions, tracing prompts and model behavior, the OpenLLMetry project’s journey, and what observability even means for modern AI systems. Nir Gazit is the CEO and co-founder of Traceloop, and brings a wealth of data and AI experience, with previous experience leading AI teams at Google and serving as the Chief Architect at Fiverr. You can read the recap post: https://medium.com/p/81b9cea6a771/ Show Notes: 00:00 - intro 04:09 - what is observability for AI 18:07 - AI observability differences from traditional observability 25:22 - OpenLLMetry intro 41:21 - OpenLLMetry latest updates and roadmap 47:00 - OpenTelemetry GenAI Semantic Conventions SIG 56:03 - KubeCon updates: CrossPlane, Knative, Dragonfly, in-toto reached CNCF graduation 1:00:08 - outro…

People in this episode

Host: Dotan Horovits

Guest: Nir Gazit

Topics covered

• Generative AI
• observability
• OpenTelemetry
• semantic conventions
• AI systems
• OpenLLMetry
• tracing

Keywords

• OpenTelemetry
• Generative AI
• observability
• OpenLLMetry
• semantic conventions
• AI monitoring
• tracing prompts

Mentioned in this episode

Organizations: OpenTelemetry, OpenLLMetry, Traceloop, Google, Fiverr

More episodes of OpenObservability Talks

• OpenTelemetry Comes of Age: CNCF Graduation, Profiling and eBPF - OpenObservability Talks S6E11 · May 29, 2026 · 59 min
• VictoriaMetrics: From Monitoring to Observability - OpenObservability Talks S6E10 · April 30, 2026 · 57 min
• Operating OpenTelemetry at Scale with OpAMP - OpenObservability Talks S6E09 · March 17, 2026 · 1h 3m
• The State of OpenTelemetry: Insights from OTel Unplugged Europe - OpenObservability Talks S6E08 · February 26, 2026 · 1h 2m
• A Decade of CNCF: Fireside Chat with the CTO - OpenObservability Talks S6E07 · January 8, 2026 · 55 min
• Unveiling OpenTelemetry eBPF Instrumentation - OpenObservability Talks S6E05 · October 26, 2025 · 1h 1m