Different Ways To Instrument Your LLM Application
LLM instrumentation is the process of monitoring and collecting data in an LLM application, helping you achieve performance and reliability. This video covers key frameworks for instrumenting an LLM application -- including OpenTelemetry (Otel) and OpenInference -- and the tradeoffs between automatic and manual instrumentation. It also shows three ways to set up manual instrumentation: using decorators, the `with` clause, and starting spans directly. 🎛️ More on LLM instrumentation: https://arize.com/blog/different-ways... 🎛️ OpenInference: https://github.com/Arize-ai/openinfer... 🎛️ LLM tracing quickstart: https://docs.arize.com/phoenix/tracin...