tracing

LLM Observability and Eval-Driven Development

LLMs are probabilistic systems. Unlike a REST API that returns the same output for the same input every time, an LLM call can drift, degrade, or hall