llm-gateway

LLM Runtime Monitoring: OpenTelemetry GenAI and Production Debugging

LLM applications introduce new failure modes. A 200 OK response can hide a hallucination, a degraded prompt template can silently reduce quality, and