Agent Observability: From Telemetry to Business Value - Softcover

Inhaltsangabe

Your agent works. But does it deliver value?

An agent can run without errors and still make poor decisions, produce unusable work, or have little or no business impact. Understanding its execution is only the beginning.

Agent Observability: From Telemetry to Business Value presents a practical framework for measuring agent performance through three connected layers:

• Technical observability reveals how the agent executed, including its errors, latency, and cost
• Behavioral observability evaluates the quality of its decisions, outputs, and actions
• Business observability connects the agent’s work to operational progress and measurable business outcomes

The book explains how to:

• Model agent runs, events, model calls, tool calls, evaluations, and business outcomes
• Combine deterministic checks, policy rules, reference-based comparisons, scoring rubrics, and expert review to evaluate agent performance
• Preserve the correct grain and denominator for trustworthy analysis
• Connect technical telemetry to behavioral quality and business results without overstating causation
• Build practical dimensional models that make agent performance measurable end to end

Three in-depth case studies bring the framework to life across the customer lifecycle. A Sales Development Agent assesses leads and initiates outreach. A Solution Engineering Agent translates customer needs into proposed solution designs. A Customer Success Agent monitors customer health and recommends interventions to help retain and grow existing relationships.

Together, these examples explore agents with different responsibilities, operating models, and degrees of autonomy while demonstrating how the same observability framework can be applied to each.

Additional chapters present examples of agents in retail, healthcare, manufacturing, financial services, and beyond, illustrating how the framework can be adapted to very different business processes.

Written for data and analytics professionals, engineers, architects, and AI product leaders, Agent Observability: From Telemetry to Business Value introduces a platform-independent discipline for determining whether agents operate reliably, perform effectively, and contribute to outcomes that matter.

Die Inhaltsangabe kann sich auf eine andere Ausgabe dieses Titels beziehen.