Operational measures show what happened to the company’s workload. Customer outcomes require a separate test: whether the customer solved the problem and how much work the process required.

For executives, this distinction changes the investment question. Efficiency measures the work the organization avoided, automated, or accelerated. Customer effort measures the work a person must perform to complete a support task, including navigating steps, repeating information, changing channels, or seeking another answer. A support system should measure these outcomes separately rather than infer one from the other.

Operational metrics answer an operating question

Call volume, average handle time, automation, and support cost answer concrete management questions. They show how much demand reached employees, how long measured interactions took, how much work was automated, and what service cost. Those measures matter to the economics of an AI investment.

Containment measures whether a chatbot conversation ends without moving to another support channel, such as a human agent. Higher containment can indicate that fewer interactions reach employees, but it does not establish what happened from the customer’s perspective. Resolution requires knowing whether the person completed the task and how much effort it required.

Call deflection has the same measurement boundary. Keeping a call away from a contact center can reduce demand when self-service resolves the problem. A deflected call alone cannot show whether the customer found an answer, abandoned the task, or used another channel. Those outcomes must be measured rather than inferred.

Metric success can hide customer work

Consider a customer who asks for a person and must first complete multiple chatbot exchanges. The automated channel can keep the interaction contained while each required exchange adds work for the customer. The key question is whether those exchanges advance the case toward resolution. If they do not, the system has transferred effort from the organization to the customer.

The same principle applies to answer design. A virtual assistant might produce several paragraphs for a question that can be answered accurately with “yes” or “no.” More text does not make an answer more useful. The useful response gives the customer enough accurate information to complete the task with less work.

Lost context creates another form of customer labor. If a person must repeatedly explain the same issue because separate interactions fail to carry relevant information forward, the customer becomes responsible for reconnecting the journey. Each component may complete its function while the overall process remains inefficient for the person seeking help. Context needs to survive the handoffs that make up one support journey.

Commercial activity can also add work when it interrupts resolution. A customer seeking help with an urgent problem may encounter a product recommendation before the problem is resolved. That recommendation serves a separate commercial objective. When it delays the current task, the customer must complete an extra activity before reaching the intended outcome.

Abandonment presents the same measurement problem as containment. Leaving a chatbot ends resource use inside that channel, but the event alone does not establish resolution. The person could continue elsewhere or stop trying. Measuring the customer outcome prevents an unresolved disappearance from being counted implicitly as success.

Operational measures alone cannot establish effects on trust, frustration, satisfaction, or retention. Executives should measure these outcomes directly when they matter rather than substitute an operating proxy.

Okoone experts
LET'S TALK!

A project in mind?
Schedule a 30-minute meeting with us.

Senior experts helping you move faster across product, engineering, cloud & AI.

Please enter a valid business email address.

Escalation can reduce customer effort

The right endpoint depends on the problem. The design objective is a reliable route to resolution with as little unnecessary customer work as possible. Escalation should be evaluated as part of the complete support journey.

For each interaction, leaders can ask whether automation resolves the need efficiently or helps an employee resolve it with less duplicated work. This treats automation and human expertise as parts of one support system.

Use AI to remove work from the journey

Context retention provides a concrete test. When relevant information moves with a case, the next employee can start with information the customer has already supplied. The customer avoids reconstructing the same history at each handoff. The useful unit of analysis is the work removed from the complete journey.

This gives executives a practical test for vendor claims. Translate claims about speed, personalization, productivity, or cost reduction into a specific customer journey, then identify the friction the technology is expected to remove. Ask what changes for the employee, what changes for the customer, and whether the proposed AI is necessary to produce that change. Judge the result through resolution and customer effort.

Key takeaways for decision-makers

  • Measure efficiency and customer outcomes separately: Call volume, handle time, containment, automation, and cost show operational performance. Pair them with resolution and customer-effort measures to understand the full effect of AI support.
  • Track customer work across the journey: Repeated chatbot exchanges, lost context, premature sales activity, and abandonment can make operational metrics look successful while customers do more work. Support owners should measure whether each step advances the customer toward resolution.
  • Treat escalation as part of resolution: Moving a customer to an employee can reduce effort when automation cannot resolve the issue efficiently. Design escalation so relevant context follows the case and customers avoid repeating information.
  • Test AI investments against work removed: Technology buyers should map vendor claims to specific support journeys and identify the friction AI will remove for customers and employees. Evaluate results through resolution and customer effort alongside operating economics.

Alexander Procter

September 16, 2026

4 Min

Okoone experts
LET'S TALK!

A project in mind?
Schedule a 30-minute meeting with us.

Senior experts helping you move faster across product, engineering, cloud & AI.

Please enter a valid business email address.