AI strategy & operational transformation
Back to homeARLAN GREY · STRATEGY & ARTIFICIAL INTELLIGENCE

Perspective · AI & operational performance

Costs beyond the pilot.

A demonstration shows that a task can be automated. It does not yet establish the cost of running a reliable service day to day.

Firm briefing · 4-minute read

The key point. Measuring production time without accounting for verification and rework overstates the value of automation.

Work does not always disappear. It moves elsewhere.

A quickly generated response may require verification, correction or further research. The cost then falls elsewhere in the process or on another team. The relevant unit of measurement is a request handled correctly from end to end.

An illustrative calculation

Assume 100 cases, each taking 8 minutes to process: 800 minutes initially. With AI, production falls to 200 minutes. However, 300 minutes of verification and 200 minutes of rework must be added. The total is 700 minutes.

The saving is therefore 100 minutes before integration and maintenance costs. These assumptions are hypothetical: they show why a saving measured at just one stage can be misleading.

Evaluating what the demonstration leaves untested

Evaluation should cover representative situations distinct from the examples used to prepare the pilot. It must include incomplete requests, errors and difficult cases, then measure how they are actually handled.

The decision also depends on the required level of quality. Some errors are easy to correct; others require systematic checks. Responsibility for those checks must be explicit.

Preparing for operation

Who monitors errors? Who takes action when a source changes? Who can suspend the service? These questions shape the operating model and recurring costs as much as the choice of model does.

Before deployment, establish evidence of three things: sufficient quality, an acceptable total cost and clearly assigned operational responsibility.

An educational example, with no client results. The criteria must be adapted to the requirements and risks of each process. References: NIST AI RMF and FinOps Framework .