Ordnance Trust: The cheapest agent per token was the most expensive per outcome, by a factor of nine.

Sofia Marchetti
Sofia Marchetti
Ordnance Trust workplace

The problem

Finance wanted a defensible answer on what the AI programme was returning.

What we did

Spend was joined to completed, uncorrected outcomes rather than token consumption.

The result

The cheapest agent per token was the most expensive per outcome, by a factor of nine.

Finance did not want an opinion on AI. They wanted the arithmetic.

Share