Northwind Financial: 79% of summaries were substantially rewritten, with edits clustering in two clauses the agent consistently misread.

Aisha Bello
Aisha Bello
Northwind Financial workplace

The problem

A contract-summary agent reported a 98% completion rate for two quarters. Legal operations quietly disagreed.

What we did

Assembly instrumented the full workflow — instruction, retrieved scope, tool calls, and what paralegals did with the output.

The result

79% of summaries were substantially rewritten, with edits clustering in two clauses the agent consistently misread. Fixed in a fortnight, once visible.

Every dashboard said the agent was working. The paralegals knew otherwise and nobody asked them.

Share