The Playbook · Part 1: See the line

02

Set a baseline. Keep measuring.

If you cannot say what the line delivered before, you cannot say what the money bought. And one measurement is a photograph, when what you need is a gauge.

The scene

Six months and a serious budget into agents, the CFO asks a fair question: what did we get for it? The answer is a slide with lines of code, tokens used and a survey in which engineers say they feel faster. Nobody wrote down what the line delivered before the programme started, so nobody can say what changed.

The play

Before the first optimization, record what the line delivers today, in terms the business already recognises: the value that ships, how long an idea takes to reach a customer, and how much comes back broken.

Then keep measuring, from now on. A baseline taken once goes stale within weeks. What you need is an observability layer over the whole line that runs all the time, so that every change you make shows up against what came before. If you do not have one, building it is the first investment, ahead of any agent.

Prefer measures that come from the business. Counting pull requests is acceptable on one condition: every pull request is tied to a ticket that carries business value, so the count adds up to something.

Smells

  • The return on investment is argued from lines of code, tokens or AI-assisted commits.
  • The evidence is that engineers feel faster.
  • Pull requests are counted with no link to what they were for.
  • There is no number from before the programme began.
  • The numbers were collected once, for a slide, and nobody has looked since.

First move

Pick three numbers the business already cares about and write down today’s values, with the date. Make every pull request reference a ticket, so that throughput can be traced back to value. Then put those three numbers somewhere they update by themselves, and look at them every week.

In Lights Out

Every purchase is judged against shipped tasks per day before and after, and each one leaves a tick on the sparklines. That is a baseline in miniature.