Observability

The pipeline keeps its receipts. All of them.

Per-issue cost ledger. Full audit trail. Every prompt sent, every dollar spent, every state transition retained. The answer to “why did this PR cost what it did” lives in the ledger, not in someone’s head.

Cost ledger

Every dollar attributed.

Each prompt, each tool call, each completion is logged with its model, its token count, and its dollar amount. The ledger rolls up to the issue, the agent, the tenant, and the time window. Export to your warehouse, or read it directly.

  • Per-issue rollup with full prompt-level breakdown
  • Per-agent comparison across issues
  • Per-tenant attribution for multi-team workspaces
  • CSV / API export for finance and BI tooling
cost_ledger · last_30d $1,142.18 · 9 repos
AgentIssuesTokens$
builder18424.1M$612.40
inspector1848.3M$184.22
surveyor1846.1M$148.66
architect1845.7M$138.30
sentinel1841.2M$32.18
marshal1840.8M$18.42
mayor1840.3M$7.99
Audit trail

Every decision recorded.

Each state transition is stamped with the agent, the timestamp, the input prompts, the model output, and the artifacts produced. You can replay an issue’s full history end to end, or open a single transition to see exactly what the agent was looking at.

  • Every prompt and every response retained
  • Tool call inputs and outputs preserved
  • Replayable transition timeline per issue
  • Retention configurable per tenant (default: lifetime)
audit.issue(2841) 14m · 41 events
14:02:11Mayorpulled from queue
14:02:14Surveyorread 3 files, 142 conventions
14:03:02Surveyorsurvey complete
14:03:05Architectdrafted 3-file change plan
14:03:40Architectplan approved by gate
14:04:02Builderimplemented · 142 +/- lines
14:11:39BuilderPR #2841 opened
14:12:12Inspectorinspection complete · evidence ok
14:14:55Marshalmerged to main
Programmable

A queryable interface, not a dashboard.

The ledger and audit trail are queryable Postgres views, exposed through a stable API. Build your own dashboard. Wire it into your BI tool. Alert on spend per agent. The point is that the data is yours, structured, and not trapped behind a vendor UI.

API reference
// query the ledger for an agent's spend
SELECT agent, SUM(cost_usd)
FROM   cost_ledger
WHERE  tenant = 'colony'
  AND  ts >= now() - '7 days'
GROUP BY agent
ORDER BY 2 DESC;

See your team’s ledger.

The pilot ships with full read-access to the ledger and audit trail for your repos.