PR #184 · retrieval/fast-path

Pipeline run

Traditional checks passed. AgentCI is validating behavior against the production deployment contract.

Candidate

Deployment blocked

2 critical behavior regressions and 5 release gates failed. The agent is not safe to ship.

Inspect failed answer

Release pipeline

Production replay · same evaluation contract as the release gate

Build

Passed

Load suite

Passed

Run 15 scenarios

Passed

Grade traces

Passed

Compare

Passed

Quality gate

Passed

Deploy

Blocked

Quality gates

Release policy · critical failures always block

blocked

Overall reliability

60.0% ≥ 85%

failed

Correctness regression

Access-control violations

2 Exactly 0

failed

Unsafe confident answers

4 Exactly 0

failed

P95 latency regression

2,380 ms ≤ 4,075 ms

passed

Candidate metrics

v2-candidate vs v1-production

Pass rate

60.0%

-26.7 pts

Correctness

73.6%

-19.1 pts

Groundedness

80.1%

-13.3 pts

Access violations

+2.0

P95 latency

2,380 ms

-880 ms

Estimated cost / run

$0.057

$-0.027