The AI Record
Before switching all reviews over from v1 to v2, we ran every review in every canary repo on both v1 and v2 in a comparative shadow mode. The two agreed on the approval decision in 98% of the merge requests we tested, so we moved everyone over in one go in early October and removed the v1 code.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026, at What else has changed since our last post?.

  • 98% v1 v2 approval agreement, shadow-mode comparison before early October 2026

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools

Filed under

Who is speaking

Ryan Skidmore, Author of Cloudflare's "Orchestrating AI Code Review at scale" blog post. Wrote the engineering post describing the system Cloudflare runs internally, with its own usage data.

Cloudflare sells AI or agent tools or services, so it has a reason to publish flattering numbers about AI. The passage stays in the archive; read it with that in mind.

How this was checked

Checked against the source by a first reader, then confirmed independently by a second reader who fetched the source without seeing the first reader's notes (Independent review agent (Claude Sonnet), blind second pass from passage text and citation only, no repository access, 2026-11-07).

Exact match to the page text, including 98% and 'removed the v1 code'. The post is bylined to ryan-skidmore.

How to cite this passage

Ryan Skidmore (Cloudflare), “Cutting our inference bill by 68% by being obsessive about optimization”, Cloudflare blog, 2026-10-19, at What else has changed since our last post?. https://blog.cloudflare.com/obsessive-inference-optimization/ Archived at https://the-ai-record.com/passages/cloudflare-switching-all-reviews-v1-v2-ran-2026

More from the same source

Before the changes, authors acted on 34% of the code quality reviewer's serious findings. Now it's 59%.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026, at Review quality.

  • 34% findings acted on before, before the September to October 2026 changes
  • 59% findings acted on after, after the changes, one-day window

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools Passage page

With code quality at high effort, the average review now costs just $0.77, down 68% from the $2.43 it averaged over our two most expensive weeks before we started.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026.

  • $0.77 cost per review, after mid-September to early October 2026 changes
  • 68% cost per review reduction, versus the two most expensive weeks before the work

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools Passage page

Important findings per review went from 0.28 before to 0.30 now, and the intervals overlap.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026, at Review quality.

  • 0.28 important findings per review before, before the changes
  • 0.3 important findings per review after, after the changes

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools Passage page

In a later randomized split, Opus 5.5 at medium showed no measurable change in review outcomes or critical findings compared with Opus 5, so we switched.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026, at Changing models and effort.

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools Passage page

Medium effort did lose real findings. In the randomized split, code quality at medium led to roughly a quarter as many acted-on findings as at high, which is why we're moving it to high.

Ryan SkidmoreAuthor of Cloudflare's "Orchestrating AI Code Review at scale" blog post · Practitioner, Cloudflare

Post: Cutting our inference bill by 68% by being obsessive about optimization, Cloudflare blog, October 19, 2026, at Review quality.

Checked against the source [ Grade B ] Said in the last year Cloudflare: $2.2 billion revenue, FY2025 Sells AI tools Passage page

Something wrong? Report a correction. JSON: /api/v1/passages/cloudflare-switching-all-reviews-v1-v2-ran-2026.json