The AI Record

Organizations

Reddit

Online community platform; the speaker describes himself as an Android engineer there.

3 passages, 1 people quoted. Topics: How do coding agents open and merge changes?, What does AI cost organizations?, How do organizations measure AI's impact?, Do organizations build their own AI tools or buy them?, How autonomous are the agents, and who checks their work?, Does AI make developers more productive?.

Before I trusted this workflow, I back tested the scoring against months of clean up history. Then I ran it live. Seven for seven PRs with green CI. Now it runs daily on my laptop and hands work back for me to review. … $1.26 a pull request. A backlog of around 520 flags a year runs for under $700. If you had engineers working on this by hand, at least $26,000 that you're looking at.

Andrew OrobatorSenior Software Engineer · Practitioner

Context. The speaker is a Reddit Android engineer. In the talk he describes this agent as running in his local workflow and on his laptop, and says some of his other practices are from his personal side projects. The $26,000 is his own estimate of manual cost, and the PR count is a small sample.

Talk: Scale the Judgment, Not the Model, AI Engineer (YouTube), June 30, 2026, at 11:59.

  • 7 flag cleanup prs green ci, the live run after back testing. A person approves
  • $1.26 flag cleanup cost per pr, per pull request. A person approves
  • $700 flag cleanup yearly cost, per year, backlog of around 520 flags. A person approves
  • $26,000 flag cleanup manual cost, per year, same backlog

Checked against the source [ Grade B ] Said in the last year Passage page

I got tired of watching old feature flags pile up… I built an agent for cleaning up stale feature flags. It runs in my local workflow and it doesn't merge any code. The models, the easy part. The judgment in front of it is the whole game. Every flag gets scored the way an experienced reviewer would analyze it. How many modules does it touch? Is it multi-variant? Does it share a component? Then it checks the experiment data. Is the rollout frozen? Is there a sample ratio mismatch? Is there a variant already rolled out to 100 percent?

Andrew OrobatorSenior Software Engineer · Practitioner

Context. The speaker is a Reddit Android engineer. In the talk he describes this agent as running in his local workflow and on his laptop, and says some of his other practices are from his personal side projects.

Talk: Scale the Judgment, Not the Model, AI Engineer (YouTube), June 30, 2026, at 11:18.

Checked against the source [ Grade B ] Said in the last year Passage page

The job changed, and most of us didn't even notice, we're harness engineers now. Our work is the system that helps produce and verify the code. The constraints, the gates, the skills, the verification.

Andrew OrobatorSenior Software Engineer · Practitioner

Context. The speaker is a Reddit Android engineer speaking about engineers in general, not describing a Reddit policy.

Talk: Scale the Judgment, Not the Model, AI Engineer (YouTube), June 30, 2026, at 02:06.

Checked against the source [ Grade B ] Said in the last year Passage page