Can AI fix bugs and handle incidents?

“In the past four weeks, OCA assisted with 575 of the 1,220 PRs merged to address incidents.”

Richard MarmorsteinCo-author of Ramp's OCA post (job title not stated) · Practitioner, Ramp

“Testo, in the last 30 days, caught 425 bugs.”

Geoff CharlesChief Product Officer (CPO) · Executive, Ramp

“Right now, OCA is human-in-the-loop.”

Richard MarmorsteinCo-author of Ramp's OCA post (job title not stated) · Practitioner, Ramp

“a growing share of sessions aren’t initiated by humans, but by automated managed agents handling code review, self-healing CI failures, completing E2E PRs with visual validation, triaging on-call alerts, debugging incoming bugs, and handling a variety of code maintenance tasks with human reviews/escalations.”

Uday Kiran MedisettyDistinguished Engineer · Practitioner, Uber

“Alert investigation: automatic investigations of paging alerts in production”

MonzoPublished by the organization itself (post), no named author

“agents spin up to then triage and run your on-call”

Ahmad Al-DahleChief Technology Officer · Executive, Airbnb

“What we did was we built a system that actually has agents constantly running and creating BAML programs. … We then look at the entire … transcripts, see what tools they use, see what happened, and obviously we as humans can inspect them. But more importantly, we can have agents go inspect them. And agents find what was good, what was bad. … And we can have humans collaborate with these issues to figure out which ones are real, which ones are hallucinations, which ones don't have taste as much as I hate to use that word. And then we can have agents go ahead and create fixes to these problems and go to address them.”

Vaibhav GuptaCo-founder and Chief Executive · Executive, Boundary (BoundaryML)

“The SRE use case, internally we think about it as auto triage Because we just want every message that comes in, and that’s an alert, that’s a bug report, to have Devin just start triaging it before anything else. And we’ve leaned into this use case so much though that we’ve basically tried to make it so that you don’t ever have to leave Slack to interact with this.”

Walden YanCo-founder and Chief Product Officer · Executive, Cognition

“At PostHog, for example, 63% of changed lines are in files that already exist, and fix is our largest commit type at 40%.”

Jina YoonAuthor, PostHog newsletter · Practitioner, PostHog

“Over roughly six weeks, we’ve run thousands of scans, produced over 300 findings ranging from defense-in-depth improvements to resolved security incidents.”

Zack DeveauTitle not stated on Deveau's author page; the post is written from Shopify's Application Security team · Practitioner, Shopify

“Early data shows that 70% of all our in house background agents, tasks which is Minions are toil.”

Abhishek TibrewalSenior Data Scientist, Platform Engineering · Practitioner, Uber

“We are now generating operation logs uh uh or daily summary of the platform”

Xiucheng QuekSoftware engineer · Practitioner, Genentech

“We are building an agent that "handholds" a change all the way to production — whether it's a code change or a change behind a feature flag. It observes the relevant monitoring graphs, but can also build its own dashboard to monitor important signals. More of our code changes are going to production with this kind of agent monitoring.”

Venkat VenkataramaniVP of Engineering, Applied Infra · Leader, OpenAI