Nordic Corporate Bank

“Also, we have a stats page where the last one is the most interesting because it shows the number of completed pull requests we've done per month for the last two years. And this blue part is after we deployed … to production. So as you can see, the amount of code that's being produced is much higher now than before. And the first month, March, the March, we completed 572 pull requests in one month. That's a pretty high number. And the year before, it was 141 with the same team, two developers.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“And how much does this get cost? I don't really have a clear answer to that because he's sharing my GitHub subscription. So I think I use most of it. But I think maybe it's been costing like $100 to $200 a month maybe. And that's not, that's almost for free. But I guess that will increase now. And also we're not using the most expensive models. So that cost could go up a lot. But it's enabled us to do this.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“So then we thought, why don't we just remove ourselves from that first stage? And … do that work instead. So we did. And we gave him some instructions on how an Epic should be specified. It needs to have a description. It needs to have some acceptance criteria. … needs to have some certain level of confidence on how to implement it. And if … doesn't have that, he won't start. Then he will just ask a question back to the product owner, … him or her, and try to figure out the stuff he needs to be able to continue.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“And we started building this agent. And this was in November 2025. And that was kind of the last time we've written code by hand. So after opening Visual Studio is each morning for … 20 years, I haven't really opened it after that. I even removed it from the taskbar. And it started with the deliberate choice. There was nobody kind of pushing us to do this. We just wanted to test it out first. And it kind of kept rolling.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“So as I said, doing pull requests … not an ideal situation. So we want to remove ourselves from that step to make it fully autonomous. I do think maybe that we need another like Opus 4.5 moment that LLM's, there's a new version that just is better. … But there are a lot of changes that could go straight to test. Like the document search could have gone without us approving it. But … it kind of needs to build this track record of doing stuff right before we trust it. So we're not quite there yet. But I think it's a matter of time.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“Because before, you could probably argue that the coding part was the bottleneck in our kind of product lifecycle. But now … is doing all the coding. And when he took over the coding, we found that the requirement part, the first part, is the new bottleneck. Because me and …, we can be tied up in some prioritized work. And then a product owner creates a new feature or a feature request in an Epic in the boards. And we won't kind of look at that before some time has passed. And then we have some questions, clarifications. And the product owner might not even remember what she wanted the first place when she wrote it. And it becomes this async ping-pong where you kind of try to figure out what to do. And you're not able to begin the implementation.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“And then the self review, which is kind of interesting because we have this, we created this review pool. So we have one model, which is a Sonnet that does one review. … then we have kind of a … cheaper model that also does a review. And then we have the third model, … right now, it kind of consolidates this and verifies the findings in the reviews and decides if it should change something or not. And when this review pool is kind of finished and happy, … will assign it to a human.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner

“How do we dare to do this in a bank? Well, we have the rules built in, and he doesn't have access to the customer data … And then he really tried to get the customer data. He tried to look at the … infrastructure and construct the connection string and all that, but we don't have secrets in our connection strings … managed identity to connect to the database, and his service principal … not have access to the database, so he couldn't get any data.”

Hallstein BrøtanSenior consultant, Novanet; developer on Nordic Corporate Bank's system · Practitioner