“And that's why we have Cursor Bench. We have this private eval set that is mostly made up of things that happen in our code base, which is held out from the … So we ensure that the models aren't trained on it. And it's based on those real world engineering tasks.”
Context. Robinson has just said public benchmarks are an imperfect test of how models are used in practice, and is describing Cursor's private evaluation set for its own models.
Lee Robinson, Machine Learning Engineer, Model Behavior, Cursor. Works on the team that trains the Cursor models he describes, so he is close to the training process; Cursor sells AI coding tools and its own models, and the talk is promotional of its approach.
Cursor (Anysphere) sells AI or agent tools or services, so it has a reason to publish flattering numbers about AI. The passage stays in the archive; read it with that in mind.
How this was checked
Checked against the source by a first reader, then confirmed independently by a second reader who fetched the source without seeing the first reader's notes (Independent review agent (Claude Sonnet), blind second pass from passage text and citation only, no repository access, 2026-11-03).
Whisper at about 08:12-08:25 reads 'we have cursor bench… held out from the evals. So we ensure…'. Captions have 'Cursor Bench'. The passage's '…' covers 'evals.' and the capital letters follow the captions.
How to cite this passage
Lee Robinson (Cursor (Anysphere)), “Recursive Model Improvement”, AI Engineer (YouTube), 2026-07-15, at 8:12. https://www.youtube.com/watch?v=q4Tr-DknG2M Archived at https://the-ai-record.com/passages/cursor-bench-private-eval-own-codebase-2026
Checked against the source[ Grade B ]Said in the last yearCursor (Anysphere): $4 billion revenue, annualised, early June 2026Sells AI toolsPassage page
Checked against the source[ Grade B ]Said in the last yearCursor (Anysphere): $4 billion revenue, annualised, early June 2026Sells AI toolsPassage page
Checked against the source[ Grade B ]Said in the last yearCursor (Anysphere): $4 billion revenue, annualised, early June 2026Sells AI toolsPassage page
Checked against the source[ Grade B ]Said in the last yearCursor (Anysphere): $4 billion revenue, annualised, early June 2026Sells AI toolsPassage page