Why we no longer evaluate SWE-bench Verified

Published 2026-02-23T11:00:00Z33e5e5bcd68981ac4e0e6be6631a5152e2d6677fb396e0d2a31ce68e4b85f70f

Source metadata

Publication date
2026-02-23T11:00:00Z
Source identifier
https://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified
Public record ID
record:sha256:33e5e5bcd68981ac4e0e6be6631a5152e2d6677fb396e0d2a31ce68e4b85f70f

This is source-provided metadata, not an enriched summary or an impact assessment. Follow the canonical source link for the published material.

Evidence and limitations

Source ID
openai_research
Record identifier
33e5e5bcd68981ac4e0e6be6631a5152e2d6677fb396e0d2a31ce68e4b85f70f
Record type
Source metadata

This record may overlap with other records. Source metadata can be incomplete or change. Validate consequential decisions against the linked source and your own environment.