DevelopmentSources: 1 source
IBM Research introduced ScarfBench benchmark
IBM Research has introduced ScarfBench, a specialised benchmark designed to evaluate autonomous AI agents on enterprise Java framework migration tasks, published via Hugging Face. The benchmark tests the capability of AI models and agentic workflows to refactor, upgrade, and modernise legacy enterprise codebases across complex Java application frameworks. Claims are as reported; this summary makes no determination about accuracy or significance.
- Low confidence
- Unconfirmed
- Product
- ScarfBench
- Availability
- Announced
- Organization
- IBM Research