2024 → 2025
The origins of SWE-bench-Live
In 2024, Linghao Zhang, Yu Kang and Chaoyun Zhang came up with the initial idea of scaling the SWE dataset creation with an automatic GitHub issue&PR scraping pipeline.
If you refer to the SWE task creation pipeline of SWE-bench-Live, or SWE-bench-Live/SWE-bench-Live (Python only tasks), please cite
@article{zhang2025swebenchgoeslive,
title={SWE-bench Goes Live!},
author={Linghao Zhang and Shilin He and Chaoyun Zhang and Yu Kang and Bowen Li and Chengxing Xie and Junhao Wang and Maoquan Wang and Yufan Huang and Shengyu Fu and Elsie Nallipogu and Qingwei Lin and Yingnong Dang and Saravan Rajmohan and Dongmei Zhang},
journal={Advances in Neural Information Processing Systems},
volume={38},
year={2025}
}
2025 → 2026
RepoLaunch across languages and platforms
In 2025, Kenan Li, Rongzhi Li, Qirui Jin and Liao Zhu further extended the automatic dataset creation idea and proposed the ultimate RepoLaunch agent. RepoLaunch agent builds and tests code repositories across multiple programming languages and operating systems, which directly enables the automatic SWE dataset creation for multiple languages and platforms.
If you refer to the automated build and test tool RepoLaunch, SWE benchmarking/training/RFT/RL environment build, SWE-bench-Live/Multi-Language or SWE-bench-Live/Windows, please cite
@article{li2026repolaunch,
title={RepoLaunch: Automating Build and Management of Code Repositories across Languages and Platforms},
author={Kenan Li and Rongzhi Li and Linghao Zhang and Qirui Jin and Liao Zhu and Xiaosong Huang and Geng Zhang and Yikai Zhang and Shilin He and Chengxing Xie and Xin Zhang and Zijian Jin and Bowen Li and Chaoyun Zhang and Yu Kang and Yufan Huang and Elsie Nallipogu and Saravan Rajmohan and Qingwei Lin and Dongmei Zhang},
journal={arXiv preprint arXiv:2603.05026},
year={2026}
}