QEDCartographer: Automating Formal Verification Using Reward-Free Reinforcement Learning
Published in Proceedings of the IEEE/ACM International Conference on Software Engineering (ICSE), 2025
QEDCartographer is an automated proof-synthesis tool that combines supervised and reinforcement learning to explore the proof space for Coq theorems. By incorporating proofs' branching structure and enabling reward-free search, it overcomes the sparse-reward problem in formal verification and proves 21.4% of CoqGym benchmark theorems — outperforming all prior single-tool approaches.
Recommended citation: Sanchez-Stern, A., Varghese, A., Kaufman, Z., Zhang, D., Ringer, T., & Brun, Y. (2025). "QEDCartographer: Automating Formal Verification Using Reward-Free Reinforcement Learning." Proceedings of ICSE 2025. Ottawa, Ontario, Canada.
Download Paper
