Benchmarking and Evaluating LLMs for Constraint Modelling
Date:
I gave a talk in the CPAIOR 2026 masterclass on Large Language Models for Constraint Programming and Operations Research, organized by Tias Guns and Serdar Kadioglu. The talk focused on benchmarking and evaluating LLMs for constraint modelling, covering lessons learned so far on how well LLMs can formulate constraint programming models, and discussing related work on automated modelling.