SemaPLC: A Project-Grounded, Verification-Gated Agent Harness for PLC Code Generation
SemaPLC only marks PLC code generation done after external checks prove it compiles and runs.
The harness gates completion on logged verification of the spec, compilation, and behavior on a live PLC runtime. On 117 independent-POU tasks, it posted a 72.6% mean strict verified pass rate across seven models. On 65 project-context tasks, its biggest gain came from dynamic behavior: 52.2 versus baseline scores from 22.4 to 31.4. The paper argues executed traces are the faithful test for generated control logic, not static scoring. HF Daily Papers' note
The harness gates completion on logged verification of the spec, compilation, and behavior on a live PLC runtime. On 117 independent-POU tasks, it posted a 72.6% mean strict verified pass rate across seven models. On 65 project-context tasks, its biggest gain came from dynamic behavior: 52.2 versus baseline scores from 22.4 to 31.4. The paper argues executed traces are the faithful test for generated control logic, not static scoring. HF Daily Papers' note
score 4