Upcoming Workshop: Citizen Developer Agentic Software Factory on AWS 11.4.26 @ 12PM PST
Register Here!
How Claude Fable 5.1 did on iac-bench 2026-10: an overall composite of 86.9, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Claude Haiku 5.5 did on iac-bench 2026-10: an overall composite of 68.0, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Claude Opus 5.5 did on iac-bench 2026-10: an overall composite of 88.9, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Claude Sonnet 5.5 did on iac-bench 2026-10: an overall composite of 86.1, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How DeepSeek V4 Pro did on iac-bench 2026-10: an overall composite of 69.2, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Gemini 3.1 Pro did on iac-bench 2026-10: an overall composite of 73.0, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Gemini 3.6 Flash did on iac-bench 2026-10: an overall composite of 54.3, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How GPT-6 Astra did on iac-bench 2026-10: an overall composite of 86.7, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How GPT-6 Luna did on iac-bench 2026-10: an overall composite of 81.5, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How Kimi K3 did on iac-bench 2026-10: an overall composite of 82.4, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.
How the iac-bench 2026-10 results were produced: the briefs, the evaluation setup, mechanical scoring against real tofu plans, the calibrated LLM judge, statistics and limitations.
We asked ten language models to write reusable OpenTofu modules for AWS, GCP and Azure, then scored 90 modules against real plans and a calibrated judge. Here is how they did and the patterns behind the scores.
Reference for every criterion behind an iac-bench score: each rubric item, expertise item and judged doctrine section, with weights and how many attempts passed.