EMPIRICAL TELEMETRY

AI Model Benchmarks

Compare AI model success rates across 5 production coding tasks before and after applying Chemical X standards.

REPRODUCIBLE AI BENCHMARKS

Empirical Agent Benchmarks: Monolith vs Chemical X

Evaluated across Claude 3.7 Sonnet, Gemini 2.5 Pro, GPT-4o, and Grok-2. We pitted the 2,700-line monolith against modular Chemical X capsules across 5 real-world coding agent tasks.

The 5 Evaluation Tasks:
Task Specification Breakdown

Task A: URL Param Filter Persistence

benchmarks repo

Objective: Synchronize category filter bidirectionally with URL search parameters on reload without infinite re-render cycles.

Monolith Baseline38%

Monolith trapped in infinite URL pushState loops during reactive hydration.

Chemical X Architecture100%

Surgical patch applied cleanly in isolated molecule under 100 lines. Zero regressions.

Run AST Context Hazard Auditnpm run audit
npm run audit -- --json

Static AST linter scans every AST node for Line Budget violations (>500 lines), Hook Saturation (>5 hooks/scope), and un-factored ternaries.