Nolan Lawson benchmarked 12 JavaScript frameworks by having Opus 5.5 build a Pokémon PokéAPI app five times each (three for Angular due to failures), measuring median cost, tokens, time, Lighthouse metrics, and lines of code. Hono+htmx was cheapest at $2.67 (4.26M tokens, 8.6 min), while Angular cost $4.97 (9.76M tokens, 17.2 min). SvelteKit ($4.28) and Gracile+Lit ($4.65) also ranked high, attributed to agents reading new migration guides or unfamiliar source. Astro, Nuxt, and Hono+htmx led in speed; Vanilla ($2.98) underperformed several frameworks. Lighthouse Performance and Accessibility scores saturated near 100, but JavaScript bytes transferred varied widely: Astro sent 0 KB, Hono+htmx 18 KB, SvelteKit 36 KB, Nuxt 84 KB, Angular 93 KB, and Next.js 142 KB. Total Blocking Time mirrored bundle size, with Astro, Gracile+Lit, and Hono+htmx at 0 ms versus Angular's 103 ms. LCP favored MPA architectures: Astro 810 ms, Hono+htmx 978 ms, while Next.js hit 2090 ms. Lines of code ranged from Hono+htmx's 1,370 to Angular's 2,009, impacting future maintenance token costs. MCP/skill usage was inconsistent across runs, reflecting LLM stochasticity. Lawson emphasizes evidence over vibes in framework selection for the agentic era.

Read original