Agent Skills use and failure modes · Records and changes

Agent Skills use and failure modes · Recorded by the site · 25 Aug 2026 · Earlier coverage

Demystifying agent skills: when they work, and until when

The paper runs controlled experiments plus paired trajectory analysis over 8,135 normalized trial records (238 valid open-coded labels) to answer when skills help, why they work, and where they fail. Skills mostly act as procedural anchors that stabilize noisy execution (65.7% of cases), beating Workflow Memory by 6.06 points in matched comparisons; cross-framework reuse and retrieval difficulty are the main failure modes.

Evidence is the authors' controlled benchmark study — not proof from our production re-test; the procedural-anchoring effect on benchmarks may not transfer to arbitrary private workflows.