arXiv paper via the AlphaSignal daily · Published 2026-08-25

Why Agent Skills help: reusable steps still need adaptation

Skills turn prior execution experience into reusable procedures. The study separates having useful guidance, finding it and actually completing the task.

From experience to guidance
BitShovel diagram · based on the article’s sources. · Open full-size image

中文

Compare the same experience in different forms

Researchers compared no prior experience, cleaned workflow records and SKILL.md distilled from the same records. The experiments cover terminal and tool tasks using a limited set of Codex and Gemini CLI configurations.

The corpus contains 8,135 normalized trials. Taxonomy development retained 238 valid labels from 240 open-coded records, followed by paired-trajectory analysis. The reported 65.7% procedural anchoring and 4.5% knowledge injection describe mechanism analysis, not exhaustive human labeling of all trials. Matched success averaged 6.06 percentage points above Workflow Memory.

中文

Finding guidance does not finish the task

With candidate pools growing from 5 to 100, actual-use precision fell from 29.6% to 3.3%. This measures overlap with designated skills, not task success. Retrieval, explicit selection and real execution were independent experiments.

A practical implication is to describe applicability, essential steps and completion checks, then adapt them when the environment changes. This is our interpretation. Rigid commands or assumptions can still fail. The limited terminal-task settings and sampled taxonomy are not proof of universal gains across agents or open-ended collaboration.

Important additions and corrections

Dates below mark changes to our coverage.

  • Correction ·

    Clarified sampled taxonomy and paired analysis, and separated skill-use precision from task success.

Sources and notes

sources中文

Sources and notes

Retained summary and context

This is a study of limited models and terminal tasks, not proof of general gains for all agents. Mechanism labels use sampling and paired analysis; usage precision is not task success.

Sources and evidence · 2 links

Each link has a purpose and scope. Link counts do not establish independent confirmation; direct support applies only to the statements specified below.

Source timeline
  1. · Found this reading link via AlphaSignal daily.
Collection record

First discovered:

Collection and source publication have distinct dates.

Editorial record

Corrected

· Beijing time (UTC+8)

Clarified sampled taxonomy and paired analysis, and separated skill-use precision from task success. Event, discovery and collection dates remain unchanged.

Sources and full record

This dates our review of the wording and sources, not a project release or product update.

Full record: before, after and sources (JSON)

Corrections and feedback