What coding agents actually read is not the technical docs — across 557 sessions and 3,033 documentation interactions, six in ten involve instruction files and working notes
A behaviour-grounded study of which documents autonomous coding agents consult, when, and what follows, drawn from 557 agentic coding sessions and 33,097 agentic pull requests. Instruction files and working notes account for 60.5% of all documentation interactions, against 10.6% for classical technical documentation and 1.3% for API references.
Paper overview (our summary)
- Field (arXiv category)cs.SE(+2)
- AuthorsZhijun Gao, Jing Chen
- Submitted2026-08-20
- arXiv ID2608.20195v1
Key points
- An empirical study of 557 agentic coding sessions (94,813 development events, 3,033 documentation interactions) and 33,097 agentic pull requests.
- Instruction files and working notes make up 60.5% of documentation interactions, against 10.6% for classical technical documentation and 1.3% for API references.
- The adjacent transition probability from consultation to editing is 0.002 and the unadjusted three-event lift is 1.05, so the link is not clean.
- No explicit documentation-based validation sequence was observed, and consultation was associated with less immediate testing.
- Consultation is self-initiated 70.2% of the time versus 7.5% failure-driven; in multi-commit PRs changing both, code is touched first 4.7 times more often.
1The readership changed; the writing did not
Technical documentation has been written for human developers. Yet the share of software changes actually authored by autonomous coding agents keeps rising.
Which documents do agents consult, when, and what happens next? This study answers from records rather than guesses, drawing on two public datasets: 557 agentic coding sessions (94,813 development events, of which 3,033 are documentation interactions) and 33,097 agentic pull requests (690,260 file-level change records).
2What is actually being read
Six in ten documentation interactions go not to documents written for a human reader but to the agent's own instruction files and working notes. Interactions with the API references teams have laboured over come to 1.3%. It is a figure that unsettles the premise of polishing technical documentation so that agents will read it.
3The read-then-write sequence is not observed
The link between consultation and editing also defies intuition. The probability that an edit immediately follows a consultation is 0.002, and the unadjusted three-event lift is 1.05. A stage-adjusted model puts it above unity, but this is far from a clean causal sequence. No explicit documentation-based validation sequence was observed at all, and consultation was associated with less immediate testing rather than more.
The trigger for consultation is mostly self-initiated (70.2%) rather than failure-driven (7.5%). Among multi-commit pull requests that change both code and documentation, code is touched first 4.7 times more often. Documentation trails code.
4Questioning the premise of agent-friendly documentation
From these traces the authors derive a descriptive model of agent-documentation interaction as a two-lobed cycle rather than a linear journey, and show that two widely assumed properties of agent-friendly documentation — actionability and verifiability — lack consistent behavioural support. Of the 1,900 arXiv papers this site holds as of 2026-09-02, 37 have cs.SE as their primary category.
Amid a field dominated by papers proposing models and methods, work that reads large volumes of real activity logs to test an existing premise stands out. This article is our own summary and does not warrant the correctness of the claims.
Why it matters
It tests from measurement the premise behind investing in existing technical documentation so agents will use it. Since what actually gets consulted is instruction files and working notes, designing the instruction files placed in a repository may carry more effect.
FAQ
Does this mean API references are unnecessary?
What is agent-friendly documentation?
Sources (primary)
Source: arXiv (descriptive metadata is CC0 public domain). Summaries are our own; see arXiv for the original text and PDF.
- arXiv abstract page (original, official)
- PDF (arXiv)
- arXiv ID: 2608.20195