cs.SE cs.AI cs.HC

What coding agents actually read is not the technical docs — across 557 sessions and 3,033 documentation interactions, six in ten involve instruction files and working notes

cs.SE Zhijun Gao, Jing Chen Aug 2026

A behaviour-grounded study of which documents autonomous coding agents consult, when, and what follows, drawn from 557 agentic coding sessions and 33,097 agentic pull requests. Instruction files and working notes account for 60.5% of all documentation interactions, against 10.6% for classical technical documentation and 1.3% for API references.

Paper overview (our summary)

  • Field (arXiv category)cs.SE(+2)
  • AuthorsZhijun Gao, Jing Chen
  • Submitted2026-08-20
  • arXiv ID2608.20195v1

Key points

  • An empirical study of 557 agentic coding sessions (94,813 development events, 3,033 documentation interactions) and 33,097 agentic pull requests.
  • Instruction files and working notes make up 60.5% of documentation interactions, against 10.6% for classical technical documentation and 1.3% for API references.
  • The adjacent transition probability from consultation to editing is 0.002 and the unadjusted three-event lift is 1.05, so the link is not clean.
  • No explicit documentation-based validation sequence was observed, and consultation was associated with less immediate testing.
  • Consultation is self-initiated 70.2% of the time versus 7.5% failure-driven; in multi-commit PRs changing both, code is touched first 4.7 times more often.

1The readership changed; the writing did not

Technical documentation has been written for human developers. Yet the share of software changes actually authored by autonomous coding agents keeps rising.

Which documents do agents consult, when, and what happens next? This study answers from records rather than guesses, drawing on two public datasets: 557 agentic coding sessions (94,813 development events, of which 3,033 are documentation interactions) and 33,097 agentic pull requests (690,260 file-level change records).

2What is actually being read

Instruction files and working notes (agent-facing artefacts)60.5 / 100
Classical technical documentation10.6 / 100
API references1.3 / 100

Six in ten documentation interactions go not to documents written for a human reader but to the agent's own instruction files and working notes. Interactions with the API references teams have laboured over come to 1.3%. It is a figure that unsettles the premise of polishing technical documentation so that agents will read it.

3The read-then-write sequence is not observed

The link between consultation and editing also defies intuition. The probability that an edit immediately follows a consultation is 0.002, and the unadjusted three-event lift is 1.05. A stage-adjusted model puts it above unity, but this is far from a clean causal sequence. No explicit documentation-based validation sequence was observed at all, and consultation was associated with less immediate testing rather than more.

The trigger for consultation is mostly self-initiated (70.2%) rather than failure-driven (7.5%). Among multi-commit pull requests that change both code and documentation, code is touched first 4.7 times more often. Documentation trails code.

4Questioning the premise of agent-friendly documentation

From these traces the authors derive a descriptive model of agent-documentation interaction as a two-lobed cycle rather than a linear journey, and show that two widely assumed properties of agent-friendly documentation — actionability and verifiability — lack consistent behavioural support. Of the 1,900 arXiv papers this site holds as of 2026-09-02, 37 have cs.SE as their primary category.

Amid a field dominated by papers proposing models and methods, work that reads large volumes of real activity logs to test an existing premise stands out. This article is our own summary and does not warrant the correctness of the claims.

Why it matters

It tests from measurement the premise behind investing in existing technical documentation so agents will use it. Since what actually gets consulted is instruction files and working notes, designing the instruction files placed in a repository may carry more effect.

FAQ

Does this mean API references are unnecessary?
No. The study measured the distribution of agent interactions, not the value of the documents themselves. What they mean for human readers is a separate question.
What is agent-friendly documentation?
The idea that documentation should be actionable and verifiable so agents can work with it. The authors report that neither property has consistent behavioural support.

Sources (primary)

Source: arXiv (descriptive metadata is CC0 public domain). Summaries are our own; see arXiv for the original text and PDF.

#arXiv#Coding agents#Documentation#Software engineering#Empirical study
Disclaimer: This site independently summarizes and classifies information based on official data sources. Always verify the latest and accurate information with the official sources. Content on finance, health, legal, and security is information, not advice. This site is not an official website of the U.S. government.