DARPA "PTG" AI assistant research (Technical Area 1) — a federal contract (USAspending)

DARPA, the Defense Advanced Research Projects Agency, is the U.S. Defense Department's research arm for nurturing high-risk, long-horizon technologies, and it has seeded many advances—from self-driving to speech recognition—that later spread into civilian use. The program behind this contract, PTG (Perceptually-enabled Task Guidance), aims at exactly what its name suggests: guiding a person through a task using machine perception. The idea is to have an AI take in video and audio from cameras and microphones, understand the scene, and tell the person in front of it what to do next—much like a skilled expert looking over your shoulder.

This contract covers Technical Area 1 of PTG, described as foundational knowledge for AI assistants. The source description does not spell out specific features or deliverables, so we will not speculate on them; what the "Technical Area 1" label signals is a focus on the underlying knowledge and models that let an assistant correctly understand procedures, objects, and situations, rather than a finished application. Splitting a program into parallel technical areas is characteristic of DARPA-style efforts, separating foundational research from applications so that results can be reused across the program.

Viewed more broadly, PTG sits where the recent wave of generative and multimodal AI (systems that handle video and language together) meets a concrete need: supporting hands-on work in fields like manufacturing, medicine, and maintenance. If an AI can perceive a complex, error-prone procedure and assist in real time, it could lower training costs and reduce mistakes. This contract reads as one example of public investment in building that foundation.