DARPA "PTG": AI that helps people perform complex physical tasks — a federal contract (USAspending)

The program here, PTG (Perceptually-enabled Task Guidance), aims to use AI to help people carry out multi-step physical tasks. Think of jobs like repairing equipment or administering first aid — work you do by watching the situation and proceeding one step at a time.

The key phrase is "perceptually-enabled." The idea is that the AI actually "sees" the worker's hands and surroundings through cameras and similar sensors, understands which step they are on, and advises on what to do next. Rather than reading out a fixed manual, it tailors its guidance to what is happening in front of it. That is a hard problem combining perception — understanding images and actions — with reasoning about procedures, and it fits DARPA's signature mission of creating capabilities that do not yet exist.

DARPA is the Pentagon's advanced research agency, known for seeding work that led to the internet and GPS. Task-guidance AI of this kind could reinforce domains that have long depended on human expertise, with potential reach beyond the military into civilian fields such as medicine and maintenance. Exactly which tasks are targeted, and to what level of accuracy, is not stated in the source, so we do not speculate.