DARPA "PTG": AI that helps people perform complex physical tasks — a federal contract (USAspending)

1AI helping with multi-step physical tasks

The program here, PTG (Perceptually-enabled Task Guidance), aims to use AI to help people carry out multi-step physical tasks. Think of jobs like repairing equipment or administering first aid — work you do by watching the situation and proceeding one step at a time.

2Why perceptually-enabled is the key phrase

The key phrase is "perceptually-enabled." The idea is that the AI actually "sees" the worker's hands and surroundings through cameras and similar sensors, understands which step they are on, and advises on what to do next. Rather than reading out a fixed manual, it tailors its guidance to what is happening in front of it.

That is a hard problem combining perception — understanding images and actions — with reasoning about procedures, and it fits DARPA's signature mission of creating capabilities that do not yet exist.

3Reinforcing work that depended on expertise

DARPA is the Pentagon's advanced research agency, known for seeding work that led to the internet and GPS. Task-guidance AI of this kind could reinforce domains that have long depended on human expertise, with potential reach beyond the military into civilian fields such as medicine and maintenance. Exactly which tasks are targeted, and to what level of accuracy, is not stated in the source, so we do not speculate.

4Reading out, or seeing and guiding

The phrase "perceptually-enabled" is what separates PTG from conventional task support.

The picture is clearest for work like repairing equipment or giving first aid, done step by step while checking with the eyes. It is a hard problem combining perceptual AI that understands images and motion with reasoning that assembles a procedure. Which tasks are covered, and what accuracy is sought, are not stated in the source.