


Project Summary
The technology developed as part of this project helps to address the lack of qualified maintainers by providing a wearable, intelligent, multi-mode assistant to guide maintainers through tasks.
This technology could also be applied more broadly to teach medics new procedures or walk them through semi-familiar procedures, assist pilots with flight tasks, and teach operators how to skillfully operate new technology such as weapons.


Ongoing work as part of multiple AFRL and DARPA (2019 – present) projects. Technology applications fall under the intelligent assistance category for various human-operator aided activities.
Project Details
- Intuitively guides human user through procedure, providing just-in-time guidance when a mistake is detected or the user asks for help.
- Guidance is user-tailored based on the user's skill level and associated need for more or less detailed guidance.
- Able to reason about the objects, activities, sounds, and spatial and temporal relationships within the task environment to determine the procedure that is being completed.

The assistant is trained for military-specific multi-step tasks and provides relevant just-in-time guidance.
Intelligent assistants can address the lack of qualified maintainers, medics, general technology operators and more.


The intelligent assistant tailors guidance provided to the specific human user. The agent learns to think like the human user to provide optimal just-in-time guidance.