DARPA Awards PARC Contract to Accelerate Learning of Complex Skillsets Through Artificial Intelligence and Augmented Reality

Rhea-AI Summary

PARC, a Xerox company, has secured a $5.8 million contract from DARPA to develop an AI system called AMIGOS, aimed at enhancing task execution through augmented reality (AR) guidance. This system will convert traditional manuals into interactive formats, allowing users to receive personalized instructions and feedback. PARC will lead the project in collaboration with the University of California, Rostock University, and Patched Reality. The initiative also aligns with Xerox's investments in AR technologies, reinforcing its strategic focus on innovative solutions in field service.

Positive

• Secured a $5.8 million contract with DARPA for the AMIGOS project.
• Project aims to enhance task execution through innovative AI and AR technologies.
• Focus on real-time feedback could improve operational efficiency in various fields.

Negative

• None.

AMIGOS program to enable real-time feedback and instructions for physical tasks.

PALO ALTO, Calif.--(BUSINESS WIRE)-- PARC, a Xerox company, announced today it has been awarded a $5.8 million contract by the Defense Advanced Research Projects Agency (DARPA) to work with the University of California at Santa Barbara, the University of Rostock and Patched Reality, an Augmented Reality company, to develop an Artificial Intelligence system that will guide users in complex physical tasks beyond their abilities. The system will convert text and video-based manuals to a format that can be processed by a computer and guide users to complete tasks using AR guidance while also monitoring task execution.

PARC will be the lead contractor on the project, known as “Autonomous Multimodal Ingestion for Goal-Oriented Support” (AMIGOS) for the Perceptually-enabled Task Guidance Program. The project will introduce new methods to extract procedural knowledge from content, perceive the environment, reason about physical tasks, and enable conversational and AR guidance that is personalized to an individual user’s level of expertise. The goal is to enable mechanics, medics and other specialists to perform tasks within and beyond their skillsets by providing just-in-time feedback and instructions for physical tasks.

“Augmented reality, computer vision, language processing, dialogue processing and reasoning are all AI technologies that have disrupted a variety of industries individually but never in such a coordinated and synergistic fashion,” said Dr. Charles Ortiz, the principal investigator for AMIGOS. “By leveraging existing instructional materials to create new AR guidance, the AMIGOS project stands to accelerate this movement, making real-time task guidance and feedback available on-demand.”

The project will deliver two major systems to DARPA. The first will be an offline component that can learn from multiple modalities, such as language and vision, to extract the steps from unlabeled content required to complete a task, including text instructions from manuals, illustrations and instructional videos. The second will be an online component that uses a hybrid AI approach combining both symbolic and neural AI elements to create interactive AR guidance based on the information extracted by the offline component. The guidance delivered by the system will be personalized to the individual user’s abilities and sensitive to the user’s emotional state during performance.

Xerox and PARC continue making substantial investments in AR-enabled field service. Earlier this year, Xerox announced the formation of its software business, CareAR, A Xerox Company, which consolidates CareAR, Inc., DocuShare® and XMPie under a single holding company named CareAR Holdings. The CareAR service experience platform supports service workforces with the visual tools and access to data that are needed to consistently deliver high-quality service experiences for service employees and end-customers, all while lowering the operating costs and greenhouse gas emissions of service providers. The expertise gained from the AMIGOS project will help inform future product development for CareAR.

About Xerox

For more than 100 years, Xerox has continually redefined the workplace experience. Harnessing our leadership position in office and production print technology, we’ve expanded into software and services to power today’s workforce. From the office to industrial environments, our differentiated business solutions and financial services are designed to make every day work better for clients — no matter where that work is being done. Today, Xerox scientists and engineers are continuing our legacy of innovation with disruptive technologies in digital transformation, augmented reality, robotic process automation, additive manufacturing, Industrial Internet of Things and cleantech. Learn more at xerox.com.

About PARC

Palo Alto Research Center Incorporated (PARC), A Xerox Company, is in the Business of Breakthroughs®. Practicing open innovation, it provides custom R&D services, technology, expertise, best practices and intellectual property to Fortune 500 and Global 1000 companies, startups, and government agencies and partners. The company creates new business options, accelerates time to market, augments internal capabilities and reduces risk for clients. Since its inception, PARC has pioneered many technology platforms – from the Ethernet and laser printing to the GUI and ubiquitous computing – and has enabled the creation of many industries. Incorporated as an independent, wholly owned subsidiary of Xerox in 2002, PARC today continues the research that enables breakthroughs for businesses.

Note: To receive RSS news feeds, visit https://www.news.xerox.com. For open commentary, industry perspectives and views, visit http://www.linkedin.com/company/xerox, http://twitter.com/xerox, http://www.facebook.com/XeroxCorp, https://www.instagram.com/xerox/, http://www.youtube.com/XeroxCorp.

Xerox^® is a trademark of Xerox in the United States and/or other countries.

View source version on businesswire.com: https://www.businesswire.com/news/home/20211216005308/en/

Media:

Justin Capella, +1-203-258-6535, justin.capella@xerox.com

Source: Xerox

FAQ

What is the AMIGOS project by Xerox and PARC?

The AMIGOS project is an AI system aimed at providing real-time guidance for complex physical tasks, utilizing augmented reality to improve user performance.

How much funding did Xerox receive for the AMIGOS project?

Xerox was awarded a $5.8 million contract for the AMIGOS project by DARPA.

Which organizations are collaborating on the AMIGOS project?

The project involves collaboration between PARC, the University of California, University of Rostock, and Patched Reality.

How does the AMIGOS project impact Xerox's business strategy?

The AMIGOS project aligns with Xerox's strategy to invest in augmented reality technologies and enhance capabilities in field service.

What benefits does the AMIGOS project offer to users?

The project offers personalized guidance and feedback, allowing users to perform tasks beyond their current skillsets effectively.