Researchers from Edith Cowan University (ECU) have been awarded a $150,000 grant to work alongside leading artificial intelligence (AI) companies to design technology that teaches defence force robots to read hand gestures.
The project aims to replace remote controls with augmented reality (AR) glasses to operate unmanned machines with hand gestures.
Spearheaded by ECU’s Dr Syed Zulqarnain Gilani, the team will include developers from robotics company Chironix, Augmented Reality provider Agili8, Rugged Technology Manufacturer Motium and researchers, including a cognitive scientist and a cyber security expert from the University of Western Australia.
Dr Gilani said: “Optimising the present-day utility of robotics technology in the Australian Defence Force requires integrating robots into the human operating environment where they can be at least partially controlled by a human operator.”
Notably, the hand gestures will be recognised by a front-facing camera, installed within the AR glasses worn by the operator and will be transmitted over considerable distances to the robot.
#ECU Scientists will work alongside leading Artificial Intelligence #AI experts to develop technology that teaches robots to read hand gestures. The new technology is set to be used in the future by the Australian Defence Force #ADF https://t.co/xNIJumoyAd pic.twitter.com/tcoeILBMOp— Edith Cowan University (ECU) (@EdithCowanUni) September 1, 2022
Multi-disciplinary collaborators
Developing the eyes for the tech is Perth company Agili8, with its revolutionary XRAI Vision glasses which will transmit hand gestures from human to robot over large distances.
According to Agile8’s CTO Chris Markovic: “This use of AI and AR in the battlefield will improve responsiveness and reduce the cognitive load on the soldier and is only the beginning of the applications of this technology.”
Toughening it up is Perth-based company Motium, which is bringing its rugged hardware expertise from the mining industry to the table.
Motium business development manager Dieter von Mollendorf said: “We are proud to be working with an innovative team on some really cutting-edge development for our frontline soldiers,”
The developers claim that the technology is a natural progression in communication for soldiers on the frontline.
"There is a long pedigree of Australian soldiers using hand gestures to communicate silently with one another,” said Dr Owen Carter, the principal research fellow at Chironix Robotics.
“The last thing your average digger wants to do is stuff around with a robot remote control while getting shot at. Signalling to a robot with one hand while keeping your other hand firmly on your weapon is much preferred,” he said
Supporting these statements, Dr Zachary Howard, a cognitive scientist from the University of Western Australia, adds that the technology significantly improves the quality of user experience when integrating robots into traditionally human teams and has the potential to reduce the cognitive burdens associated with current control systems.