Tactical advanced robotic engagement system
This invention describes a tactical advanced robotic engagement system (ARES) ( 100 ) for combat or rescue mission by employing advanced electronics, AI and AR capabilities. In ARES, a user carries a weapon or tool ( 102 ) equipped with a hand-operable controller ( 150 ) for controlling an associated UGV ( 170 ), UAV ( 180 ) or UUV. The UGV ( 170 ) provides a ground/home station for the UAV ( 180 ). The UGV, UAV is equipped with a camera ( 290 ) to obtain real-time photographs or videos and to relay them to a heads-up display (HUD) ( 110 ) mounted on the user's helmet ( 104 ). The HUD ( 110 ) system provides intuitive UIs ( 132 ) for communication and navigation of the UGV, UAV; AR information reduces visual cognitive and mental loads on the user, thereby enhancing situation awareness and allowing the user to maintain heads-up, eyes-out and hands-on trigger readiness. The HUD ( 110 ) also provides intuitive UIs to connect up with peers and/or a Command Centre ( 190 ).
1. A tactical advanced robotic engagement system (ARES) comprising:
a heads-up display (HUD) mounted on a helmet of a user, wherein the HUD comprises four multi-modal buttons located virtually on a user interface (UI), with the four multi-modal buttons being a manual, a voice, a gesture and a brain sensory sensor;
a one-hand-operable controller mountable on a weapon or tool carried by the user; and
an unmanned ground vehicle (UGV) and an associated unmanned aerial vehicle (UAV) or unmanned underwater vehicle (UUV);
wherein: the one-hand operable controller comprises switches to communicate with the UGV and/or UAV (or UUV), and operation of the ARES with the virtual, manual multi-modal button which is given command priority over the other three multi-modal buttons to execute autonomous control of the UGV and/or UAV or UUV reduces visual and mental cognitive loads on the user, enhances the user's situation awareness, enhances decision making with reduced risks, and allows the user to maintain mission-critical, time-critical or safety-critical readiness, thereby to achieve task effectiveness and mission success.
2. The tactical ARES according to claim 1 , wherein the one-hand-operable controller comprises a preset button for preset navigational control of the UGV, UAV or UUV and two buttons for programmable speed and directional control, with the two buttons being operable simultaneously for programmable hover control of the UAV or UUV, thereby providing quick response to effective navigation control to the user.
3. The tactical ARES according to claim 1 , wherein the one hand-operable controller further comprising a joystick for yaw and roll programmable control and homing of the UAV or UUV to the UGV, wherein homing allows the UAV to return and dock with the UGV for battery charging.
4. The tactical ARES according to claim 1 , wherein the one-hand-operable controller further comprises 3D sensors, with outputs of the 3D sensors for gesture control of the UGV and/or UAV or UUV by panning and tilting the one-hand-operable controller.
5. The tactical ARES according to claim 1 , further comprising a dead-reckoning algorithm and an AI algorithm, wherein the dead-reckoning algorithm allows the ARES to track and guide the user when GPS is ineffective in a built-up area, and the AI algorithm responds and allows inputs from various sensors deployed in the UGV, UAV or UUV to recommend execution of a strategy plan to reach a target area or object of interest with low risks and high effectiveness.
6. The tactical ARES according to claim 5 , wherein the dead-reckoning algorithm and AI algorithm functionalities are built into the HUD, UGV or a command centre.
7. The tactical ARES according to claim 5 , wherein the UGV, UAV and HUD have GPS sensors that provide positional nodes, so that locations on a GPS map can be determined with predetermined accuracies.
8. The tactical ARES according to claim 1 , wherein the HUD comprises a user health and electric power monitor to notify the user with alerts in order to achieve mission success or to reduce mission failure.
9. The tactical ARES according to claim 1 , further comprising a camera mounted on the UAV or UGV for taking photos or videos of a target area or object-of-interest, wherein the photos or videos are transmitted to the HUD or an associated command centre for stitching together to create a strategy map for mission planning.