Systems and methods for remotely controlling locomotives with gestures
Exemplary embodiments are disclosed of systems and methods for remotely controlling locomotives with gestures. In an exemplary embodiment, a system is configured for allowing an operator(s) to remotely control operation of a locomotive with gesture(s) made by an operator(s). The system includes at least one processor configured to be operable for visually recognizing gesture(s) made by an operator(s) in one or more images captured by at least one camera. A locomotive control unit is configured to be operable for controlling the operation of the locomotive according to the visually recognized gesture(s) made by the operator(s).
1 . A system comprising a locomotive control unit configured to be operable for controlling operation of a locomotive according to a gesture(s) made by an operator(s) and visually recognized, via at least one processor, in one or more images captured by at least one camera, wherein:
the at least one camera, the at least one processor, and the locomotive control unit are onboard the locomotive thereby providing an onboard system configuration for gesture-based control that is fully contained onboard the locomotive; and/or
the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, and decelerating.
2 . The system of claim 1 , wherein the at least one processor is in communication with the locomotive control unit via a communication link.
3 . The system of claim 1 , wherein the at least one processor comprises an edge processing device and/or a neural network.
4 . The system of claim 1 , wherein the at least one processor comprises an edge processing device running a single shot detector (SSD) neural network.
5 . The system of claim 1 , wherein:
the at least one processor is in communication via a serial connection with the locomotive control unit;
the at least one processor is configured to be operable for relaying one or more decisions, commands, and/or instructions to the locomotive control unit over the serial connection based on the visually recognized gesture(s); and
the locomotive control unit is configured to be operable for controlling operation of the locomotive according to the one or more decisions, commands, and/or instructions relayed to the locomotive control unit from the at least one processor over the serial connection.
6 . The system of claim 1 , wherein the locomotive control unit is configured to be operable for controlling operation of the locomotive in accordance with an algorithm(s) associated with or allocated to the visually recognized gesture(s).
7 . The system of claim 1 , wherein:
the system includes the at least one camera comprising at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s); and
the locomotive control unit is configured to be operable for controlling operation of the locomotive according to the gesture(s) made by the operator(s) and visually recognized, via the at least one processor, in the video captured by the at least one video camera.
8 . The system of claim 1 , wherein:
the system includes the at least one camera comprising at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s);
the locomotive control unit integrally includes the at least one processor; and
the at least one processor integrally included within the locomotive control unit is configured to be operable for analyzing a video feed of the operator(s) captured by the at least one video camera and visually recognizing the gesture(s) made by the operator(s) in the video feed captured by the at least one video camera.
9 . The system of claim 1 , wherein the at least one processor is configured to be operable for visually recognizing gesture(s) made by the operator(s) including one or more of an operator's hand signal(s), body language, and/or pose(s).
10 . The system of claim 1 , wherein:
the locomotive control unit integrally includes the at least one processor that is operable for visually recognizing the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera, whereby the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, decelerating, light(s), and audible alert(s); and
an entirety of the system including the at least one camera, the locomotive control unit, and the at least one processor integrally included within the locomotive control unit are onboard the locomotive thereby providing an onboard system configuration for gesture-based control that is fully contained onboard the locomotive.
11 . The system of claim 10 , wherein the at least one processor integrally included within the locomotive control unit comprises an edge processing device and/or a neural network.
12 . The system of claim 10 , wherein the at least one processor integrally included within the locomotive unit comprises an edge processing device running a single shot detector (SSD) neural network.
13 . The system of claim 10 , wherein the at least one processor integrally included within the locomotive unit includes artificial intelligence operable for visually recognizing the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.
14 . A method comprising controlling operation of a locomotive, via a locomotive control unit, according to a gesture(s) made by an operator(s) and visually recognized, via at least one processor, in one or more images captured by at least one camera, wherein:
the at least one camera, the at least one processor, and the locomotive control unit are onboard the locomotive thereby providing an onboard system configuration for gesture-based control that is fully contained onboard the locomotive; and/or
the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, and decelerating.
15 . The method of claim 14 , wherein:
the at least one processor is in communication via a serial connection with the locomotive control unit;
the method includes
relaying one or more decisions, commands, and/or instructions based on the visually recognized gesture(s) from the at least one processor over the serial connection to the locomotive control unit; and
controlling operation of the locomotive, via the locomotive control unit, according to the one or more decisions, commands, and/or instructions relayed to the locomotive control unit from the at least one processor over the serial connection.
16 . The method of claim 14 , wherein the method includes controlling operation of the locomotive, via the locomotive control unit, in accordance with an algorithm(s) associated with or allocated to the visually recognized gesture(s).
17 . The method of claim 14 , wherein:
the at least one camera comprises at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s);
the locomotive control unit integrally includes the at least one processor; and
the method includes:
capturing, via the at least one video camera, video of the gesture(s) made by the operator(s); and
visually recognizing, via the at least one processor of the locomotive control unit, the gesture(s) made by the operator(s) in the video captured by the at least one video camera.
18 . The method of claim 14 , wherein the visually recognized gesture(s) made by the operator(s) comprise one or more of an operator's hand signal(s), body language, and/or pose(s).
19 . The method of claim 14 , wherein:
the locomotive control unit integrally includes at least one processor operable for visually recognizing the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera, whereby the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, decelerating, light(s), and audible alert(s); and
the at least one camera, the locomotive control unit, the at least one processor integrally included within the locomotive control unit are onboard the locomotive thereby providing an onboard system configuration for gesture-based control that is fully contained onboard the locomotive.
20 . A system for remotely controlling operation of a locomotive with a gesture(s) made by an operator(s), the system comprising a locomotive control unit configured to be operable for controlling operation of the locomotive according to a gesture(s) made by an operator(s) and visually recognized in one or more images captured by at least one camera, wherein:
the at least one camera and the locomotive control unit are onboard the locomotive thereby providing an onboard system configuration for gesture-based control that is fully contained onboard the locomotive; and/or
the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, and decelerating.
21 . The system of claim 20 , wherein:
the system includes the at least one camera comprising at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s); and
the locomotive control unit integrally includes at least one processor configured to be operable for analyzing a video feed of the operator(s) captured by the at least one video camera and visually recognizing the gesture(s) made by the operator(s) in the video feed captured by the at least one video camera.
22 . The system of claim 20 , wherein:
the system is configured for allowing the operator(s) to remotely control operation of the locomotive with gesture(s) made by the operator(s) including starting, stopping, accelerating, decelerating, light(s), and audible alert(s); and
an entirety of the system including the at least one camera, the locomotive control unit, and the at least one processor integrally included within the locomotive control unit are onboard the locomotive thereby providing the onboard system configuration for gesture-based control that is fully contained onboard the locomotive.
23 . The system of claim 22 , wherein the locomotive control unit integrally includes at least one processor operable for visually recognizing the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.
24 . The system of claim 22 , wherein the system includes an edge processing device running a single shot detector (SSD) neural network that is operable for visually recognizing the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.