IP Library › Granted Patent US 11,854,309
Granted Patent B2
US 11,854,309 · App. 17/959,159 · Granted Dec 26, 2023

Systems and methods for remotely controlling locomotives with gestures

Inventors: Jeremy Jovenall (Mercer, PA); Brian Fette (Canfield, OH); Ryan Wooten (Strongsville, OH); Ronald Timothy Bailey, Jr. (Newton Falls, OH)
Assignee: Cattron North America, Inc.
G06V40/28B61L3/065G06F3/017G06V10/82G06V20/56G06V40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,854,309
App. No.
17/959,159
Granted
Dec 26, 2023
Kind
B2
Abstract

Exemplary embodiments are disclosed of systems and methods for remotely controlling locomotives with gestures. In an exemplary embodiment, a system is configured for allowing an operator(s) to remotely control operation of a locomotive with gesture(s) made by an operator(s). The system includes at least one processor configured to be operable for visually recognizing gesture(s) made by an operator(s) in one or more images captured by at least one camera. A locomotive control unit is configured to be operable for controlling the operation of the locomotive according to the visually recognized gesture(s) made by the operator(s).

Claims (41)

1. A system configured for allowing an operator(s) to remotely control operation of a locomotive with gesture(s) made by an operator(s), the system comprising:

at least one processor configured to be operable for visually recognizing gesture(s) made by an operator(s) in one or more images captured by at least one camera; and

a locomotive control unit configured to be operable for controlling the operation of the locomotive according to the visually recognized gesture(s) made by the operator(s).

2. The system of claim 1 , wherein the at least one processor comprises an edge processing device.

3. The system of claim 1 , wherein the at least one processor comprises a neural network.

4. The system of claim 1 , wherein the at least one processor comprises an edge processing device running a single shot detector (SSD) neural network.

5. The system of claim 1 , wherein:

the at least one processor is in communication via a serial connection with the locomotive control unit; and

the at least one processor is configured to be operable for relaying one or more decisions, commands, and/or instructions to the locomotive control unit over the serial connection based on the visually recognized gesture(s).

6. The system of claim 5 , wherein the locomotive control unit is configured to be operable for controlling operation of the locomotive according to the one or more decisions, commands, and/or instructions relayed to the locomotive control unit from the at least one processor over the serial connection.

7. The system of claim 1 , wherein the locomotive control unit is configured to be operable for controlling operation of the locomotive in accordance with an algorithm(s) associated with or allocated to the visually recognized gesture(s).

8. The system of claim 1 , wherein the at least one camera, the at least one processor, and the locomotive control unit are onboard the locomotive.

9. The system of claim 1 , wherein:

the system includes the at least one camera comprising at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s); and

the at least one processor is configured to visually recognize the gesture(s) made by the operator(s) in the video captured by the at least one video camera.

10. The system of claim 1 , wherein the at least one processor is configured to be operable for visually recognizing gesture(s) made by the operator(s) including one or more of an operator's hand signal(s), body language, and/or pose(s).

11. A method of remotely controlling operation of a locomotive with gesture(s) made by an operator(s), the method comprising:

capturing, via at least one camera, one or more images of gesture(s) made by an operator(s);

visually recognizing, via at least one processor, the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera; and

controlling operation of the locomotive, via a locomotive control unit, according to the visually recognized gesture(s) made by the operator(s).

12. The method of claim 11 , wherein:

the at least one processor comprises an edge processing device; and

the method includes visually recognizing, via the edge processing device, the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.

13. The method of claim 11 , wherein:

the at least one processor comprises a neural network; and

the method includes visually recognizing, via the neural network, the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.

14. The method of claim 11 , wherein:

the at least one processor comprises an edge processing device running a single shot detector (SSD) neural network; and

the method includes visually recognizing, via the edge processing device running the single shot detector (SSD) neural network, the gesture(s) made by the operator(s) in the one or more images captured by the at least one camera.

15. The method of claim 11 , wherein:

the at least one processor is in communication via a serial connection with the locomotive control unit; and

the method includes relaying one or more decisions, commands, and/or instructions based on the visually recognized gesture(s) from the at least one processor over the serial connection to the locomotive control unit.

16. The method of claim 15 , wherein the method includes controlling operation of the locomotive, via the locomotive control unit, according to the one or more decisions, commands, and/or instructions relayed to the locomotive control unit from the at least one processor over the serial connection.

17. The method of claim 11 , wherein the method includes controlling operation of the locomotive, via the locomotive control unit, in accordance with an algorithm(s) associated with or allocated to the visually recognized gesture(s).

18. The method of claim 11 , wherein the at least one camera, the at least one processor, and the locomotive control unit are onboard the locomotive.

19. The method of claim 11 , wherein:

the at least one camera comprising at least one video camera onboard the locomotive for capturing video of the gesture(s) made by the operator(s); and

the method includes:

capturing, via the at least one video camera, video of the gesture(s) made by the operator(s); and

visually recognizing, via the at least one processor, the gesture(s) made by the operator(s) in the video captured by the at least one video camera.

20. The method of claim 11 , wherein the visually recognized gesture(s) made by the operator(s) comprise one or more of an operator's hand signal(s), body language, and/or pose(s).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2022
From: JOVENALL, JEREMY; FETTE, BRIAN; BAILEY, RONALD TIMOTHY, JR.; WOOTEN, RYAN
To: CATTRON NORTH AMERICA, INC.
Reel/Frame 061303/0825 →
Continuity (2)
Provisional Application 63273893 · Oct 30, 2021
Related Publication 20230137475A1 · May 4, 2023
Cited By (1)
US 12,462,612