IP Library Granted Patent US 11,977,378
Granted Patent B2
US 11,977,378 · App. 16/572,012 · Granted May 7, 2024

Virtual path guidance system

Inventors: Victor D. Cámara Puerto (Stillwater, OK); Benjamin Ryan Travers (Argyle, TX)
Assignee: The Charles Machine Works, Inc.
G05D1/0038E02F5/06E02F5/145G05D1/0088G05D1/0212G05D1/0231G05D1/0278G06V20/588
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,977,378
App. No.
16/572,012
Granted
May 7, 2024
Kind
B2
Abstract

A guidance system for remotely guiding a work machine along a virtual path. The system uses a vision system to capture image data representative of areas surrounding the work machine. The image data is used to produce a spatial map. Analysis of image data allows the work machine's then-current position to be represented on the spatial map. A virtual path extending from the work machine's position is next added to the spatial map. The virtual path may be generated in response to external input provided at the display showing an image of the spatial map. Using continuously-updated image data, the work machine is driven toward the virtual path. During operation, the actual path of the work machine is compared to the virtual path. If any deviation between the paths is detected, the trajectory of the work machine is automatically adjusted.

Claims (29)

1. A method, comprising: capturing image data representative of one or more scenes in the vicinity of a self-propelled work machine; locating the work machine in relation to the imaged vicinity; receiving data about a virtual path for the work machine, the virtual path originating at the machine's then-current location; generating the virtual path within the captured image data using the received data; driving the work machine along an actual path; and comparing the actual path of the driven work machine to the virtual path; and as the work machine is driving along the actual path, adjusting the trajectory of the work machine in response to any deviation of the actual path from the virtual path.

2. The method of claim 1 in which the trajectory of the work machine is automatically adjusted.

3. The method of claim 1 , further comprising:

modifying an untraversed portion of the virtual path after the work machine begins traversing its actual path.

4. The method of claim 1 , further comprising:

juxtaposing representations of the virtual path and the imaged vicinity on a display.

5. The method of claim 4 , further comprising:

updating the juxtaposed representations of the virtual path and the imaged vicinity on the display as the work machine is driven along the actual path.

6. The method of claim 1 , further comprising:

touching a display; and

in which the received data is provided by a user's touching of the display.

7. The method of claim 1 , further comprising:

engaging a work tool with a ground surface as the work machine is driven along the actual path.

8. The method of claim 1 , further comprising:

creating a three-dimensional map of the imaged vicinity.

9. The method of claim 8 in which creating step uses structure-from-motion software.

10. The method of claim 1 in which the capturing step uses a camera.

11. The method of claim 1 in which the capturing step uses a 3D sensor.

12. The method of claim 1 in which the comparing step uses GPS measurements associated with points along the actual path.

13. The method of claim 1 in which the actual path is compared to the virtual path without the use of a georeferenced map.

14. The method of claim 1 , further comprising:

measuring an acceleration rate and angular position of the work machine relative to a ground surface as the work machine is driven along the actual path.

15. The method of claim 1 , in which the received data comprises a plurality of waypoints identified within the captured image data by external input.

16. The method of claim 15 , further comprising:

assigning projected GPS coordinates to each of the plurality of waypoints; and

displaying the virtual path on an aerial map.

17. A method, comprising: capturing image data representative of one or more scenes in the vicinity of a self-propelled work machine; locating the work machine in relation to the imaged vicinity; receiving data about a virtual path for the work machine, the virtual path originating at the machine's then-current location; generating the virtual path within the captured image data using the received data; driving the work machine along an actual path; comparing the actual path of the driven work machine to the virtual path; and modifying an untraversed portion of the virtual path after the work machine begins traversing its actual path.

18. A method, comprising: capturing image data representative of one or more scenes in the vicinity of a self-propelled work machine; creating a three-dimensional map of the imaged vicinity; locating the work machine in relation to the imaged vicinity; receiving data about a virtual path for the work machine, the virtual path originating at the machine's then-current location; generating the virtual path within the captured image data using the received data; driving the work machine along an actual path; and comparing the actual path of the driven work machine to the virtual path.

19. The method of claim 18 in which the creating step uses structure-from-motion software.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: SUBSITE, LLC
To: THE CHARLES MACHINE WORKS, INC.
Reel/Frame 060325/0330 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2019
From: CÁMARA PUERTO, VICTOR D.; TRAVERS, BENJAMIN RYAN
To: SUBSITE, LLC
Reel/Frame 050805/0183 →
Continuity (2)
Provisional Application 62732027 · Sep 17, 2018
Related Publication 20200089222A1 · Mar 19, 2020