Granted Patent B2

US 12,209,387 · App. 17/652,845 · Granted Jan 28, 2025

Inventors: Cameron Jensen (Shorewood, IL); Victor A. Simkus (Elgin, IL)

Assignee: Caterpillar Inc.

E02F9/205G01C3/10G05D1/0022G05D1/0038H04N7/183

Abstract

Claims (75)

1. A system for remote control of a machine, the system comprising:

a light source configured to emit a light beam;

a camera configured to obtain image data of an environment that includes the light beam and an object,

wherein the light beam is configured to provide a visual indication of a distance from the machine to the object; and

a controller configured to cause the image data to be provided to a remote control device that controls an operation of the machine,

wherein the image data is provided to cause the image data to be included in a video feed, of the environment, displayed by the remote control device,

wherein control of the operation of the machine, through the remote control device, is based, at least in part, on the light beam displayed in the video feed,

wherein a visual characteristic of the light beam, in the video feed, changes to indicate a change in the distance from the machine to the object,

wherein the light source is configured to cause the light beam to be projected onto a ground surface to indicate that the distance is a first distance,

wherein the light source is configured to cause the light beam to be projected onto a bottom portion of the object to indicate that the distance has decreased from the first distance to a second distance, and

wherein the light source is configured to cause the light beam to move toward a top portion of the object to indicate that the distance has decreased from the second distance to a third distance.

2. The system of claim 1 , wherein the object is a dump target,

wherein the remote control device controls an implement of the machine during a dumping operation involving the dump target, and

wherein the image data is provided to the remote control device to facilitate control of the implement during the dumping operation.

3. The system of claim 2 , wherein the light source is configured to cause the light beam, in the video feed, to provide an indication that the machine is located at a target distance from the dump target for performing the dumping operation,

wherein the light source is configured to cause the light beam to be projected onto a portion of the dump target when the machine is located at the target distance, and

wherein the light source is configured to cause the light beam to be projected onto a ground surface when the machine is located at a distance from the dump target that exceeds the target distance.

4. The system of claim 1 , wherein the light source includes a laser light source, and

wherein the light beam is a laser light beam.

5. The system of claim 1 , wherein the light source is a first light source and the light beam is a first light beam,

wherein the system further comprises a second light source configured to emit a second light beam and a third light source configured to emit a third light beam,

wherein the environment further comprises the second light beam and the third light beam, and

wherein the first light beam, the second light beam, and the third light beam are configured to provide visual indications, in the video feed, of the distance from the machine to a second object.

6. The system of claim 5 , wherein the first light source, the second light source, and the third light source are configured to cause an intersection of the first light beam, the second light beam, and the third light beam to indicate a target distance from the machine to the second object, and

wherein the first light beam, the second light beam, and the third light beam are parallel to a ground surface.

7. The system of claim 1 , wherein the light source includes an infrared light source,

wherein the light beam is an infrared light beam,

wherein the camera is configured to detect the infrared light beam, and

wherein the image data is augmented to include a visual representation, in the video feed, of the infrared light beam detected by the camera.

8. A machine, comprising:

an implement;

a light source configured to emit a light beam;

a camera configured to obtain image data of an environment that includes the light beam and a target object;

a wireless communication component configured to communicate with a remote control device that controls an operation of the machine; and

a controller configured to cause the wireless communication component to provide the image data to the remote control device,

wherein the image data is provided to cause the image data to be included in a video feed, of the environment, displayed by the remote control device,

wherein the light source is configured to cause the light beam, in the video feed, to provide a visual indication of a distance from the machine to the target object,

wherein control of the operation of the machine, through the remote control device, is based, at least in part, on the distance indicated by the light beam displayed in the video feed,

wherein the light source is configured to cause the light beam to be projected onto a ground surface to indicate that the distance is a first distance,

wherein the light source is configured to cause the light beam to be projected onto a first portion of the target object to indicate that the distance has changed from the first distance to a second distance, and

wherein the light source is configured to cause the light beam to move toward a second portion of the target object to indicate that the distance has changed from the second distance to a third distance.

9. The machine of claim 8 , wherein a visual characteristic of the light beam, in the video feed, changes to indicate a change in the distance from the machine to the target object.

10. The machine of claim 9 , wherein the visual characteristic of the light beam changes based on a velocity of the machine.

11. The machine of claim 8 , wherein the light source includes an infrared light source or a laser light source, and

wherein the light beam is an infrared light beam or a laser light beam.

12. The machine of claim 8 , wherein the light source is a first light source,

wherein the light beam is a first light beam,

wherein the machine further comprises a second light source configured to emit a second light beam and a third light source configured to emit a third light beam,

wherein the image data includes image data of the second light beam and the third light beam, and

wherein the first light beam, the second light beam, and the third light beam are configured to provide visual indications, in the video feed, of the distance from the machine to a second target object.

13. The machine of claim 12 , wherein the first light beam, the second light beam, and the third light beam are parallel to a ground surface,

wherein the first light beam, the second light beam, and the third light beam are projected onto the second target object,

wherein the second light beam is provided between the first light beam and the third light beam, and

wherein a distance between the first light beam and the second light beam decreases to indicate, in the video feed, that the machine is approaching the second target object.

14. The machine of claim 12 , wherein the first light source, the second light source, and the third light source are configured to cause an intersection of the first light beam, the second light beam, and the third light beam to indicate a second target distance from the machine to the second target object, and

wherein the first light source, the second light source, and the third light source are configured to cause the intersection to be located at a particular distance from a front portion of the implement.

15. A system, comprising:

a light source configured to emit a light beam;

a camera configured to obtain image data of an environment that includes the light beam and a target object; and

a wireless communication component configured to provide the image data to a remote control device that controls an operation of a machine,

wherein the image data is provided to cause the image data to be included in a video feed, of the environment, displayed by the remote control device, and

wherein the light source is configured to cause the light beam, in the video feed, to provide a visual indication of a distance from the machine to the target object

wherein the light source is configured to cause the light beam to be projected onto a ground surface to indicate that the distance is a first distance, and

wherein the light source is configured to cause the light beam to be projected onto a first portion of the target object to indicate that the distance has changed from the first distance to a second distance from the machine to the target object.

16. The system of claim 15 , wherein a visual characteristic of the light beam, in the video feed, changes to indicate a change in the distance from the machine to the target object, and

wherein the visual characteristic of the light beam changes based on a velocity of the machine.

17. The system of claim 15 , wherein the light source is a first light source and the light beam is a first light beam,

wherein the system further comprises a second light source configured to emit a second light beam and a third light source configured to emit a third light beam,

wherein the first light beam, the second light beam, and the third light beam are projected onto a second target object,

wherein the image data includes image data of the second light beam and the third light beam, and

wherein the first light beam, the second light beam, and the third light beam are configured to provide visual indications, in the video feed, of the distance from the machine to the second target object.

18. The system of claim 1 , wherein the light beam has at least one of a first size or a first shape when the machine is the first distance from the object, the first size or shape providing the visual indication of the first distance,

wherein the light beam has at least one of a second size or a second shape when the machine is the second distance from the object, the second size or shape providing the visual indication of the second distance.

19. The system of claim 18 , wherein the visual characteristic in the video feed that changes to indicate the change from the first distance to the second distance is at least one of a difference between the first and second sizes, or a difference between the first and second shapes.

20. The machine of claim 10 , wherein the visual characteristic of the light beam is at least one of a size or shape of the light beam, and wherein the size or shape of the light beam changes based on a velocity of the machine.

Assignments (1)

Continuity (1)

References Cited (19)