IP Library Granted Patent US 10,249,060
Granted Patent B2
US 10,249,060 · App. 15/378,965 · Granted Apr 2, 2019

Tool erosion detecting system using augmented reality

Inventors: James Edward Wagner (Chillicothe, IL); Patrick Simon Campomanes (Washington, IL); Brian Charles Brown (Woodhull, IL); Drew Steven Solorio (Elmwood, IL); John M. Plouzek (Peoria, IL); David Jason Mcintyre (Chillicothe, IL); Paul Davis Jackson, Jr. (Peoria, IL); Phillip John Kunz (Morton, IL); Thomas Marshall Congdon (Dunlap, IL); Shadi Naji Kfouf (Peoria, IL)
Assignee: Caterpillar Inc.
G06T11/00E02F9/26H04N5/23293H04N7/183G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,249,060
App. No.
15/378,965
Granted
Apr 2, 2019
Kind
B2
Abstract

A tool erosion detecting system for a machine having a ground engaging tool is disclosed. The tool erosion detecting system may include a camera configured to generate a first image of the ground engaging tool on a display device, an input device configured to receive a user input, and a controller in communication with the camera and the input device. The controller may be configured to generate an augmented reality view of the ground engaging tool. The augmented reality view may include the first image of the ground engaging tool generated by the camera and a second image of a ground engaging tool superimposed on the first image and being associated with a selected wear level, wherein the selected wear level is based on the user input.

Claims (39)

1. A tool tip erosion detecting system for a machine having a ground engaging tool tip, comprising:

a camera configured to generate a first image of the ground engaging tool tip on a display device;

an input device configured to receive a user input; and

a controller in communication with the camera and the input device and being configured to generate an augmented reality view of the ground engaging tool tip, the augmented reality view including:

the first image of the ground engaging tool tip generated by the camera; and

a second image of a ground engaging tool tip superimposed on the first image and being associated with a selected wear level, wherein the selected wear level is based on the user input.

2. The tool tip erosion detecting system of claim 1 , wherein the first image of the ground engaging tool tip is one of a live video image and a captured still image.

3. The tool tip erosion detecting system of claim 1 , wherein the superimposed second image of a ground engaging tool tip includes a graphical single-side view of a ground engaging tool tip.

4. The tool tip erosion detecting system of claim 1 , wherein the superimposed second image of a ground engaging tool tip includes a graphical perspective view of a ground engaging tool tip.

5. The tool tip erosion detecting system of claim 4 , wherein an orientation of the graphical perspective view of a ground engaging tool tip is adjustable via the input device.

6. The tool tip erosion detecting system of claim 1 , wherein the controller is configured to generate a wear level indicator on the display device, the wear level indicator being indicative of the selected wear level.

7. The tool tip erosion detecting system of claim 6 , wherein the wear level indicator is a graphical object selectively movable via the input device.

8. The tool tip erosion detecting system of claim 1 , wherein the controller is configured to generate a scale on the display device, the scale being indicative of a physical dimension of the ground engaging tool tip.

9. The tool tip erosion detecting system of claim 1 , wherein the controller is configured to store image data associated with the augmented reality view.

10. The tool tip erosion detecting system of claim 9 , wherein:

the system further includes a communication device; and

the controller is configured to transmit the image data associated with the augmented reality view via the communication device.

11. A method of detecting tool erosion on a machine having a ground engaging tool tip, the method comprising:

generating a first image of the ground engaging tool tip, wherein the first image of the ground engaging tool tip is one of a live video image and a captured still image;

receiving a user input via an input device;

generating an augmented reality view of the ground engaging tool tip on a display device, the augmented reality view including the first image of the ground engaging tool tip; and

superimposing a second image of a ground engaging tool tip on the first image of the ground engaging tool tip, the superimposed second image being associated with a selected wear level, wherein the selected wear level is based on the user input.

12. The method of claim 11 , wherein the superimposed second image of a ground engaging tool tip includes one of a graphical single-side view of a ground engaging tool tip and a graphical perspective view of a ground engaging tool tip.

13. The method of claim 12 , further including adjusting an orientation of the graphical perspective view of a ground engaging tool tip in response to an input received via the input device.

14. The method of claim 11 , further including generating a wear level indicator on the display device, the wear level indicator being indicative of the selected wear level.

15. The method of claim 14 , further including repositioning the wear level indicator in response to an input received via the input device.

16. The method of claim 11 , further including generating a scale on the display device, the scale being indicative of a physical dimension of the ground engaging tool tip.

17. The method of claim 11 , further including storing image data associated with the augmented reality view.

18. The method of claim 17 , further including transmitting the image data associated with the augmented reality view via a communication device to an off-board computer.

19. A tool erosion detecting system for a machine having a ground engaging tool tip, comprising:

a camera configured to generate a first image of the ground engaging tool tip on a display device;

an input device configured to receive user input; and

a controller in communication with the camera and the input device and being configured to:

generate an augmented reality view of the ground engaging tool tip, the augmented reality view including:

the first image of the ground engaging tool tip generated by the camera, the first image including one of a live video image and a captured still image of the ground engaging tool tip; and

a second image of a ground engaging tool tip superimposed on the first image and being associated with a selected wear level, wherein:

the selected wear level is based on the user input; and

the second image includes one of a graphical single-side view of a ground engaging tool tip and a graphical perspective view of a ground engaging tool tip; and

generate a wear level indicator on the display device, the wear level indicator being indicative of the selected wear level.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE 5 AND 10 ASSIGNOR EXECUTION DATES PREVIOUSLY RECORDED AT REEL: 040736 FRAME: 0614. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 23, 2017
From: WAGNER, JAMES EDWARD; BROWN, BRIAN CHARLES; SOLORIO, DREW STEVEN; MCINTYRE, DAVID JASON; PLOUZEK, JOHN M.; JACKSON, PAUL DAVIS, JR.; CONGDON, THOMAS MARSHALL; KFOUF, SHADI NAJI; CAMPOMANES, PATRICK SIMON; KUNZ, PHILLIP JOHN
To: CATERPILLAR INC.
Reel/Frame 041786/0093 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2016
From: WAGNER, JAMES EDWARD; BROWN, BRIAN CHARLES; SOLORIO, DREW STEVEN; MCINTYRE, DAVID JASON; PLOUZEK, JOHN M.; JACKSON, PAUL DAVIS, JR.; KUNZ, PHILLIP JOHN; CONGDON, THOMAS MARSHALL; KFOUF, SHADI NAJI; CAMPOMANES, PATRICK SIMON
To: CATERPILLAR INC.
Reel/Frame 040736/0614 →
Continuity (1)
Related Publication 20180165884A1 · Jun 14, 2018
Cited By (3)
US 12,252,870 US 12,553,221 US 12,601,158