IP Library Granted Patent US 10,984,004
Granted Patent B2
US 10,984,004 · App. 16/244,679 · Granted Apr 20, 2021

Systems and methods for predictive augmentation of vehicle service procedures

Inventors: Patrick S. Merg (Hollister, CA); Jacob G. Foreman (Hollister, CA); Todd Mercer (Descanso, CA)
Assignee: Snap-on Incorporated
G06F16/24575G06F16/248G06F16/738G06F16/783G06Q10/06G06Q10/20G07C5/008G07C5/0808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,004
App. No.
16/244,679
Granted
Apr 20, 2021
Kind
B2
Abstract

An example method includes receiving a first service procedure including a plurality of procedural steps for servicing a vehicle, identifying at least one procedural step of the plurality of procedural steps to supplement with supplemental service information, receiving information about vehicles sharing one or more attributes with the vehicle, determining at least one piece of supplemental service information to supplement the at least one identified procedural step, and providing a supplemented service procedure comprising the first service procedure with the at least one piece of supplemental service information included with the at least one identified procedural step.

Claims (63)

1. A method comprising:

receiving, from a first data source that includes computer-readable service procedures, a first service procedure including a plurality of procedural steps for servicing a vehicle;

identifying a procedural step of the plurality of procedural steps to supplement with supplemental service information;

receiving, from a second data source that includes computer-readable vehicle information, information about vehicles sharing one or more attributes with the vehicle;

determining, based on the received information, a piece of supplemental service information to supplement the identified procedural step;

receiving image data captured by a camera, wherein the captured image data shows the vehicle during performance of the first service procedure;

detecting, by processing the captured image data showing the vehicle during performance of the first service procedure, an occurrence of a trigger event associated with performance of the identified procedural step of the first service procedure; and

in response to detecting the occurrence of the trigger event, providing the piece of supplemental service information for presentation on a display during performance of the identified procedural step of the first service procedure.

2. The method of claim 1 , wherein the image data comprises video data received from the camera.

3. The method of claim 2 , wherein the piece of supplemental service information is overlaid onto the video data as part of an augmented reality (AR) presentation.

4. The method of claim 2 , wherein the display is a portable display device which includes the camera.

5. The method of claim 4 , wherein the portable display device is a head-mountable device (HMD).

6. The method of claim 1 , wherein the trigger event comprises a technician action associated with the identified procedural step of the first service procedure.

7. The method of claim 1 , further comprising providing a representation of the identified procedural step for presentation on the display in response to detecting the trigger event.

8. The method of claim 1 ,

wherein identifying the procedural step to supplement with supplemental service information comprises identifying a vehicle component involved in the procedural step, and

wherein the piece of supplemental service information comprises a metric associated with the vehicle component.

9. The method of claim 8 , further comprising:

determining that the procedural step involves application of torque to at least one fastener of the vehicle component, and

wherein the metric associated with the vehicle component comprises at least one of a torque specification or a torque pattern for the at least one fastener of the vehicle component.

10. The method of claim 1 ,

wherein the procedural step comprises a direction to add a fluid to one of a vehicle component or a vehicle system, and

wherein the piece of supplemental service information comprises at least one of a fluid capacity and fluid specifications of the one of the vehicle component or the vehicle system.

11. The method of claim 1 ,

wherein identifying the procedural step to supplement with supplemental service information comprises identifying a vehicle component involved in the procedural step, and

wherein the piece of supplemental service information comprises a location in the vehicle of the vehicle component.

12. The method of claim 1 , further comprising:

receiving usage information indicating a usage history of the vehicle; and

determining the piece of supplemental service information based at least in part on the usage information.

13. The method of claim 12 , further comprising:

identifying, based on the received usage information, at least one proximate vehicle component for inspection, wherein the at least one proximate vehicle component is proximate to a vehicle component involved in the first service procedure, and

wherein the piece of supplemental service information includes a notification to inspect the at least one proximate vehicle component.

14. The method of claim 13 , further comprising:

receiving data indicative of a mileage limit for the at least one proximate vehicle component; and

identifying the at least one proximate vehicle component for inspection based on the received usage information indicating a current vehicle mileage within a threshold amount of the mileage limit for the at least one proximate vehicle component.

15. The method of claim 1 , further comprising:

receiving prior service information indicating a prior service history of the vehicle; and

determining the piece of supplemental service information based at least in part on the prior service information.

16. The method of claim 1 , further comprising:

receiving at least one signal indicating an availability of at least one vehicle part to be used in performance of the first service procedure, and

wherein the piece of supplemental service information includes an indication of the availability.

17. The method of claim 1 , further comprising:

receiving a signal indicating a customer approval of the procedural step, and

wherein the piece of supplemental service information includes an indication of the customer approval of the procedural step.

18. A computing device, comprising:

one or more processors; and

a non-transitory computer-readable data storage device storing computer-readable program instructions, wherein the computer-readable program instructions are executable by the one or more processors to:

receive, from a first data source that includes computer-readable service procedures, a first service procedure including a plurality of procedural steps for servicing a vehicle;

identify a procedural step of the plurality of procedural steps to supplement with supplemental service information;

receive, from a second data source that includes computer-readable vehicle information, information about vehicles sharing one or more attributes with the vehicle;

determine, based on the received information, a piece of supplemental service information to supplement the identified procedural step;

receive image data captured by a camera, wherein the captured image data shows the vehicle during performance of the first service procedure;

detect, by processing the captured image data showing the vehicle during performance of the first service procedure, an occurrence of a trigger event associated with performance of the identified procedural step of the first service procedure; and

in response to detecting the occurrence of the trigger event, provide the piece of supplemental service information for presentation on a display during performance of the identified procedural step of the first service procedure.

19. The computing device of claim 18 , wherein the computing device includes the display and the camera, wherein the image data comprises video data received from the camera, and wherein the program instructions are executable by the one or more processors to virtually overlay the piece of supplemental service information onto the video data which is displayed on the display.

20. A non-transitory computer-readable medium having stored therein instructions, that when executed by a computing device, cause the computing device to perform functions comprising:

receiving, from a first data source that includes computer-readable service procedures, a first service procedure including a plurality of procedural steps for servicing a vehicle;

identifying a procedural step of the plurality of procedural steps to supplement with supplemental service information;

receiving, from a second data source that includes computer-readable vehicle information, information about vehicles sharing one or more attributes with the vehicle;

determining, based on the received information, a piece of supplemental service information to supplement the identified procedural step;

receiving image data captured by a camera, wherein the captured image data shows the vehicle during performance of the first service procedure;

detecting, by processing the captured image data showing the vehicle during performance of the first service procedure, an occurrence of a trigger event associated with performance of the identified procedural step of the first service procedure; and

in response to detecting the occurrence of the trigger event, providing the piece of supplemental service information for presentation on a display during performance of the identified procedural step of the first service procedure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2019
From: MERG, PATRICK S.; FOREMAN, JACOB G.; MERCER, TODD
To: SNAP-ON INCORPORATED
Reel/Frame 047957/0706 →
Continuity (2)
Continuation 14812941 · Jul 29, 2015
Related Publication 20190146973A1 · May 16, 2019
Cited By (1)
US 12,229,149