IP Library Granted Patent US 12,190,358
Granted Patent B2
US 12,190,358 · App. 17/127,575 · Granted Jan 7, 2025

Systems and methods for automatically determining associations between damaged parts and repair estimate information during damage appraisal

Inventors: Jerry Gastineau (San Diego, CA); Niv Genchel (San Diego, CA); Julian Louis (San Diego, CA); Beau Sullivan (San Diego, CA)
Assignee: Mitchell International, Inc.
G06Q30/0278G06N3/04G06N3/08G06Q10/0875G06Q10/20G06Q30/018
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,358
App. No.
17/127,575
Granted
Jan 7, 2025
Kind
B2
Abstract

A method, non-transitory computer readable medium, and apparatus that improves automated damage appraisal includes analyzing one or more obtained images of property using a deep neural network with multiple hidden layers of units between an input and output and which has stored knowledge data encoded from one or more stored property damage images to identify the part of the vehicle that has sustained damage. Damage data on an extent of the damage in the identified part of the vehicle is determined using the deep neural network which has stored knowledge data encoded from one or more stored property damage images. The identified generic part of the vehicle is used to obtain a corresponding Part ID Code by using a parts dictionary. Part Qualifier information obtained using VIN information is then used in conjunction with the Part ID to obtain the OEM-specific part and then generate one or more repair lines for the repair estimate.

Claims (33)

1. A system for conducting an automatic appraisal of a vehicle damaged during an adverse incident, the system comprising:

a user computing device; and

an appraisal management computing apparatus comprising:

a processor; and

a memory storing computer-executable instructions that, when executed by the processor, cause the appraisal management computing apparatus to:

provide at least one damage evidence file for a damaged part of the vehicle as input to a deep neural network (DNN), wherein responsive to the input, the DNN generates output comprising a part code corresponding to the damaged part, wherein the DNN comprises multiple layers including an input layer, an output layer, and one or more hidden layers between the input layer and the output layer, and wherein the DNN is trained on historic damage data comprising a plurality of damage evidence files associated with corresponding damaged parts previously identified as damaged;

identify an Original Equipment Manufacturer (OEM) part number based on the part code and a vehicle identification number (VIN) associated with the vehicle; and

generate a repair estimate line comprising the OEM part number.

2. The system of claim 1 , wherein the output of the DNN comprises a repair operation for restoring the damaged part.

3. The system of claim 2 , wherein the repair estimate line comprises an OEM repair operation determined based on the repair operation identified by the output of the DNN.

4. The system of claim 3 , wherein the repair estimate line is incorporated into an automatic appraisal of damage to restoring the vehicle damaged during the adverse incident.

5. The system of claim 1 , wherein identifying the OEM part number comprises extracting data from the VIN.

6. The system of claim 1 , wherein identifying the OEM part number comprises using a parts dictionary configured to store associations between generic vehicle parts and OEM part numbers.

7. The system of claim 1 , wherein the at least one damage evidence file comprises at least an image file, a video file, a 3D scan file.

8. The system of claim 1 , wherein OEM part code and OEM repair operation are specific to individual automotive manufacturers.

9. A method for conducting an automatic appraisal of a vehicle damaged during an adverse incident, the method comprising:

providing, by a damage assessment computing apparatus, at least one damage evidence file for a damaged part of the vehicle as input to a deep neural network (DNN), wherein responsive to the input, the DNN generates output comprising a part code corresponding to the damaged part, wherein the DNN comprises multiple layers including an input layer, an output layer, and one or more hidden layers between the input layer and the output layer, and wherein the DNN is trained on historic damage data comprising a plurality of damage evidence files associated with corresponding damaged parts previously identified as damaged;

identifying, by the damage assessment computing apparatus, an Original Equipment Manufacturer (OEM) part number based on the part code and a vehicle identification number (VIN) associated with the vehicle; and

generating, by a repair estimate generating computing apparatus, a repair estimate line comprising the OEM part number.

10. The method of claim 9 , wherein the output of the DNN comprises a repair operation for restoring the damaged part.

11. The method of claim 10 , wherein the repair estimate line comprises an OEM repair operation determined based on the repair operation identified by the output of the DNN.

12. The method of claim 11 , wherein the repair estimate line is incorporated into an automatic appraisal of damage to restoring the vehicle damaged during the adverse incident.

13. The method of claim 9 , wherein identifying the OEM part number comprises extracting data from the VIN.

14. The method of claim 9 , wherein identifying the OEM part number comprises using a parts dictionary configured to store associations between generic vehicle parts and OEM part numbers.

15. The method of claim 9 , wherein responsive to a user selection of an individual evidence file associated with a damaged part, presenting one more vehicle parts determined to be related.

16. The method of claim 9 , wherein the at least one damage evidence file comprises at least an image file, a video file, a 3D scan file.

17. The method of claim 9 , wherein OEM part code and OEM repair operation are specific to individual automotive manufacturers.

18. One or more non-transitory machine-readable storage media encoded with instructions that, when executed by one or more hardware processors of a computing system, cause the computing system to perform operations for conducting an automatic appraisal of a vehicle damaged during an adverse incident, the operations comprising:

providing, by a damage assessment computing apparatus, at least one damage evidence file depicting a damaged part of the vehicle as input to a deep neural network (DNN), wherein responsive to the input, the DNN generates output comprising a part code corresponding to the damaged part, wherein the DNN comprises multiple layers including an input layer, an output layer, and one or more hidden layers between the input layer and the output layer, and wherein the DNN is trained on historic damage data comprising a plurality of damage evidence files associated with corresponding damaged parts previously identified as damaged;

identifying, by the damage assessment computing apparatus, an Original Equipment Manufacturer (OEM) part number based on the part code and a vehicle identification number (VIN) associated with the vehicle; and

generating, by a repair estimate generating computing apparatus, a repair estimate line comprising the OEM part number.

19. The one or more non-transitory machine-readable storage media of claim 18 , wherein the output of the DNN comprises a repair operation for restoring the damaged part.

20. The one or more non-transitory machine-readable storage media of claim 19 , wherein the repair estimate line comprises an OEM repair operation determined based on the repair operation identified by the output of the DNN.

Assignments (3)
SECOND LIEN SECURITY AGREEMENT Recorded Oct 18, 2021
From: MITCHELL INTERNATIONAL, INC.
To: GOLDMAN SACHS BANK USA
Reel/Frame 057842/0170 →
FIRST LIEN SECURITY AGREEMENT Recorded Oct 18, 2021
From: MITCHELL INTERNATIONAL, INC.
To: GOLDMAN SACHS BANK USA
Reel/Frame 058014/0629 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2021
From: GASTINEAU, JERRY; GENCHEL, NIV; LOUIS, JULIAN; SULLIVAN, BEAU
To: MITCHELL INTERNATIONAL, INC.
Reel/Frame 055040/0084 →
Continuity (3)
Continuation In Part 15421972 · Feb 1, 2017
Provisional Application 62289720 · Feb 1, 2016
Related Publication 20210150591A1 · May 20, 2021
References Cited (93)
US 4435769A · Nagano et al. · 1984 [cited by applicant]
US 5347656A · Fabritz et al. · 1994 [cited by applicant]
US 5395664A · Thompson, Jr. · 1995 [cited by applicant]
US 5432904A · Wong · 1995 [cited by applicant]
US 5504674A · Chen et al. · 1996 [cited by applicant]
US 5593225A · Safyan · 1997 [cited by applicant]
US 5809732A · Farmer, Sr. et al. · 1998 [cited by applicant]
US 5950169A · Borghesi et al. · 1999 [cited by applicant]
US 6047858A · Romer · 2000 [cited by applicant]
US 6107399A · Selley et al. · 2000 [cited by applicant]
US 6207094B1 · Farmer, Sr. et al. · 2001 [cited by applicant]
US 6381561B1 · Bomar, Jr. et al. · 2002 [cited by applicant]
US 6467299B1 · Coetzee · 2002 [cited by applicant]
US 6470303B2 · Kidd et al. · 2002 [cited by applicant]
US 6885981B2 · Bomar, Jr. et al. · 2005 [cited by applicant]
US 7197444B2 · Bomar, Jr. et al. · 2007 [cited by applicant]
US 7222110B2 · Onoue · 2007 [cited by applicant]
US 7359821B1 · Smith et al. · 2008 [cited by applicant]
US 7502772B2 · Kidd et al. · 2009 [cited by applicant]
US 7698086B2 · Kidd et al. · 2010 [cited by applicant]
US 7716002B1 · Smith · 2010 [cited by applicant]
US 7789217B2 · Fischer et al. · 2010 [cited by applicant]
US 7809587B2 · Dorai · 2010 [cited by examiner]
US 7974808B2 · Smith · 2011 [cited by applicant]
US 8019629B1 · Medina, III et al. · 2011 [cited by applicant]
US 8095391B2 · Obora et al. · 2012 [cited by applicant]
US 8160904B1 · Smith · 2012 [cited by applicant]
US 8200513B2 · Vahidi et al. · 2012 [cited by applicant]
US 8260639B1 · Medina, III et al. · 2012 [cited by applicant]
US 8468038B2 · Vahidi et al. · 2013 [cited by applicant]
US 8612170B2 · Smith et al. · 2013 [cited by applicant]
US 8712806B1 · Medina, III et al. · 2014 [cited by applicant]
US 8725544B2 · Vahidi et al. · 2014 [cited by applicant]
US 8792781B1 · Randall et al. · 2014 [cited by applicant]
US 9208526B1 · Leise · 2015 [cited by examiner]
US 9218626B1 · Haller, Jr. et al. · 2015 [cited by applicant]
US 9228834B2 · Kidd et al. · 2016 [cited by applicant]
US 9500545B2 · Smith et al. · 2016 [cited by applicant]
US 9721400B1 · Oakes, III et al. · 2017 [cited by applicant]
US 9846093B2 · Smith et al. · 2017 [cited by applicant]
US 10339728B1 · Oakes, III et al. · 2019 [cited by applicant]
US 10360601B1 · Adegan · 2019 [cited by examiner]
US 10410439B1 · Gingrich et al. · 2019 [cited by applicant]
US 10510142B1 · Dohner et al. · 2019 [cited by applicant]
US 10796685B2 · Gong et al. · 2020 [cited by applicant]
US 10922726B1 · Nelson et al. · 2021 [cited by applicant]
US 10949814B1 · Nelson et al. · 2021 [cited by applicant]
US 20040148188A1 · Uegaki · 2004 [cited by examiner]
US 20050246206A1 · Obora et al. · 2005 [cited by applicant]
US 20050251427A1 · Dorai et al. · 2005 [cited by applicant]
US 20060064393A1 · Orr · 2006 [cited by applicant]
US 20070071762A1 · Ts'o et al. · 2007 [cited by applicant]
US 20090138290A1 · Holden · 2009 [cited by applicant]
US 20090150200A1 · Siessman · 2009 [cited by examiner]
US 20090265193A1 · Collins et al. · 2009 [cited by applicant]
US 20110313951A1 · Cook · 2011 [cited by examiner]
US 20120090956A1 · Brobst · 2012 [cited by applicant]
US 20130317865A1 · Tofte et al. · 2013 [cited by applicant]
US 20140025403A1 · Vahidi et al. · 2014 [cited by applicant]
US 20140058764A1 · Vahidi et al. · 2014 [cited by applicant]
US 20140067429A1 · Lowell · 2014 [cited by applicant]
US 20140067637A1 · Vahidi et al. · 2014 [cited by applicant]
US 20140067735A1 · Yu · 2014 [cited by applicant]
US 20140074865A1 · Zobrist · 2014 [cited by examiner]
US 20140081675A1 · Ives et al. · 2014 [cited by applicant]
US 20140095133A1 · Silva et al. · 2014 [cited by applicant]
US 20140122130A1 · Kelly et al. · 2014 [cited by applicant]
US 20140229123A1 · Smith et al. · 2014 [cited by applicant]
US 20140279169A1 · Leos · 2014 [cited by applicant]
US 20140316825A1 · van Dijk · 2014 [cited by examiner]
US 20150012169A1 · Coard · 2015 [cited by applicant]
US 20150039397A1 · Fuchs · 2015 [cited by examiner]
US 20150103170A1 · Nelson et al. · 2015 [cited by applicant]
US 20150106133A1 · Smith, Jr. · 2015 [cited by applicant]
US 20150213556A1 · Haller, Jr. et al. · 2015 [cited by applicant]
US 20150294419A1 · Gonzalez Miranda · 2015 [cited by examiner]
US 20160012539A1 · Gorelov · 2016 [cited by applicant]
US 20160178465A1 · Smith et al. · 2016 [cited by applicant]
US 20160292759A1 · Gonzalez Miranda et al. · 2016 [cited by applicant]
US 20170221110A1 · Sullivan et al. · 2017 [cited by applicant]
US 20180101504A1 · Ditomaso · 2018 [cited by applicant]
US 20180300576A1 · Dalyac et al. · 2018 [cited by applicant]
US 20210103817A1 · Gastineau et al. · 2021 [cited by applicant]
WO WO2009129496A2 · 2009 [cited by applicant]
Image processing based severity and cost prediction of damages in the vehicle body: A computational intelligence approach; 2017 National Information Technology Conference (NITC) (pp. 18-21); W.A. Rukshala Harshani, Kane… [cited by examiner]
Examination Report in European Patent Application No. 17154277.2. dated Apr. 22, 2021. [cited by applicant]
Huetter, J., “CCC:A.I. Claims tech could be offered to shops too,” http://www.repairerdrivennews.com/2018/12/04/ccc-a-i-claims-tech-could-be-offered-to-shops-too/ (Dec. 4, 2018). [cited by applicant]
Hellyar, M., “CCC Introduces the World's First Artificial Intelligence Estimating Tool,” https://www.cccis.com/2018/12/03/ccc-introduces-the-worlds-first-artificial-intelligence-estimating-tool/ (Dec. 3, 2018). [cited by applicant]
Novet, “Microsoft Researchers Say Their Newest Deep Learning System Beats Humans—And Google,” Feb. 9, 2015, pp. 1-3, BIG-DATA. [cited by applicant]
He, et al., “Delving Depp Into Rectifiers: Surpassing Human-Level Performance On ImageNet Classification,” Feb. 6, 2015, pp. 1-11. [cited by applicant]
Krizhevsky, Alex et al., “ImageNet Classification with Deep Convolutional Neural Networks,” 2012, Advances in Neural Information Processing Systems 25 (NIPS 2012). [cited by applicant]
Extended European Search Report in EP 17154277.2, dated Jun. 30, 2017. [cited by applicant]
Office Action in European Patent Application No. 17154277.2, dated Nov. 19, 2019. [cited by applicant]