IP Library Patent Application 16590574
Patent Application
App. No. 16/590,574

Apparatus and Method for Combined Visual Intelligence

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/590,574
Filed
Oct 2, 2019
Art Unit
3693
USPC
705/4
Abstract

A method includes accessing a plurality of input images of a vehicle and categorizing each of the plurality of images into one of a plurality of categories. The method also includes determining one or more parts of the vehicle in each categorized image, determining a side of the vehicle in each categorized image, and determining a first list of damaged parts of the vehicle. The method also includes determining, using the categorized images, an identification of the vehicle; determining, using the plurality of input images, a second list of damaged parts of the vehicle; and aggregating, using one or more rules, the first and second lists of damaged parts of the vehicle in order to generate an aggregated list of damaged parts of the vehicle. The method also includes displaying a repair cost estimation for the vehicle.

Claims (75)

1 . An apparatus comprising:

one or more computer processors; and

one or more memory units communicatively coupled to the one or more computer processors, the one or more memory units comprising instructions executable by the one or more computer processors, the one or more computer processors being operable when executing the instructions to:

access a plurality of input images of a vehicle;

categorize each of the plurality of input images into one of a plurality of categories;

determine one or more parts of the vehicle in each categorized image;

determine a side of the vehicle in each categorized image;

determine, using the determined one or more parts of the vehicle and the determined side of the vehicle, a first list of damaged parts of the vehicle;

determine, using the categorized images, an identification of the vehicle;

determine, using the plurality of input images, a second list of damaged parts of the vehicle;

aggregate, using one or more rules, the first and second lists of damaged parts of the vehicle in order to generate an aggregated list of damaged parts of the vehicle; and

display a repair cost estimation for the vehicle, the repair cost estimation determined based on the determined identification of the vehicle and the aggregated list of damaged parts of the vehicle.

2 . The apparatus of claim 1 , wherein the plurality of categories comprises:

a full-view vehicle image; and

a close-up vehicle image.

3 . The apparatus of claim 1 , wherein determining the one or more parts of the vehicle in each categorized image comprises utilizing instance segmentation.

4 . The apparatus of claim 1 , wherein determining the identification of the vehicle comprises utilizing multi-image classification.

5 . The apparatus of claim 1 , wherein determining, using the plurality of input images, the second list of damaged parts of the vehicle comprises utilizing multi-image classification.

6 . The apparatus of claim 1 , wherein the repair cost estimation comprises one or more repair steps, each repair step comprising:

a confidence score;

a damage type;

a damage amount; and

a user-selectable estimate option.

7 . The apparatus of claim 1 , wherein the vehicle comprises:

an automobile;

a truck;

a recreational vehicle (RV); or

a motorcycle.

8 . A method, comprising:

accessing a plurality of input images of a vehicle;

categorizing each of the plurality of input images into one of a plurality of categories;

determining one or more parts of the vehicle in each categorized image;

determining a side of the vehicle in each categorized image;

determining, using the determined one or more parts of the vehicle and the determined side of the vehicle, a first list of damaged parts of the vehicle;

determining, using the categorized images, an identification of the vehicle;

determining, using the plurality of input images, a second list of damaged parts of the vehicle;

aggregating, using one or more rules, the first and second lists of damaged parts of the vehicle in order to generate an aggregated list of damaged parts of the vehicle; and

displaying a repair cost estimation for the vehicle, the repair cost estimation determined based on the determined identification of the vehicle and the aggregated list of damaged parts of the vehicle.

9 . The method of claim 8 , wherein the plurality of categories comprises:

a full-view vehicle image; and

a close-up vehicle image.

10 . The method of claim 8 , wherein determining the one or more parts of the vehicle in each categorized image comprises utilizing instance segmentation.

11 . The method of claim 8 , wherein determining the identification of the vehicle comprises utilizing multi-image classification.

12 . The method of claim 8 , wherein determining, using the plurality of input images, the second list of damaged parts of the vehicle comprises utilizing multi-image classification.

13 . The method of claim 8 , wherein the repair cost estimation comprises one or more repair steps, each repair step comprising:

a confidence score;

a damage type;

a damage amount; and

a user-selectable estimate option.

14 . The method of claim 8 , wherein the vehicle comprises:

an automobile;

a truck;

a recreational vehicle (RV); or

a motorcycle.

15 . One or more computer-readable non-transitory storage media embodying one or more units of software that is operable when executed to:

access a plurality of input images of a vehicle;

categorize each of the plurality of input images into one of a plurality of categories;

determine one or more parts of the vehicle in each categorized image;

determine a side of the vehicle in each categorized image;

determine, using the determined one or more parts of the vehicle and the determined side of the vehicle, a first list of damaged parts of the vehicle;

determine, using the categorized images, an identification of the vehicle;

determine, using the plurality of input images, a second list of damaged parts of the vehicle;

aggregate, using one or more rules, the first and second lists of damaged parts of the vehicle in order to generate an aggregated list of damaged parts of the vehicle; and

display a repair cost estimation for the vehicle, the repair cost estimation determined based on the determined identification of the vehicle and the aggregated list of damaged parts of the vehicle.

16 . The one or more computer-readable non-transitory storage of claim 15 , wherein the plurality of categories comprises:

a full-view vehicle image; and

a close-up vehicle image.

17 . The one or more computer-readable non-transitory storage of claim 15 , wherein determining the one or more parts of the vehicle in each categorized image comprises utilizing instance segmentation.

18 . The one or more computer-readable non-transitory storage of claim 15 , wherein determining the identification of the vehicle comprises utilizing multi-image classification.

19 . The one or more computer-readable non-transitory storage of claim 15 , wherein determining, using the plurality of input images, the second list of damaged parts of the vehicle comprises utilizing multi-image classification.

20 . The one or more computer-readable non-transitory storage of claim 15 , wherein the repair cost estimation comprises one or more repair steps, each repair step comprising:

a confidence score;

a damage type;

a damage amount; and

a user-selectable estimate option.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER D856640 PREVIOUSLY RECORDED AT REEL: 056595 FRAME: 0764. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 14, 2021
From: SOLERA HOLDINGS, INC.
To: SOLERA HOLDINGS, LLC
Reel/Frame 057857/0274 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
CHANGE OF NAME Recorded Jun 15, 2021
From: SOLERA HOLDINGS, INC.
To: SOLERA HOLDINGS, LLC
Reel/Frame 056595/0764 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2019
From: DE BUREN, PASCAL; GONZENBACH, MAURICE
To: SOLERA HOLDINGS, INC.
Reel/Frame 050682/0387 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: STUCKI, PASCAL; NAFISI, NIMA
To: SOLERA HOLDINGS, INC.
Reel/Frame 050602/0915 →