IP Library Granted Patent US 11,080,839
Granted Patent B2
US 11,080,839 · App. 16/554,223 · Granted Aug 3, 2021

System and method for training a damage identification model

Inventor: Juan Xu (Beijing, CN)
Assignee: Advanced New Technologies Co., Ltd.
G06T7/0002G06F16/5866G06K9/623G06K9/6256G06K9/6267G06N5/04G06N20/00G06T2207/20081G06T2207/30248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,080,839
App. No.
16/554,223
Granted
Aug 3, 2021
Kind
B2
Abstract

A system is provided for identifying damages of a vehicle. During operation, the system can obtain a set of digital images associated with a set of tagged digital images as training data. Each tagged digital image in the set of tagged digital images may include at least one damage object. The system can train a damage identification model based on the training data. When training the damage identification model, the system may identify at least a damage object in the training data based on a target detection technique. The system may also generate a set of feature vectors for the training data. The system can use the set of feature vectors to optimize a set of parameters associated with the damage identification model to obtain a trained damage identification model. The system can then apply the trained damage identification model to obtain a damage category prediction result.

Claims (81)

1. A computer-implemented method for identifying damages of a vehicle, the method comprising:

obtaining, by a computing device, a set of tagged digital images as training data, wherein each tagged digital image includes at least one damage object;

training, based on the training data, a damage identification model independent of a part associated with the damage object, wherein training the damage identification model comprises:

identifying at least a damage object in the training data based on a target detection technique;

generating a set of feature vectors for the training data; and

using the set of feature vectors to optimize a set of parameters associated with the damage identification model to obtain a trained damage identification model; and

applying the trained damage identification model to obtain a damage category prediction result.

2. The method of claim 1 , wherein an area comprising the damage object is tagged with a damage bounding box and a damage category tag corresponding to the damage bounding box, and wherein the damage category tag indicates a damage material and a damage mode.

3. The method of claim 2 , wherein the damage material includes one of:

a painted piece;

a plastic piece;

a metal piece;

a sanded piece; and

a glass.

4. The method of claim 2 , wherein the damage mode includes one of:

a scratch;

a deformation;

a crack; and

a fragmentation.

5. The method of claim 2 , wherein the damage category tag further indicates a damage degree, and wherein the damage degree corresponds to at least one of:

minor damage;

medium damage; and

severe damage.

6. The method of claim 1 , wherein training the damage identification model further comprises reducing noise associated with the identified damage object in the training data prior to generating the feature vectors, and wherein reducing the noise comprises:

determining whether a sub-area associated with the identified damage object corresponds to a maximum damaged area;

in response to determining that the sub-area does not include the maximum damaged area, filtering out negative matches; and

retaining positive matches.

7. The method of claim 6 , wherein the negative matches indicate that the one or more portions in the sub-area do not include the damage object, and wherein the positive matches indicate that the one or more portions in the sub-area includes the damage object.

8. The method of claim 1 , wherein applying the trained damage identification model to obtain a damage category prediction result comprises:

obtaining an untagged digital image of a target object;

providing the digital image to the trained damage identification model;

using the trained damage identification model to:

identify a damage object from the digital image; and

determine a damage category prediction result associated with the identified damage object; and

determining a damage material and a damage mode of the damage object based on the damage category prediction result and a mapping table.

9. The method of claim 8 , further comprising:

determining a repair solution based on the damage category prediction result.

10. An apparatus for identifying damages of a vehicle, the apparatus comprising:

one or more processors; and

a storage medium storing instructions that, when executed by the one or more processors, cause the apparatus to perform a method comprising:

obtaining, by a computing device, a set of tagged digital images as training data, wherein each tagged digital image includes at least one damage object;

training, based on the training data, a damage identification model independent of a part associated with the damage object, wherein training the damage identification model comprises:

identifying at least a damage object in the training data based on a target detection technique;

generating a set of feature vectors for the training data; and

using the set of feature vectors to optimize a set of parameters associated with the damage identification model to obtain a trained damage identification model; and

applying the trained damage identification model to obtain a damage category prediction result.

11. The apparatus of claim 10 , wherein an area comprising the damage object is tagged with a damage bounding box and a damage category tag corresponding to the damage bounding box, and wherein the damage category tag indicates a damage material and a damage mode.

12. The apparatus of claim 10 , wherein training the damage identification model further comprises reducing noise associated with the identified damage object in the training data prior to generating the feature vectors, and wherein reducing the noise comprises:

determining whether a sub-area associated with the identified damage object corresponds to a maximum damaged area;

in response to determining that the sub-area does not include the maximum damaged area, filtering out negative matches; and

retaining positive matches.

13. The apparatus of claim 12 , wherein the negative matches indicate that the one or more portions in the sub-area do not include the damage object, and wherein the positive matches indicate that the one or more portions in the sub-area includes the damage object.

14. The apparatus of claim 10 , wherein applying the trained damage identification model to obtain a damage category prediction result comprises:

obtaining an untagged digital image of a target object;

providing the digital image to the trained damage identification model;

using the trained damage identification model to:

identify a damage object from the digital image; and

determine a damage category prediction result associated with the identified damage object; and

determine a damage material and a damage mode of the damage object based on the damage category prediction result and a mapping table.

15. The apparatus of claim 14 , wherein the method further comprising:

determining a repair solution based on the damage category prediction result.

16. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for identifying damages of a vehicle, the method comprising:

obtaining, by a computing device, a set of tagged digital images as training data, wherein each tagged digital image includes at least one damage object;

training, based on the training data, a damage identification model independent of a part associated with the damage object, wherein training the damage identification model comprises:

identifying at least a damage object in the training data based on a target detection technique;

generating a set of feature vectors for the training data; and

using the set of feature vectors to optimize a set of parameters associated with the damage identification model to obtain a trained damage identification model; and

applying the trained damage identification model to obtain a damage category prediction result.

17. The non-transitory computer-readable storage medium claim 16 , wherein an area comprising the damage object is tagged with a damage bounding box and a damage category tag corresponding to the damage bounding box, and wherein the damage category tag indicates a damage material and a damage mode.

18. The non-transitory computer-readable storage medium claim 16 , wherein training the damage identification model further comprises reducing noise associated with the identified damage object in the training data prior to generating the feature vectors, and wherein reducing the noise comprises:

determining whether a sub-area associated with the identified damage object corresponds to a maximum damaged area;

in response to determining that the sub-area does not include the maximum damaged area, filtering out negative matches; and

retaining positive matches.

19. The non-transitory computer-readable storage medium claim 18 , wherein the negative matches indicate that the one or more portions in the sub-area do not include the damage object, and wherein the positive matches indicate that the one or more portions in the sub-area includes the damage object.

20. The non-transitory computer-readable storage medium claim 16 , wherein applying the trained damage identification model to obtain the damage category prediction result comprises:

obtaining an untagged digital image of a target object;

providing the digital image to the trained damage identification model;

using the trained damage identification model to:

identify a damage object from the digital image; and

determine a damage category prediction result associated with the identified damage object; and

determine a damage material and a damage mode of the damage object based on the damage category prediction result and a mapping table.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2020
From: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
To: ADVANCED NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053745/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053663/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2020
From: XU, JUAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 051890/0632 →
Priority Claims (1)
CN 201811012749.2 · Aug 31, 2018 · national
Continuity (1)
Related Publication 20200090320A1 · Mar 19, 2020