IP Library Granted Patent US 11,069,048
Granted Patent B2
US 11,069,048 · App. 16/563,634 · Granted Jul 20, 2021

System and method for facilitating efficient damage assessments

Inventor: Juan Xu (Beijing, CN)
Assignee: ADVANCED NEW TECHNOLOGIES CO., LTD.
G06T7/0002G06K9/6257G06K9/6267G06N3/08G06T7/70G06K2209/21G06K2209/23G06T2207/20081G06T2207/20084G06T2207/30248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,069,048
App. No.
16/563,634
Granted
Jul 20, 2021
Kind
B2
Abstract

Embodiments described herein provide a system for facilitating image sampling for training a target detector. During operation, the system obtains a first image depicting a first target. Here, the continuous part of the first target in the first image is labeled and enclosed in a target bounding box. The system then generates a set of positive image samples from an area of the first image enclosed by the target bounding box. A respective positive image sample includes at least a part of the first target. The system can train the target detector with the set of positive image samples to detect a second target from a second image. The target detector can be an artificial intelligence (AI) model capable of detecting an object.

Claims (48)

1. A method for facilitating image sampling for training a target detector, comprising:

obtaining a first image depicting a first target, wherein a continuous part of the first target depicted in the first image is labeled and enclosed by a target bounding box;

determining region proposals from an area of the first image enclosed by the target bounding box;

generating a set of positive image samples from a subset of the region proposals, wherein a respective region proposal of the subset of the region proposals is associated with an overlapping parameter in a threshold range, wherein a respective positive image sample of the set of positive image samples includes at least a part of the first target; and

training the target detector with the set of positive image samples to detect a second target from a second image, wherein the target detector is an artificial intelligence (AI) model capable of detecting an object, and wherein the first and second targets indicate first and second vehicular damages, respectively.

2. The method of claim 1 , wherein the label of the continuous part indicates a material impacted by the first vehicular damage.

3. The method of claim 2 , wherein detecting the second target comprises detecting the second vehicular damage based on a corresponding material independent of identifying a part of a vehicle impacted by the second vehicular damage.

4. The method of claim 1 , wherein the overlapping parameter is a ratio of an overlapping region of the respective region proposal and a surrounding region of the respective region proposal,

wherein the overlapping region indicates a common region covered by both the respective region proposal and at least one internal bounding box of a set of internal bounding boxes within the target bounding box, wherein a respective internal bounding box of the set of internal bounding boxes includes at least a part of the continuous region, and

wherein the surrounding region indicates a total region covered by the respective region proposal and the set of internal bounding boxes.

5. The method of claim 4 , wherein the set of internal bounding boxes is determined for the respective region proposal based on one of:

an intersection with the respective region proposal;

a distance from the respective region proposal; and

a total number of internal bounding boxes in the target bounding box.

6. The method of claim 1 , further comprising generating a negative sample, which excludes any part of the first target, from the first image by one or more of:

selecting a region proposal from a second subset of the region proposals as the negative sample, wherein the overlapping parameter of a respective region proposal of the second subset of the region proposals is in a low threshold range; and

selecting an area outside of the target bounding box as the negative sample.

7. The method of claim 1 , wherein the region proposals are determined based on applying a movement rule.

8. The method of claim 1 , further comprising generating a second set of positive image samples from one or more of:

new region proposals from an area of the first image enclosed by a second target bounding box in the first image; and

new region proposals with a different size or shape compared to the region proposals.

9. The method of claim 1 , further comprising optimizing the training of the target detector by:

generating a plurality of bounding boxes for a plurality of image samples in the set of positive image samples, wherein a respective bounding box identifies the corresponding part of the continuous region; and

combining the plurality of bounding boxes to generate a combined bounding box and a corresponding label.

10. A non-transitory computer-readable storage medium storing instructions that when executed by a computer, cause the computer to perform a method for facilitating image sampling for training a target detector, the method comprising:

obtaining a first image depicting a first target, wherein a continuous part of the first target depicted in the first image is labeled and enclosed by a target bounding box;

determining region proposals from an area of the first image enclosed by the target bounding box;

generating a set of positive image samples from a subset of the region proposals, wherein a respective region proposal of the subset of the region proposals is associated with an overlapping parameter in a threshold range, wherein a respective positive image sample of the set of positive image samples includes at least a part of the first target; and

training the target detector with the set of positive image samples to detect a second target from a second image, wherein the target detector is an artificial intelligence (AI) model capable of detecting an object, and wherein the first and second targets indicate first and second vehicular damages, respectively.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the label of the continuous part indicates a material impacted by the first vehicular damage.

12. The non-transitory computer-readable storage medium of claim 11 , wherein detecting the second target comprises detecting the second vehicular damage based on a corresponding material independent of identifying a part of a vehicle impacted by the second vehicular damage.

13. The non-transitory computer-readable storage medium of claim 10 , wherein the overlapping parameter is a ratio of an overlapping region of the respective region proposal and a surrounding region of the respective region proposal,

wherein the overlapping region indicates a common region covered by both the respective region proposal and at least one internal bounding box of a set of internal bounding boxes within the target bounding box, wherein a respective internal bounding box of the set of internal bounding boxes includes at least a part of the continuous region, and

wherein the surrounding region indicates a total region covered by the respective region proposal and the set of internal bounding boxes.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the set of internal bounding boxes is determined for the respective region proposal based on one of:

an intersection with the respective region proposal;

a distance from the respective region proposal; and

a total number of internal bounding boxes in the target bounding box.

15. The non-transitory computer-readable storage medium of claim 10 , wherein the method further comprises generating a negative sample, which excludes any part of the first target, from the first image by one or more of:

selecting a region proposal from a second subset of the region proposals as the negative sample, wherein the overlapping parameter of a respective region proposal of the second subset of the region proposals is in a low threshold range; and

selecting an area outside of the target bounding box as the negative sample.

16. The non-transitory computer-readable storage medium of claim 10 , wherein the region proposals are determined based on applying a movement rule.

17. The non-transitory computer-readable storage medium of claim 10 , wherein the method further comprises generating a second set of positive image samples from one or more of:

new region proposals from an area of the first image enclosed by a second target bounding box in the first image; and

new region proposals with a different size or shape compared to the region proposals.

18. The non-transitory computer-readable storage medium of claim 10 , wherein the method further comprises optimizing the training of the target detector by:

generating a plurality of bounding boxes for a plurality of image samples in the set of positive image samples, wherein a respective bounding box identifies the corresponding part of the continuous region; and

combining the plurality of bounding boxes to generate a combined bounding box and a corresponding label.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2020
From: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
To: ADVANCED NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053745/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053663/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2020
From: XU, JUAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 051890/0497 →
Priority Claims (1)
CN 201811046061.6 · Sep 7, 2018 · national
Continuity (1)
Related Publication 20200090321A1 · Mar 19, 2020