IP Library Granted Patent US 11,900,335
Granted Patent B2
US 11,900,335 · App. 17/649,601 · Granted Feb 13, 2024

Auxiliary parts damage determination

Inventors: Razvan Ranca (London, GB); Marcel Horstmann (London, GB); Bjorn Mattsson (London, GB); Janto Oellrich (London, GB); Yih Kai Teh (London, GB); Ken Chatfield (London, GB); Franziska Kirschner (London, GB); Rusen Aktas (London, GB); Laurent Decamp (London, GB); Mathieu Ayel (London, GB); Julia Peyre (London, GB); Shaun Trill (London, GB); Crystal Van Oosterom (London, GB); Stephen Hardwick (London, GB)
Assignee: Tractable Limited
G06Q10/20G06F16/24578G06F18/214G06F18/2148G06F18/231G06F18/24G06F18/2415G06F18/2431G06F18/24317G06F18/285G06F40/20G06N3/04G06N3/045G06N3/049G06N3/08G06N20/00G06N20/20G06Q10/06313G06Q10/0875G06Q30/0283G06T7/0002G06T7/0004G06T7/11G06V10/22G06V10/225G06V10/25G06V10/255G06V10/454G06V10/764G06V10/82G06V20/10G06Q30/016G06Q40/08G06T2207/20081G06T2207/20084G06T2207/20132G06T2207/30156G06T2207/30164G06T2207/30248G06T2207/30252G06V2201/08G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,335
App. No.
17/649,601
Granted
Feb 13, 2024
Kind
B2
Abstract

A method of determining one or more damage states of one or more auxiliary parts of a damaged vehicle, the vehicle comprising a plurality of normalized parts and at least some of the normalized parts further comprising one or more auxiliary parts. The method includes receiving one or more images of the vehicle, using a plurality of classifiers, each determining at least one classification of damage to the vehicle, each said classification being determined for each of a plurality of normalized parts of the vehicle, determining one or more classifications for the plurality of auxiliary parts using one or more trained models, wherein each classification comprises at least one indication of damage to at least one auxiliary part and outputting the determined damage states of the one or more auxiliary parts.

Claims (42)

1. A method, comprising:

receiving one or more images of a damaged vehicle, the damage vehicle comprising a plurality of normalized parts;

determining, using image segmentation on the one or more images, a location of damage on the damaged vehicle relative to one or more of the normalized parts; and

determining, using one or more classifiers, one or more damage states for one or more auxiliary parts of the vehicle based on at least the image segmentation.

2. The method of claim 1 , wherein the one or more classifiers comprises one or more of a first type of classifier and a second type of classifier,

wherein the first type of classifier is configured to perform image segmentation and determine a classification of damage to one of the normalized parts of the vehicle, and

wherein the second type of classifier is configured to i) receive input comprising image segmentation data and the one or more images and ii) generate output comprising the one or more damages states for the one or more auxiliary parts of the vehicle.

3. The method of claim 2 , wherein the segmentation data comprises one or more segmentation masks or segmentation maps.

4. The method of claim 1 , wherein the one or more classifiers perform the image segmentation on the one or more images.

5. The method of claim 1 , further comprising:

generating a plurality of cropped images from each of the one or more images, wherein determining the location of the damage on the vehicle further comprises using image segmentation on the plurality of cropped images.

6. The method of claim 1 , wherein the one or more classifiers comprises at least a multi-task classifier comprising both shared layers and task specific layers.

7. The method of claim 6 , wherein each task of the multi-task classifier correspond to a same auxiliary part.

8. The method of claim 1 , wherein determining, using the one or more classifiers, the one or more damage states for the one or more auxiliary parts of the vehicle is further based on a classification of a category of the damage.

9. One or more processors configured to perform operations comprising:

receiving one or more images of a damaged vehicle, the damage vehicle comprising a plurality of normalized parts;

determining, using image segmentation on the one or more images, a location of damage on the damaged vehicle relative to one or more of the normalized parts; and

determining, using one or more classifiers, one or more damage states for one or more auxiliary parts of the vehicle based on at least the image segmentation.

10. The one or more processors of claim 9 , wherein the one or more classifiers comprises one or more of a first type of classifier and a second type of classifier,

wherein the first type of classifier is configured to perform image segmentation and determine a classification of damage to one of the normalized parts of the vehicle, and

wherein the second type of classifier is configured to i) receive input comprising image segmentation data and the one or more images and ii) generate output comprising the one or more damages states for the one or more auxiliary parts of the vehicle.

11. The one or more processors of claim 10 , wherein the segmentation data comprises one or more segmentation masks or segmentation maps.

12. The one or more processors of claim 9 , wherein the one or more classifiers perform the image segmentation on the one or more images.

13. The one or more processors of claim 9 , further comprising:

generating a plurality of cropped images from each of the one or more images, wherein determining the location of the damage on the vehicle further comprises using image segmentation on the plurality of cropped images.

14. The one or more processors of claim 9 , wherein the one or more classifiers comprises at least a multi-task classifier comprising both shared layers and task specific layers.

15. The one or more processors of claim 14 , wherein each task of the multi-task classifier correspond to a same auxiliary part.

16. The one or more processors of claim 9 , wherein determining, using the one or more classifiers, the one or more damage states for the one or more auxiliary parts of the vehicle is further based on a classification of a category of the damage.

17. A non-transitory computer-readable storage medium storing a set of instructions that is executable by one or more processors, the set of instructions, when executed by the one or more processors, causing the one or more processors to perform operations, comprising:

receiving one or more images of a damaged vehicle, the damage vehicle comprising a plurality of normalized parts;

determining, using image segmentation on the one or more images, a location of damage on the damaged vehicle relative to one or more of the normalized parts; and

determining, using one or more classifiers, one or more damage states for one or more auxiliary parts of the vehicle based on at least the image segmentation.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the one or more classifiers comprises one or more of a first type of classifier and a second type of classifier,

wherein the first type of classifier is configured to perform image segmentation and determine a classification of damage to one of the normalized parts of the vehicle, and

wherein the second type of classifier is configured to i) receive input comprising image segmentation data and the one or more images and ii) generate output comprising the one or more damages states for the one or more auxiliary parts of the vehicle.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the segmentation data comprises one or more segmentation masks or segmentation maps.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the one or more classifiers perform the image segmentation on the one or more images.

21. The non-transitory computer-readable storage medium of claim 17 , further comprising:

generating a plurality of cropped images from each of the one or more images, wherein determining the location of the damage on the vehicle further comprises using image segmentation on the plurality of cropped images.

22. The non-transitory computer-readable storage medium of claim 17 , wherein the one or more classifiers comprises at least a multi-task classifier comprising both shared layers and task specific layers.

23. The non-transitory computer-readable storage medium of claim 22 , wherein each task of the multi-task classifier correspond to a same auxiliary part.

24. The non-transitory computer-readable storage medium of claim 17 , wherein determining, using the one or more classifiers, the one or more damage states for the one or more auxiliary parts of the vehicle is further based on a classification of a category of the damage.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2022
From: RANCA, RAZVAN; MATTSSON, BJORN; VAN OOSTEROM, CRYSTAL; KIRSCHNER, FRANZISKA; OELLRICH, JANTO; PEYRE, JULIA; CHATFIELD, KEN; DECAMP, LAURENT; HORSTMANN, MARCEL; AYEL, MATHIEU; AKTAS, RUSEN; TRILL, SHAUN; TEH, YIH KAI
To: TRACTABLE LIMITED
Reel/Frame 062014/0055 →
SECURITY INTEREST Recorded Nov 14, 2022
From: TRACTABLE LTD.; TRACTABLE INC.
To: CANADIAN IMPERIAL BANK OF COMMERCE
Reel/Frame 061764/0796 →
Priority Claims (5)
GB 2000076.6 · Jan 3, 2020 · national
GB 2000077.4 · Jan 3, 2020 · national
GB 2007465.4 · May 19, 2020 · national
GB 2016723.5 · Oct 21, 2020 · national
GB 2017464.5 · Nov 4, 2020 · national
Continuity (4)
Continuation 17303076 · May 19, 2021
Continuation PCTGB2021050009 · Jan 4, 2021
Provisional Application 63198628 · Oct 30, 2020
Related Publication 20220156915A1 · May 19, 2022