IP Library Granted Patent US 10,671,873
Granted Patent B2
US 10,671,873 · App. 15/917,331 · Granted Jun 2, 2020

System and method for vehicle wheel detection

Inventors: Panqu Wang (San Diego, CA); Pengfei Chen (San Diego, CA)
Assignee: TUSIMPLE, INC.
G06K9/3241G01S17/89G06K9/00791G06K9/00805G06K9/4628G06K9/6271G06T7/194G06T2207/20081G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,671,873
App. No.
15/917,331
Granted
Jun 2, 2020
Kind
B2
Abstract

A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.

Claims (37)

1. A system comprising:

a data processor; and

an autonomous vehicle wheel detection system, executable by the data processor, the autonomous vehicle wheel detection system being configured to perform an autonomous vehicle wheel detection operation for autonomous vehicles, the autonomous vehicle wheel detection operation being configured to:

receive training image data from a training image data collection system;

obtain ground truth data corresponding to the training image data;

perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects of other vehicles in the images of the training image data;

receive operational image data from an image data collection system associated with an autonomous vehicle; and

perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects of other vehicles from the operational image data and produce vehicle wheel object data related to wheels of other vehicles, the vehicle wheel object data including vehicle wheel contour data corresponding to the contours surrounding the wheels of other vehicles.

2. The system of claim 1 wherein the training phase being configured to obtain ground truth data from a manual image annotation or labeling process.

3. The system of claim 1 being further configured to generate a blended visualization of a raw image combined with the ground truth.

4. The system of claim 1 being further configured to generate the ground truth by filling in the interior regions defined by contours surrounding the extracted vehicle wheel objects.

5. The system of claim 1 being further configured to use a fully convolutional neural network (FCN) as a machine learning model.

6. The system of claim 1 being further configured to use a fully convolutional neural network (FCN) as a machine learning model with semantic segmentation using dense upsampling convolution (DUC) and semantic segmentation using hybrid dilated convolution (HDC).

7. The system of claim 1 being configured to generate object-level contour detections for each extracted vehicle wheel object of the operational image data.

8. A method comprising:

receiving training image data from a training image data collection system;

obtaining ground truth data corresponding to the training image data;

performing a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects of other vehicles in the images of the training image data;

receiving operational image data from an image data collection system associated with an autonomous vehicle; and

performing an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects of other vehicles from the operational image data and produce vehicle wheel object data related to wheels of other vehicles, the vehicle wheel object data including vehicle wheel contour data corresponding to the contours surrounding the wheels of other vehicles.

9. The method of claim 8 wherein the training phase includes obtaining ground truth data from a manual image annotation or labeling process.

10. The method of claim 8 including generating a blended visualization of a raw image combined with the ground truth.

11. The method of claim 8 including generating the ground truth by filling in the interior regions defined by contours surrounding the extracted vehicle wheel objects.

12. The method of claim 8 including using a fully convolutional neural network (FCN) as a machine learning model.

13. The method of claim 8 including using a fully convolutional neural network (FCN) as a machine learning model with semantic segmentation using dense upsampling convolution (DUC) and semantic segmentation using hybrid dilated convolution (HDC).

14. The method of claim 8 including generating object-level contour detections for each extracted vehicle wheel object of the operational image data.

15. A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:

receive training image data from a training image data collection system;

obtain ground truth data corresponding to the training image data;

perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects of other vehicles in the images of the training image data;

receive operational image data from an image data collection system associated with an autonomous vehicle; and

perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects of other vehicles from the operational image data and produce vehicle wheel object data related to wheels of other vehicles, the vehicle wheel object data including vehicle wheel contour data corresponding to the contours surrounding the wheels of other vehicles.

16. The non-transitory machine-useable storage medium of claim 15 wherein the training phase being configured to obtain ground truth data from a manual image annotation or labeling process.

17. The non-transitory machine-useable storage medium of claim 15 being further configured to generate a blended visualization of a raw image combined with the ground truth.

18. The non-transitory machine-useable storage medium of claim 15 being further configured to generate the ground truth by filling in the interior regions defined by contours surrounding the extracted vehicle wheel objects.

19. The non-transitory machine-useable storage medium of claim 15 being further configured to use a fully convolutional neural network (FCN) as a machine learning model.

20. The non-transitory machine-useable storage medium of claim 15 being configured to generate object-level contour detections for each extracted vehicle wheel object of the operational image data.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
CHANGE OF NAME Recorded Jan 30, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051757/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2018
From: WANG, PANQU; CHEN, PENGFEI
To: TUSIMPLE
Reel/Frame 047468/0191 →
Continuity (3)
Continuation In Part 15456294 · Mar 10, 2017
Continuation In Part 15456210 · Mar 10, 2017
Related Publication 20180260651A1 · Sep 13, 2018
Cited By (1)
US 12,688,425