IP Library Granted Patent US 10,147,193
Granted Patent B2
US 10,147,193 · App. 15/456,294 · Granted Dec 4, 2018

System and method for semantic segmentation using hybrid dilated convolution (HDC)

Inventors: Zehua Huang (San Diego, CA); Pengfei Chen (San Diego, CA); Panqu Wang (San Diego, CA)
Assignee: TuSimple
G06T7/11B60W50/00G05D1/0088G06K9/4604G06N3/02B60W2420/42B60W2900/00G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,147,193
App. No.
15/456,294
Granted
Dec 4, 2018
Kind
B2
Abstract

A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

Claims (35)

1. A system comprising:

a data processor; and

an image processing module, executable by the data processor, the image processing module being configured to perform semantic segmentation using a hybrid dilated convolution (HDC) operation, the HDC operation being configured to: receive an input image; produce a feature map from the input image;

perform a convolution operation on the feature map and produce multiple convolution layers;

group the multiple convolution layers into a plurality of groups;

apply different dilation rates for different convolution layers in a single group of the plurality of groups; and

apply a same dilation rate setting across all groups of the plurality of groups

wherein the HDC operation is used by an autonomous control subsystem to control a vehicle without a driver.

2. The system of claim 1 wherein the HDC operation is configured to assign increasing dilation rates to the multiple convolution layers.

3. The system of claim 1 wherein the first dilation rate and the second dilation rate do not have a common factor relationship.

4. The system of claim 1 wherein the HDC operation is configured operate within a fully convolutional network (FCN).

5. The system of claim 1 wherein the HDC operation is performed at an original resolution, thereby enabling pixel-level decoding.

6. A method comprising:

receiving an input image;

producing a feature map from the input image;

performing a convolution operation on the feature map and producing multiple convolution layers;

grouping the multiple convolution layers into a plurality of groups;

applying different dilation rates for different convolution layers in a single group of the plurality of groups; and

applying a same dilation rate setting across all groups of the plurality of groups

wherein the method is used by an autonomous control subsystem to control a vehicle without a driver.

7. The method of claim 6 including assigning increasing dilation rates to the multiple convolution layers.

8. The method of claim 6 wherein the first dilation rate and the second dilation rate do not have a common factor relationship.

9. The method of claim 6 wherein the method operates within a fully convolutional network (FCN).

10. The method of claim 6 wherein the method is performed at an original resolution, thereby enabling pixel-level decoding.

11. A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:

receive an input image;

produce a feature map from the input image;

perform a convolution operation on the feature map and produce multiple convolution layers; group the multiple convolution layers into a plurality of groups;

apply different dilation rates for different convolution layers in a single group of the plurality of groups; and

apply a same dilation rate setting across all groups of the plurality of groups

wherein the instructions are further configured to be used with an autonomous control subsystem to control a vehicle without a driver.

12. The non-transitory machine-useable storage medium of claim 11 wherein the instructions are further configured to assign increasing dilation rates to the multiple convolution layers.

13. The non-transitory machine-useable storage medium of claim 11 wherein the first dilation rate and the second dilation rate do not have a common factor relationship.

14. The non-transitory machine-useable storage medium of claim 11 wherein the instructions are further configured to operate within a fully convolutional network (FCN).

15. The non-transitory machine-useable storage medium of claim 11 wherein the instructions are further configured to perform at an original resolution, thereby enabling pixel-level decoding.

Assignments (4)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
CHANGE OF NAME Recorded Jan 30, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051757/0470 →
CHANGE OF NAME Recorded Jan 30, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051754/0828 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2018
From: HUANG, ZEHUA; CHEN, PENGFEI; WANG, PANQU
To: TUSIMPLE
Reel/Frame 044559/0058 →
Continuity (1)
Related Publication 20180260956A1 · Sep 13, 2018
Cited By (12)
US 12,202,492 US 12,228,409 US 12,241,975 US 12,242,967 US 12,270,661 US 12,276,516 US 12,293,668 US 12,352,592 US 12,387,348 US 12,589,776 US 12,639,941 US 12,718,695