IP Library Granted Patent US 10,943,132
Granted Patent B2
US 10,943,132 · App. 16/380,823 · Granted Mar 9, 2021

Distant on-road object detection

Inventors: Zuoguan Wang (Los Gatos, CA); Qun Gu (San Jose, CA); Jizhang Shan (Los Gatos, CA)
Assignee: Black Sesame International Holding Limited
G06K9/00805G06K9/00798
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,943,132
App. No.
16/380,823
Granted
Mar 9, 2021
Kind
B2
Abstract

A method of distant on-road object detection, comprising, capturing an initial frame of a roadway lane in a direction of travel, detecting lane edges in the initial frame, capturing a subsequent frame of the roadway lane, cropping the subsequent frame based on the detected lane edges of the initial frame resulting in an image patch, detecting an image patch object within the image patch, down-sampling the subsequent frame, detecting a down-sampled object within the down-sampled subsequent frame and merging the detections within the image patch and the detections within the down-sampled subsequent frame.

Claims (29)

1. A method of distant on-road object detection, comprising:

capturing an initial frame of a curved roadway lane in a direction of travel;

detecting lane edges in the initial frame of the curved roadway;

capturing a subsequent frame of the curved roadway lane;

cropping the subsequent frame of the curved roadway based on the detected lane edges of the initial frame of the curved roadway resulting in an image patch;

detecting an image patch object within the image patch;

down-sampling the subsequent frame;

detecting a down-sampled object within the down-sampled subsequent frame; and

merging the detection of the image patch object within the image patch and the detection of the down-sampled object within the down-sampled subsequent frame.

2. The method of distant on-road object detection of claim 1 further comprising finally detecting an object of interest based on the merged detections within the image patch and the down-sampled subsequent frame.

3. The method of distant on-road object detection of claim 1 further comprising resizing the subsequent frame.

4. The method of distant on-road object detection of claim 1 wherein the initial frame is captured at a frame rate of least a 30 fps.

5. The method of distant on-road object detection of claim 1 wherein the initial frame is captured at a resolution of at least 1080p.

6. The method of distant on-road object detection of claim 1 wherein images beyond the image patch are discarded from detection.

7. A system of distant on-road object detection, comprising:

a forward looking camera that; and

captures an initial frame of a curved roadway lane in a direction of travel, and

captures a subsequent frame of the curved roadway lane,

an image analysis unit that;

detects lane edges in the initial frame of the curved roadway;

crops the subsequent frame of the curved roadway based on the detected lane edges of the initial frame of the curved roadway resulting in an image patch;

detects an image patch object within die image patch;

down-samples the subsequent frame;

detects a down-sampled object within the down-sampled subsequent frame; and

merges the detection of the merge patch object within the image patch and the detection of the down-sampled object within the down-sampled subsequent frame.

8. The system of distant on-road object detection of claim 7 wherein the image analysis unit further finally detects an object of interest based on the merged detections within the image patch and the down-sampled subsequent frame.

9. The system of distant on-road object detection of claim 8 wherein the forward looking camera captures the frame at a frame rate of at least 30 fps.

10. The system of distant on-road object detection of claim 9 wherein the forward looking camera captures the frame at a resolution of at least 1080p.

11. The system of distant on-road object detection of claim 10 wherein the forward looking camera discards from detection images beyond the image patch.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: BLACK SESAME INTERNATIONAL HOLDING LIMITED
To: BLACK SESAME TECHNOLOGIES INC.
Reel/Frame 058301/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2019
From: WANG, ZUOGUAN; GU, QUN; SHAN, JIZHANG
To: BLACK SESAME INTERNATIONAL HOLDING LIMITED
Reel/Frame 050159/0821 →
Continuity (1)
Related Publication 20200327339A1 · Oct 15, 2020
Cited By (16)
US 12,198,396 US 12,216,610 US 12,223,428 US 12,236,689 US 12,307,350 US 12,346,816 US 12,367,405 US 12,455,739 US 12,462,575 US 12,522,243 US 12,536,131 US 12,554,467 US 12,591,240 US 12,618,976 US 12,623,691 US 12,709,294