IP Library Granted Patent US 10,867,192
Granted Patent B1
US 10,867,192 · App. 16/533,422 · Granted Dec 15, 2020

Real-time robust surround view parking space detection and tracking

Inventors: Yilin Song (San Jose, CA); Zuoguan Wang (Los Gatos, CA); Qun Gu (San Jose, CA)
Assignee: Black Sesame International Holding Limited
G06K9/00812G06K9/00798G06K9/622H04N5/2253H04N5/23238B60R11/04G06K2209/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,867,192
App. No.
16/533,422
Granted
Dec 15, 2020
Kind
B1
Abstract

A method of parking lot tracking including receiving a plurality of camera images from a plurality of cameras attached to a vehicle in motion, stitching the plurality of camera images to simulate a surround view of the vehicle, recognizing at least one potential parking space within the surround view of the vehicle, estimating a motion parameter by camera motion estimation of the plurality of cameras and tracking the at least one potential parking space based on the motion parameter.

Claims (38)

1. A method, comprising:

receiving a plurality of camera images from a plurality of cameras attached to a vehicle in motion;

stitching the plurality of camera images to simulate a surround view of the vehicle;

recognizing at last one potential parking space within the surround view of the vehicle;

determining an available free-space via the surround view of the vehicle to indicate which area is safest to drive to the at last one potential parking space;

determining a percentage of free-space within the at last one potential parking space to indicate whether the at last one potential parking space is available;

estimating a motion parameter by camera motion estimation of the plurality of cameras;

tracking the at last one potential parking space based on the motion parameter to indicate a relative position of the vehicle and the at last one potential parking space as tracklets;

determining a location of the at least one potential parking space;

determining an amount of free space surrounding the at last one potential parking space;

determining a direction from a vehicle location to the at last one potential parking space;

determining a distance from the vehicle location to the at last one potential parking space;

determining two entrance corners of the at least one potential parking space; and

clustering the at least one potential parking space into a set of clusters indicating entrance points.

2. The method of claim 1 , further comprising updating the location of the at last one potential parking space based on the camera motion estimation.

3. The method of claim 1 , further comprising determining a stopping point from the vehicle location to the at last one potential parking space.

4. The method of claim 1 , further comprising segmenting the set of clusters of the at last one potential parking space.

5. The method of claim 4 , further comprising ranking the set of clusters based on combinatorial optimization.

6. The method of claim 5 , further comprising selecting one of the set of clusters based on distance thresholding.

7. A non-transitory computer readable medium comprising instructions that, when read by a processor, cause the processor to perform:

receiving a plurality of camera images from a plurality of cameras attached to a vehicle in motion;

stitching the plurality of camera images to simulate a surround view of the vehicle;

recognizing at last one potential parking space within the surround view of the vehicle;

determining an available free-space via the surround view of the vehicle to indicate which area is safest to drive to the at last one potential parking space;

determining a percentage of free-space within the at last one potential parking space to indicate whether the at last one potential parking space is available;

estimating a motion parameter by camera motion estimation of the plurality of cameras;

tracking the at last one potential parking space based on the motion parameter to indicate a relative position of the vehicle and the at last one potential parking space as tracklets;

determining a location of the at last one potential parking space;

determining an amount of free space surrounding the at last one potential parking space;

determining a direction from a vehicle location to the at last one potential parking space;

determining a distance from the vehicle location to the at last one potential parking space;

determining two entrance corners of the at last one potential parking space;

clustering the at last one potential parking space into a set of clusters indicating entrance points; and

selecting one of the set of clusters based on distance thresholding.

8. The non-transitory computer readable medium of claim 7 , further comprising segmenting the set of clusters of the at last one potential parking space.

9. The non-transitory computer readable medium of claim 8 , further comprising ranking the set of clusters based on combinatorial optimization.

10. The non-transitory computer readable medium of claim 9 , wherein the ranking is based on a Hungarian algorithm.

11. The non-transitory computer readable medium of claim 7 , wherein the surround view of the vehicle is a bird's eye view.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: BLACK SESAME INTERNATIONAL HOLDING LIMITED
To: BLACK SESAME TECHNOLOGIES INC.
Reel/Frame 058301/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2019
From: SONG, YILIN; WANG, ZUOGUAN; GU, QUN
To: BLACK SESAME INTERNATIONAL HOLDING LIMITED
Reel/Frame 050159/0827 →