IP Library Granted Patent US 9,736,374
Granted Patent B2
US 9,736,374 · App. 14/031,128 · Granted Aug 15, 2017

Video/vision based access control method and system for parking occupancy determination, which is robust against camera shake

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,736,374
App. No.
14/031,128
Granted
Aug 15, 2017
Kind
B2
Abstract

Methods and systems for parking lot occupancy determination. Video of an entrance to a parking lot (or other facility) can be acquired utilizing one or more video cameras focusing on a pre-defined vision-based region of interest and a pre-defined video-based region of interest. The video can be video processed via a classifier that is pre-trained to take into account potential camera shake disturbances to generate video output data thereof. The video output data can then be trajectory smoothed. The video output data (following trajectory smoothing) can then be analyzed for parking lot occupancy data such that the impact of camera shake with respect to the video camera(s) is minimized to determine parking lot occupancy.

Claims (47)

1. A method for parking occupancy determination, said method comprising:

acquiring video of an entrance to a parking lot utilizing at least one video camera focusing on a computer vision-based region of interest for vehicle validation and a video-based region of interest for motion detecting and tracking;

video processing said video via at least one classifier trained with data collected from said parking lot and to take into account potential camera shake disturbances to generate video output data thereof, wherein said at least one classifier comprises at least one computer vision-based image content classifier;

analyzing said video output data for parking lot occupancy data, wherein an impact of camera shake with respect to said at least one video camera is minimized to determine parking lot occupancy;

determining an access type with respect to said parking lot based on said parking lot occupancy data, after analyzing said video output data for said parking lot occupancy data;

configuring said at least one classifier to comprise said computer vision-based image content classifier that performs image content classification for the computer vision-based region of interest and assists in object tracking with respect to said video-based region of interest;

applying distortions that simulate camera shake effects with respect to at least one image frame;

cropping said at least one image frame at an original region of interest after said applying said distortions that simulate said camera shake effects with respect to said at least one image frame;

incorporating said potential camera shake disturbances into training of said at least one classifier used for computer vision-based processing for said computer vision-based region of interest for vehicle validation and used for trajectory smoothing said video output data to remove an impact of high-frequency components during said camera shake disturbances;

measuring changes in a field of view of said video using template matching between templates derived from at least one original scene and at least one current scene with motion removed; and

employing said changes measured in said field of view to adjust data indicative of at least one region of interest for computer vision-based processing thereof if said changes measured are above a pre-determined threshold so that an impact of said changes with respect so said field of view to performance is minimized and determine said parking lot occupancy.

2. The method of claim 1 wherein said video processing said video further comprises video processing said video via a data-processing system comprising a server.

3. The method of claim 2 further comprising:

tracking at least one vehicle within said video of said entrance to said parking lot utilizing said at least one classifier.

4. The method of claim 2 further comprising:

tracking at least one vehicle within said video of said entrance to said parking lot utilizing said at least one classifier; and

wherein video processing said video via said at least one classifier further comprises: video processing said video at said video-based region of interest for motion detecting and tracking, if motion is detected within said computer vision-based region of interest for vehicle validation.

5. The method of claim 1 wherein said video processing said video further comprises video processing said video via a data-processing system comprising a smartphone or a tablet computing device.

6. The method of claim 1 further comprising tracking at least one vehicle within said video of said entrance to said parking lot utilizing said at least one classifier.

7. The method of claim 6 wherein video processing said video via said at least one classifier further comprises:

video processing said video at said video-based region of interest for motion detecting and tracking, if motion is detected within said computer vision-based region of interest for vehicle validation.

8. The method of claim 7 further comprising analyzing said video for a vehicle trajectory of said at least one vehicle to provide an indication of whether or not said at least one vehicle is entering or exiting said parking lot.

9. The method of claim 7 further comprising training said at least one classifier based on pulled samples indicative of camera shake in scope to include said potential camera shake disturbances into said at least one classifier.

10. The method of claim 9 further comprising:

randomly moving, rotating, scaling, and warping said computer vision-based region of interest for vehicle validation; and

cropping said training samples to capture samples indicative of said camera shake.

11. The method of claim 10 further comprising manipulating distortion parameters to generate a plurality of varying levels of simulated camera shake samples for use as said training samples.

12. A system for parking occupancy determination, said system comprising:

a processor; and

a computer-usable medium embodying computer program code, said computer-usable medium capable of communicating with the processor, said computer program code comprising instructions executable by said processor and configured for:

acquiring video of an entrance to a parking lot utilizing at least one video camera focusing on a computer vision-based region of interest for vehicle validation and a video-based region of interest for motion detecting and tracking;

video processing said video via at least one classifier trained with data collected from said parking lot and to take into account potential camera shake disturbances to generate video output data thereof, wherein said at least one classifier comprises at least one computer vision-based image content classifier;

tracking at least one vehicle within said video of said entrance to said parking lot utilizing said at least one classifier:

analyzing said video output data for parking lot occupancy data, wherein an impact of camera shake with respect to said at least one video camera is minimized to determine parking lot occupancy;

determining an access type with respect to said parking lot based on said parking lot occupancy data, after analyzing said video output data for said parking lot occupancy data;

incorporating said potential camera shake level considerations into training of said at least one classifier used for computer vision-based processing for said computer vision-based region of interest for vehicle validation and used for trajectory smoothing said video output data to remove an impact of high-frequency components in said camera shake;

video processing said video at said pre-defined video-based region of interest for motion detection and tracking, if motion is detected within said pre-defined vision-based region of interest;

analyzing said video for a vehicle trajectory of said at least one vehicle to determine if said at least one vehicle is entering or exiting said parking lot;

training said at least one classifier based on pulled samples indicative of camera shake in scone to include said potential camera shake disturbances into said at least one classifier;

deriving new pixel locations with respect to said computer vision-based region of interest for said vehicle validation if a determined amount exceeds a pre-determined threshold, and if said amount does not exceed said pre-determined threshold, leave pixel locations unchanged with respect to said computer vision-based region of interest for vehicle validation;

wherein said computer vision-based region of interest for vehicle validation is contained within said video-based region of interest for motion detecting and tracking;

randomly moving, rotating, scaling, and warping said computer vision-based region of interest; and

cropping said training samples to capture said samples indicative of said camera shake.

13. The system of claim 12 further comprising a data-processing system comprising said processor that communicates with an HDD (Hard Disk Drive).

14. The system of claim 12 further comprising a data-processing system comprising a server comprising said processor.

15. The system of claim 12 further comprising a tablet computing device comprising said processor or a smartphone comprising said processor.

16. The system of claim 12 wherein said instructions are further configured for manipulating distortion parameters to generate a plurality of varying levels of simulated camera shake samples for use as said training samples.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2024
From: CONDUENT BUSINESS SERVICES, LLC; CONDUENT STATE & LOCAL SOLUTIONS, INC.
To: MODAXO ACQUISITION USA INC. N/K/A MODAXO TRAFFIC MANAGEMENT USA INC.
Reel/Frame 069110/0888 →
PARTIAL RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 2, 2024
From: BANK OF AMERICA, N.A.
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 067302/0649 →
RELEASE OF SECURITY INTEREST Recorded May 2, 2024
From: U.S. BANK TRUST COMPANY
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 067305/0265 →
SECURITY INTEREST Recorded May 1, 2024
From: MODAXO TRAFFIC MANAGEMENT USA INC.
To: BANK OF MONTREAL
Reel/Frame 067288/0512 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2017
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 041542/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2013
From: WU, WENCHENG
To: XEROX CORPORATION
Reel/Frame 031237/0950 →