IP Library Granted Patent US 10,008,000
Granted Patent B2
US 10,008,000 · App. 15/158,336 · Granted Jun 26, 2018

Camera calibration based on moving vehicle line segments

Inventors: Hao Wu (Pittsford, NY); Robert P. Loce (Webster, NY)
Assignee: Conduent Business Services, LLC
G06T7/248G06T7/33G06T2207/30204G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,008,000
App. No.
15/158,336
Granted
Jun 26, 2018
Kind
B2
Abstract

Systems, methods, apparatus, and computer-implemented methods are provided for determining a camera calibration. The method includes accessing video data for a geographic area captured by a video camera. The video data is processed to detect a plurality of moving vehicles in the video data. A detection area is defined based on the plurality of moving vehicles. A plurality of line segments are identified for each of the plurality of vehicles detected in the video data. A plurality of vanishing points are estimated based on at least a subset of the plurality of line segments. A camera calibration is determined based on the plurality of vanishing points.

Claims (64)

1. A computer-implemented method, comprising:

accessing video data for a geographic area captured by a video camera;

processing the video data to detect a plurality of moving vehicles in the video data;

defining a detection area based on the plurality of moving vehicles;

extracting a plurality of line segments for each of the plurality of vehicles detected in the video data;

estimating a plurality of vanishing points based on at least a subset of the plurality of line segments; and

determining a camera calibration based on the plurality of vanishing points,

wherein extracting a plurality of line segments includes:

detecting a plurality of edges of one of the plurality of vehicles within the detection area; and

identifying straight line segments within the detection area.

2. The computer-implemented method of claim 1 , wherein

identifying the straight line segments comprises identifying the straight line segments using one of a Hough transform and a Line Segment Detector.

3. The computer-implemented method of claim 1 , further comprising

determining an orientation for each of the plurality of line segments; and

grouping line segments into one of a plurality of groups based on the orientation of the line segments.

4. The computer-implemented method of claim 3 , wherein the plurality of groups includes a first group and a second group, the line segments in the first group having line segments that are substantially perpendicular to the line segments of the second group.

5. The computer-implemented method of claim 1 , wherein determining a camera calibration includes:

generating an inverse perspective mapping based on at least two of the vanishing points.

6. The computer-implemented method of claim 1 , wherein the method is performed in the video camera.

7. The computer-implemented method of claim 1 , further comprising:

applying the camera calibration to image data captured by the video camera.

8. An apparatus, comprising:

a memory storing a set of instructions; and

a processor, configured to execute the stored set of instructions to perform operations comprising:

accessing video data for a geographic area captured by a video camera;

processing the video data to detect a plurality of moving vehicles in the video data;

defining a detection area based on the plurality of moving vehicles;

extracting a plurality of line segments for each of the plurality of vehicles detected in the video data;

estimating a plurality of vanishing points based on at least a subset of the plurality of line segments; and

determining a camera calibration based on the plurality of vanishing points,

wherein extracting a plurality of line segments includes:

detecting a plurality of edges of one of the plurality of vehicles within the detection area; and

identifying straight line segments within the detection area.

9. The apparatus of claim 8 , wherein

identifying the straight line segments comprises identifying the straight line segments using one of a Hough transform and a Line Segment Detector.

10. The apparatus of claim 8 , the method further comprising

determining an orientation for each of the plurality of line segments; and

grouping line segments into one of a plurality of groups based on the orientation of the line segments.

11. The apparatus of claim 10 , wherein the plurality of groups includes a first group and a second group, the line segments in the first group having line segments that are perpendicular to the line segments of the second group.

12. The apparatus of claim 8 , wherein determining a camera calibration includes:

generating an inverse perspective mapping based on at least two of the vanishing points.

13. The apparatus of claim 8 , wherein the method is performed in the video camera.

14. The apparatus of claim 8 , the method further comprising:

applying the camera calibration to image data captured by the video camera.

15. A non-transitory computer-readable medium storing a set of instructions, executable by a processor to perform operations comprising:

accessing video data for a geographic area captured by a video camera;

processing the video data to detect a plurality of moving vehicles in the video data;

defining a detection area based on the plurality of moving vehicles;

extracting a plurality of line segments for each of the plurality of vehicles detected in the video data;

estimating a plurality of vanishing points based on at least a subset of the plurality of line segments; and

determining a camera calibration based on the plurality of vanishing points,

wherein extracting a plurality of line segments includes:

detecting a plurality of edges of one of the plurality of vehicles within the detection area; and

identifying straight line segments within the detection area.

16. The computer-readable medium of claim 15 , wherein

identifying the straight line segments comprises identifying the straight line segments using one of a Hough transform and a Line Segment Detector.

17. The computer-readable medium of claim 15 , the method further comprising

determining an orientation for each of the plurality of line segments; and

grouping line segments into one of a plurality of groups based on the orientation of the line segments.

18. The computer-readable medium of claim 17 , wherein the plurality of groups includes a first group and a second group, the line segments in the first group having line segments that are perpendicular to the line segments of the second group.

19. The computer-readable medium of claim 15 , wherein determining a camera calibration includes:

generating an inverse perspective mapping based on at least two of the vanishing points.

20. The computer-readable medium of claim 15 , the method further comprising:

applying the camera calibration to image data captured by the video camera.

Assignments (6)
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
RELEASE OF SECURITY INTEREST Recorded Oct 18, 2021
From: JPMORGAN CHASE BANK, N.A.
To: CONDUENT BUSINESS SERVICES, LLC; CONDUENT STATE & LOCAL SOLUTIONS, INC.; CONDUENT TRANSPORT SOLUTIONS, INC.; ADVECTIS, INC.; CONDUENT COMMERCIAL SOLUTIONS, LLC; CONDUENT BUSINESS SOLUTIONS, LLC; CONDUENT CASUALTY CLAIMS SOLUTIONS, LLC; CONDUENT HEALTH ASSESSMENTS, LLC
Reel/Frame 057969/0180 →
SECURITY AGREEMENT Recorded Apr 23, 2019
From: CONDUENT BUSINESS SERVICES, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 050326/0511 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2017
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 041542/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2016
From: WU, HAO; LOCE, ROBERT P.
To: XEROX CORPORATION
Reel/Frame 038638/0694 →
Continuity (1)
Related Publication 20170337699A1 · Nov 23, 2017