IP Library › Granted Patent US 9,947,111
Granted Patent B2
US 9,947,111 · App. 14/925,465 · Granted Apr 17, 2018

Method of multiple camera positioning utilizing camera ordering

Inventors: Cheng-Yi Liu (San Jose, CA); Alexander Berestov (San Jose, CA)
Assignee: Sony Corporation
G06T7/73G06K9/209G06K9/4671G06T7/33G06T7/80G06T7/97H04N17/002G06T2207/10016G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,947,111
App. No.
14/925,465
Granted
Apr 17, 2018
Kind
B2
Abstract

A method to position multiple camera using camera ordering is described herein. Based on two known camera positions, a third camera position is able to be determined using acquired information and calculations.

Claims (52)

1. A method programmed in a non-transitory memory of a device comprising:

a. obtaining camera ordering of a plurality of cameras;

b. selecting and positioning an initial camera pair of the plurality of cameras; and

c. estimating a camera position of a camera not in the initial camera pair of the plurality of cameras using the camera ordering of the plurality of cameras, wherein the camera position is estimated utilizing a distance test, a ratio test and an epipolar line test, wherein the distance test, the ratio test and the epipolar line test are all used to remove outlier information, wherein a binary map stores neighboring camera information, wherein each row of the binary map represents neighboring cameras of the camera.

2. The method of claim 1 further comprising assuming the plurality of cameras are positioned toward an object so positions of the plurality of cameras form a circle or a convex arc.

3. The method of claim 1 wherein a position of the initial camera pair is known.

4. The method of claim 1 wherein estimating the camera position of the camera not in the initial camera pair utilizes five local correspondences between each of three camera pairs.

5. The method of claim 1 wherein estimating the camera position of the camera not in the initial camera pair is based on a 5-point essential matrix estimation.

6. The method of claim 1 wherein estimating the camera position of the camera not in the initial camera pair is based on a matrix and an 8-point algorithm.

7. The method of claim 1 wherein estimating the camera position of the camera not in the initial camera pair includes bundle adjust after each estimate of the camera position.

8. The method of claim 1 wherein obtaining camera ordering comprises:

i. performing background extraction;

ii. performing pairwise camera correspondence extraction;

iii. identifying neighboring cameras;

iv. determining neighboring camera positioning; and

v. performing camera list topology deduction.

9. A system comprising:

a. a plurality of camera devices each configured for capturing video content; and

b. a computing device configured for:

i. obtaining camera ordering of the plurality of cameras;

ii. selecting and positioning an initial camera pair of the plurality of cameras; and

iii. estimating a camera position of a camera not in the initial camera pair of the plurality of cameras using the camera ordering of the plurality of cameras, wherein the camera position is estimated utilizing a distance test, a ratio test and an epipolar line test, wherein the distance test, the ratio test and the epipolar line test are all used to remove outlier information, wherein a binary map stores neighboring camera information, wherein each row of the binary map represents neighboring cameras of the camera.

10. The system of claim 9 wherein the computing device is further configured for assuming the plurality of cameras are positioned toward an object so positions of the plurality of cameras form a circle or a convex arc.

11. The system of claim 9 wherein a position of the initial camera pair is known.

12. The system of claim 9 wherein estimating the camera position of the camera not in the initial camera pair utilizes five local correspondences between each of three camera pairs.

13. The system of claim 9 wherein estimating the camera position of the camera not in the initial camera pair is based on a 5-point essential matrix estimation.

14. The system of claim 9 wherein estimating the camera position of the camera not in the initial camera pair is based on a matrix and an 8-point algorithm.

15. The system of claim 9 wherein estimating the camera position of the camera not in the initial camera pair includes bundle adjust after each estimate of the camera position.

16. The system of claim 9 wherein obtaining camera ordering comprises:

(1) performing background extraction;

(2) performing pairwise camera correspondence extraction;

(3) identifying neighboring cameras;

(4) determining neighboring camera positioning; and

(5) performing camera list topology deduction.

17. An apparatus comprising:

a. a non-transitory memory for storing an application, the application for:

i. obtaining camera ordering of a plurality of cameras;

ii. selecting and positioning an initial camera pair of the plurality of cameras; and

iii. estimating a camera position of a camera not in the initial camera pair of the plurality of cameras using the camera ordering of the plurality of cameras, wherein the camera position is estimated utilizing a distance test, a ratio test and an epipolar line test to remove outlier information, wherein the distance test removes correspondences with descriptor matching scores below a threshold, wherein the ratio test determines two matches with minimum distances for a keypoint, and wherein the epipolar line test utilizes geometry constraints and statistics of correspondences, wherein a binary map stores neighboring camera information, wherein each row of the binary map represents neighboring cameras of the camera; and

b. a processor coupled to the memory, the processor configured for processing the application.

18. The apparatus of claim 17 wherein the application is further for assuming the plurality of cameras are positioned toward an object so positions of the plurality of cameras form a circle or a convex arc.

19. The apparatus of claim 17 wherein a position of the initial camera pair is known.

20. The apparatus of claim 17 wherein estimating the camera position of the camera not in the initial camera pair utilizes five local correspondences between each of three camera pairs.

21. The apparatus of claim 17 wherein estimating the camera position of the camera not in the initial camera pair is based on a 5-point essential matrix estimation.

22. The apparatus of claim 17 wherein estimating the camera position of the camera not in the initial camera pair is based on a matrix and an 8-point algorithm.

23. The apparatus of claim 17 wherein estimating the camera position of the camera not in the initial camera pair includes bundle adjust after each estimate of the camera position.

24. The apparatus of claim 17 wherein obtaining camera ordering comprises:

(1) performing background extraction;

(2) performing pairwise camera correspondence extraction;

(3) identifying neighboring cameras;

(4) determining neighboring camera positioning; and

(5) performing camera list topology deduction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2015
From: LIU, CHENG-YI; BERESTOV, ALEXANDER
To: SONY CORPORATION
Reel/Frame 037382/0161 →
Continuity (1)
Related Publication 20170124712A1 · May 4, 2017