IP Library › Granted Patent US 9,330,436
Granted Patent B2
US 9,330,436 · App. 14/308,495 · Granted May 3, 2016

Multi-camera array with adjacent fields of view

Inventors: Timothy MacMillan (Woodside, CA); Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
G06T3/0093G06T3/0068G06T3/4038G06T5/006G06T5/50G06T7/0026G06T7/0032H04N5/2253H04N5/2257H04N5/2258H04N5/23216H04N5/23229H04N5/23232H04N5/23238H04N5/247H04N5/2628H04N5/3415G06T2207/10004G06T2207/20128G06T2207/20221G06T2210/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,330,436
App. No.
14/308,495
Granted
May 3, 2016
Kind
B2
Abstract

Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Claims (36)

1. An apparatus comprising:

a common outer lens;

a plurality of cameras in a camera array, each camera including a plurality of lenses, an image sensor, and a housing securing the plurality of lenses and image sensor such that, for each camera of the plurality of cameras, light passing through the common outer lens and through an aperture of the camera is directed by the plurality of lenses to be incident upon the image sensor;

wherein each camera in the plurality of cameras is oriented at a pitch, roll, and yaw such that an image captured by a first camera in the plurality of cameras comprises an overlapping portion with at least one other camera in the plurality of cameras when images are synchronously captured by the plurality of cameras, and such that each camera in the plurality of cameras faces in a direction that converges in at least one dimension with a direction faced by at least one other camera in the plurality of cameras, wherein the pitch is greater than 60 degrees and less than 80 degrees.

2. The apparatus of claim 1 , wherein the camera array is a 2×1 camera array including two cameras.

3. The apparatus of claim 1 , wherein the camera array is a 2×2 camera array including four cameras.

4. The apparatus of claim 1 , wherein each camera in the plurality of cameras in the camera array include a housing mold, wherein an outer layer of the housing mold is less than 5 mm from inner components within the housing mold, the inner components including a plurality of lenses and an image sensor.

5. The apparatus of claim 1 , wherein the common outer lens is a cone lens.

6. The apparatus of claim 1 , wherein the common outer lens is a ball lens.

7. The apparatus of claim 1 , wherein a first camera is coupled adjacent to a second camera, wherein an edge of the first camera is substantially parallel to a corresponding edge of the second camera, and wherein the front surface of the first and second cameras are rotated inwards at the respective pitch, roll and yaw of the first and second cameras such that a substantial center of a forward-most lens for each of the first and second cameras are within a threshold distance.

8. The apparatus of claim 7 , wherein the threshold distance is 5 mm.

9. The apparatus of claim 1 , wherein vectors normal to each forward-most lens of each pair of cameras in the plurality of cameras intersect within an overlapping field of view of the pair of cameras.

10. An apparatus comprising:

a common outer lens;

a plurality of cameras in a camera array, each camera including a plurality of lenses, an image sensor, and a housing securing the plurality of lenses and image sensor such that, for each camera of the plurality of cameras, light passing through the common outer lens and through an aperture of the camera is directed by the plurality of lenses to be incident upon the image sensor;

wherein each camera in the plurality of cameras is oriented at a pitch, roll, and yaw such that an image captured by a first camera in the plurality of cameras comprises an overlapping portion with at least one other camera in the plurality of cameras when images are synchronously captured by the plurality of cameras, and such that each camera in the plurality of cameras faces in a direction that converges in at least one dimension with a direction faced by at least one other camera in the plurality of cameras, wherein the roll is greater than 30 degrees and less than 50 degrees.

11. The apparatus of claim 10 , wherein the camera array is a 2×1 camera array including two cameras.

12. The apparatus of claim 10 , wherein the camera array is a 2×2 camera array including four cameras.

13. The apparatus of claim 10 , wherein each camera in the plurality of cameras in the camera array include a housing mold, wherein an outer layer of the housing mold is less than 5 mm from inner components within the housing mold, the inner components including a plurality of lenses and an image sensor.

14. The apparatus of claim 10 , wherein the common outer lens is a cone lens.

15. The apparatus of claim 10 , wherein the common outer lens is a ball lens.

16. The apparatus of claim 10 , wherein a first camera is coupled adjacent to a second camera, wherein an edge of the first camera is substantially parallel to a corresponding edge of the second camera, and wherein the front surface of the first and second cameras are rotated inwards at the respective pitch, roll and yaw of the first and second cameras such that a substantial center of a forward-most lens for each of the first and second cameras are within a threshold distance.

17. The apparatus of claim 16 , wherein the threshold distance is 5 mm.

18. The apparatus of claim 10 , wherein vectors normal to each forward-most lens of each pair of cameras in the plurality of cameras intersect within an overlapping field of view of the pair of cameras.

19. An apparatus comprising:

a common outer lens;

a plurality of cameras in a camera array, each camera including a plurality of lenses, an image sensor, and a housing securing the plurality of lenses and image sensor such that, for each camera of the plurality of cameras, light passing through the common outer lens and through an aperture of the camera is directed by the plurality of lenses to be incident upon the image sensor;

wherein each camera in the plurality of cameras is oriented at a pitch, roll, and yaw such that an image captured by a first camera in the plurality of cameras comprises an overlapping portion with at least one other camera in the plurality of cameras when images are synchronously captured by the plurality of cameras, and such that each camera in the plurality of cameras faces in a direction that converges in at least one dimension with a direction faced by at least one other camera in the plurality of cameras, wherein the yaw is greater than 60 degrees and less than 80 degrees.

20. The apparatus of claim 19 , wherein the camera array is a 2×1 camera array including two cameras.

21. The apparatus of claim 19 , wherein the camera array is a 2×2 camera array including four cameras.

22. The apparatus of claim 19 , wherein each camera in the plurality of cameras in the camera array include a housing mold, wherein an outer layer of the housing mold is less than 5 mm from inner components within the housing mold, the inner components including a plurality of lenses and an image sensor.

23. The apparatus of claim 19 , wherein the common outer lens is a cone lens.

24. The apparatus of claim 19 , wherein the common outer lens is a ball lens.

25. The apparatus of claim 19 , wherein a first camera is coupled adjacent to a second camera, wherein an edge of the first camera is substantially parallel to a corresponding edge of the second camera, and wherein the front surface of the first and second cameras are rotated inwards at the respective pitch, roll and yaw of the first and second cameras such that a substantial center of a forward-most lens for each of the first and second cameras are within a threshold distance.

26. The apparatus of claim 25 , wherein the threshold distance is 5 mm.

27. The apparatus of claim 19 , wherein vectors normal to each forward-most lens of each pair of cameras in the plurality of cameras intersect within an overlapping field of view of the pair of cameras.

Assignments (4)
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY AGREEMENT Recorded Aug 29, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 039851/0611 →
SECURITY AGREEMENT Recorded Mar 28, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038184/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2014
From: MACMILLAN, TIMOTHY; CAMPBELL, SCOTT PATRICK
To: GOPRO, INC.
Reel/Frame 033447/0768 →
Continuity (4)
Provisional Application 61973788 · Apr 1, 2014
Provisional Application 61979386 · Apr 14, 2014
Provisional Application 61985256 · Apr 28, 2014
Related Publication 20150281590A1 · Oct 1, 2015