IP Library Granted Patent US 11,303,823
Granted Patent B2
US 11,303,823 · App. 16/808,194 · Granted Apr 12, 2022

Camera array for a mediated-reality system

Inventors: James Andrew Youngquist (Seattle, WA); David Julio Colmenares (Seattle, WA); Adam Gabriel Jones (Seattle, WA)
Assignee: Proprio, Inc.
H04N5/247G02B3/0056G06T7/50G06T7/521G06T7/557G06T19/006H04N5/2252H04N5/2258H04N13/243G06T2207/10028G06T2207/10052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,303,823
App. No.
16/808,194
Granted
Apr 12, 2022
Kind
B2
Abstract

A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.

Claims (51)

1. A mediated-reality system, comprising:

a camera array to capture a plurality of images of a scene, the camera array including:

a rigid frame having walls structured to form a plurality of cells having a substantially same shape;

a plurality of cameras mounted within each of the plurality of cells and arranged in a same pattern within each of the plurality of cells, the plurality of cameras including at least one camera of a first focal length and at least one camera of a second focal length different than the first focal length, wherein the first focal length is longer than the second focal length, and at least one camera of the second focal length within each of the plurality of cells is at a position further from or equidistant from a center point of the camera array relative to cameras of the first focal length;

an input controller to control a position and orientation of a virtual perspective of the scene;

an image processing device to synthesize a virtual image corresponding to the virtual perspective based on the plurality of images of the scene; and

a display device to display the virtual image.

2. The camera array of claim 1 , wherein the camera of the first focal length comprises a 50 mm camera and wherein the camera of the second focal length comprises a 35 mm camera.

3. The camera array of claim 1 , further comprising:

a projector to project structured light onto a scene that within a field of view of the plurality of cameras.

4. The camera array of claim 1 , further comprising:

a depth sensor for sensing depth of a surface of a scene within a field of view of the plurality of cameras.

5. The camera array of claim 1 , further comprising:

a cooling system to provide cooling to the plurality of cameras.

6. The camera array of claim 1 , further comprising a swing arm to position the plurality of cameras in a desired position and orientation.

7. A camera array comprising:

a rigid frame having walls structured to form a plurality of cells having a substantially same shape;

a plurality of cameras mounted within each of the plurality of cells and arranged in a same pattern within each of the plurality of cells, the plurality of cameras including at least one camera of a first focal length and at least one camera of a second type focal length different than the first focal length, wherein the first focal length is longer than the second focal length, and at least one camera of the second type within each of the plurality of cells is at a position further from or equidistant from a center point of the camera array relative to cameras of the first type.

8. The camera array of claim 7 , wherein the camera of the first type comprises a 50 mm camera and wherein the camera of the second type comprises a 35 mm camera.

9. The camera array of claim 7 , further comprising:

a projector to project structured light onto a scene that within a field of view of the plurality of cameras.

10. The camera array of claim 7 , further comprising:

a depth sensor for sensing depth of a surface of a scene within a field of view of the plurality of cameras.

11. The camera array of claim 7 , further comprising:

a cooling system to provide cooling to the plurality of cameras.

12. The camera array of claim 7 , further comprising a swing arm to position the plurality of cameras in a desired position and orientation.

13. A mediated-reality system, comprising:

a camera array to capture a plurality of images of a scene, the camera array including:

a plurality of cells; and

a plurality of cameras mounted within each of the plurality of cells, the plurality of cameras including at least one camera of a first type and at least one camera of a second type different than the first type, wherein the plurality of cameras within each of the plurality of cells are arranged in a triangular grid approximately equidistant from neighboring cameras;

an input controller to control a position and orientation of a virtual perspective of the scene;

an image processing device to synthesize a virtual image corresponding to the virtual perspective based on the plurality of images of the scene; and

a display device to display the virtual image.

14. The mediated-reality system of claim 13 , wherein the at least one camera of the second type within each of the plurality of cells is at a position further from or equidistant from a center point of the camera array relative to cameras of the first type.

15. The mediated-reality system of claim 13 , wherein the at least one camera of the first type has a longer focal length than the at least one camera of the second type.

16. The mediated-reality system array of claim 13 , further comprising:

a projector to project structured light onto a scene that within a field of view of the plurality of cameras.

17. The mediated-reality system of claim 13 , further comprising:

a depth sensor for sensing depth of a surface of a scene within a field of view of the plurality of cameras.

18. The mediated-reality system of claim 13 , further comprising:

a cooling system to provide cooling to the plurality of cameras.

19. A mediated-reality system, comprising:

a camera array to capture a plurality of images of a scene, the camera array including:

a rigid frame having walls structured to form a plurality of cells having a substantially same shape;

a plurality of cameras mounted within each of the plurality of cells and arranged in a same pattern within each of the plurality of cells, the plurality of cameras including at least one camera of a first focal length and at least one camera of a second focal length different than the first focal length, wherein the camera of the first focal length comprises a 50 mm camera and wherein the camera of the second focal length comprises a 35 mm camera;

an input controller to control a position and orientation of a virtual perspective of the scene;

an image processing device to synthesize a virtual image corresponding to the virtual perspective based on the plurality of images of the scene; and

a display device to display the virtual image.

20. A camera array comprising:

a rigid frame having walls structured to form a plurality of cells having a substantially same shape;

a plurality of cameras mounted within each of the plurality of cells and arranged in a same pattern within each of the plurality of cells, the plurality of cameras including at least one camera of a first focal length and at least one camera of a second focal length different than the first focal length, wherein the camera of the first focal length comprises a 50 mm camera and wherein the camera of the second focal length comprises a 35 mm camera.

Assignments (2)
CHANGE OF NAME Recorded Apr 2, 2020
From: ELOUPES, INC.
To: PROPRIO, INC.
Reel/Frame 052302/0939 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: YOUNGQUIST, JAMES ANDREW; COLMENARES, DAVID JULIO; JONES, ADAM GABRIEL
To: ELOUPES, INC.
Reel/Frame 052021/0509 →
Continuity (3)
Continuation 16582855 · Sep 25, 2019
Provisional Application 62737791 · Sep 27, 2018
Related Publication 20200204741A1 · Jun 25, 2020
Cited By (2)
US 12,261,988 US 12,299,907