IP Library Granted Patent US 10,250,866
Granted Patent B1
US 10,250,866 · App. 15/387,477 · Granted Apr 2, 2019

Systems and methods for capturing light field of objects

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,250,866
App. No.
15/387,477
Granted
Apr 2, 2019
Kind
B1
Abstract

A set of light field sensors may generate light field output signals conveying light field information within fields of view of the set of light field sensors. The generation of the light field outputs signals may be characterized by a subpixel accuracy. The subpixel accuracy may be enabled by a physical link between the set of light field sensors. The fields of view of the set of light field sensors may overlap over an overlap volume. An object may be located within the overlap volume. The light field information characterizing light field emanating from the object may be combined.

Claims (54)

1. A system for capturing light field of objects, the system comprising:

a set of light field sensors configured to generate light field output signals conveying light field information within fields of view of the set of light field sensors, the fields of view of the set of light field sensors inwardly directed such that the fields of view overlap over an overlap volume, the set of light field sensor surrounding the overlap volume, the generation of the light field output signals by the set of light field sensors characterized by a subpixel accuracy, the subpixel accuracy enabled by a physical link between the set of light field sensors, wherein the set of light field sensors includes:

a first light field sensor configured to generate first light field output signals conveying first light field information within a first field of view; and

a second light field sensor configured to generate second light field output signals conveying second light field information within a second field of view; and one or more physical processors configured by machine-readable instructions to:

obtain first object light field information based on the first light field information, the first object light field information characterizing first light field emanating from an object entirely located within the overlap volume, wherein the first object light field information is determined based on distinguishing the first light field emanating from the object from other light field emanating from one or more other objects;

obtain second object light field information based on the second light field information, the second object light field information characterizing second light field emanating from the object entirely located within the overlap volume;

generate a combined object light field information based on the first object light field information and the second object light field information; and

present a view of the object on a display based on the combined object light field information, wherein presenting the view of the object on the display includes:

determining a location of view for the object; and

determining the view of the object based on the location of view for the object and the combined object light field information.

2. The system of claim 1 , wherein the view of the object is presented on the display without a use of a point cloud or a texture.

3. The system of claim 1 , wherein the set of light field sensors are arranged in a spherical configuration.

4. The system of claim 1 , wherein the set of light field sensors are arranged in a polyhedron configuration.

5. The system of claim 1 , wherein the set of light field sensors are arranged in a cubic configuration.

6. The system of claim 1 , wherein the combined object light field information characterizes 360 degrees of light field emanating from the object entirely located within the overlap volume.

7. The system of claim 1 , wherein:

the object includes a moving object;

the first object light field information characterizes the first light field emanating from the moving object; and

the second object light field information characterizes the second light field emanating from the moving object.

8. A method for capturing light field of objects, the method comprising:

generating light field output signals conveying light field information within fields of view of a set of light field sensors, the fields of view of the set of light field sensors inwardly directed such that the fields of view overlap over an overlap volume, the set of light field sensor surrounding the overlap volume, the generation of the light field output signals characterized by a subpixel accuracy, the subpixel accuracy enabled by a physical link between the set of light field sensors, wherein generating the light field output signals includes:

generating first light field output signals conveying first light field information within a first field of view of a first light field sensor; and

generating second light field output signals conveying second light field information within a second field of view of a second light field sensor;

obtaining first object light field information based on the first light field information, the first object light field information characterizing first light field emanating from an object entirely located within the overlap volume, wherein the first object light field information is determined based on distinguishing the first light field emanating from the object from other light field emanating from one or more other objects;

obtaining second object light field information based on the second light field information, the second object light field information characterizing second light field emanating from the object entirely located within the overlap volume;

generating a combined object light field information based on the first object light field information and the second object light field information; and

presenting a view of the object on a display based on the combined object light field information, wherein presenting the view of the object on the display includes:

determining a location of view for the object; and

determining the view of the object based on the location of view for the object and the combined object light field information.

9. The method of claim 8 , wherein the view of the object is presented on the display without a use of a point cloud or a texture.

10. The method of claim 8 , wherein the set of light field sensors are arranged in a spherical configuration.

11. The method of claim 8 , wherein the set of light field sensors are arranged in a polyhedron configuration.

12. The method of claim 8 , wherein the set of light field sensors are arranged in a cubic configuration.

13. The method of claim 8 , wherein the combined object light field information characterizes 360 degrees of light field emanating from the object entirely located within the overlap volume.

14. The method of claim 8 , wherein:

the object includes a moving object;

the first object light field information characterizes the first light field emanating from the moving object ; and

the second object light field information characterizes the second light field emanating from the moving object.

15. The system of claim 1 , wherein:

the first light field sensor is positioned to left of the second light field sensor;

the location of view for the object is positioned in between and front of the first light field sensor and the second light field sensor;

the view of the object is determined without use of a point cloud or a texture of the object and based on:

a first light ray emanating from a right side of the object, the first light ray captured by the first light field sensor; and

a second light ray emanating from a left side of the object, the second light ray captured by the second light field sensor.

16. The system of claim 1 , wherein the first light field emanating from the object is distinguished from the other light field emanating from the one or more other objects based on colors, intensities, or angular directions of light rays within the first light field and the other light field.

17. The system of claim 1 , wherein the first light field emanating from the object is distinguished from the other light field emanating from the one or more other objects based on locations of origination of the first light field and the other light field.

18. The method of claim 8 , wherein:

the first light field sensor is positioned to left of the second light field sensor;

the location of view for the object is positioned in between and front of the first light field sensor and the second light field sensor;

the view of the object is determined without use of a point cloud or a texture of the object and based on:

a first light ray emanating from a right side of the object, the first light ray captured by the first light field sensor; and

a second light ray emanating from a left side of the object, the second light ray captured by the second light field sensor.

19. The method of claim 8 , wherein the first light field emanating from the object is distinguished from the other light field emanating from the one or more other objects based on colors, intensities, or angular directions of light rays within the first light field and the other light field.

20. The method of claim 1 , wherein the first light field emanating from the object is distinguished from the other light field emanating from the one or more other objects based on locations of origination of the first light field and the other light field.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Jun 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 049454/0352 →
SECURITY INTEREST Recorded Jul 31, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 043380/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2017
From: JENNY, ALEXANDRE
To: GOPRO, INC.
Reel/Frame 043062/0226 →