IP Library Granted Patent US 10,757,390
Granted Patent B2
US 10,757,390 · App. 16/322,958 · Granted Aug 25, 2020

Method for obtaining at least one sub-aperture image being associated with one view

Inventors: Guillaume Boisson (Pleumeleuc, FR); Mozhdeh Seifi (Thorigne-Fouillard, FR); Neus Sabater (Betton, FR)
Assignee: InterDigital CE Patent Holdings
H04N13/156G06T5/50H04N5/22541H04N13/246G06T2200/21G06T2207/10052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,757,390
App. No.
16/322,958
Granted
Aug 25, 2020
Kind
B2
Abstract

In one embodiment, it is proposed a method for obtaining at least one sub-aperture image being associated with one view, from raw light field data corresponding to recorded data by an array of pixels sensors positioned behind an array of micro-lenses in a light field camera, each of said pixel sensor recording a linear mixing of up to four different views. The method is remarkable in that it comprises applying a signal separation process on said raw data by using an inverse of a mixing matrix A, said mixing matrix comprising coefficients that convey weighting information of said up to four different views recorded by a pixel sensor.

Claims (19)

1. A method comprising: recording raw light field data by an array of pixel sensors positioned behind an array of micro-lenses in a light field camera, wherein each pixel sensor records a linear mixing of up to four different views

obtaining at least one sub-aperture image associated with one view by applying a signal separation process on the raw data by using an inverse of a mixing matrix A, wherein the mixing matrix A comprises coefficients that convey weighting information of the up to four different views, and wherein the mixing matrix A is representative of a relationship between the data recorded by the array of pixel sensors and the at least one sub-aperture image.

2. The method according to claim 1 , wherein the coefficients are defined according to positions, in the array of pixels, of micro-lenses images centers.

3. The method according to claim 1 , wherein the applying comprises multiplying the recorded data, represented by a column vector, by the inverse of the mixing matrix A.

4. The method according to claim 1 , wherein the signal separation is a blind signal separation.

5. The method according to claim 1 , wherein the coefficients are obtained by performing a calibration process on the light field camera.

6. A non-transient storage medium storing a computer program comprising a set of computer-executable instructions to implement the method according to claim 1 wherein the instructions are executed by a computer.

7. An electronic device comprising a memory and at least one processor coupled to the memory, wherein the at least one processor is configured to: record raw light field data by an array of pixels sensors positioned behind an array of micro-lenses in a light field camera, wherein each pixel sensor records a linear mixing of up to four different views;

obtain at least one sub-aperture image associated with one view by applying a signal separation process on the raw data by using an inverse of a mixing matrix A, wherein the mixing matrix A comprises coefficients that convey weighting information of the up to four different views, and wherein the mixing matrix A is representative of a relationship between the data recorded by the array of pixel sensors and the at least one sub-aperture image.

8. The electronic device according to claim 7 , wherein the coefficients are defined according to positions, in the array of pixels, of micro-lenses images centers.

9. The electronic device according to claim 7 , wherein the at least one processor is further configured to multiply the recorded data, represented by a column vector, by the inverse of the mixing matrix A.

10. The electronic device according to claim 7 , wherein the signal separation is a blind signal separation.

11. The electronic device according to claim 7 , wherein the at least one processor is further configured to perform a calibration of the light field camera in order to obtain the coefficients.

12. The electronic device according to claim 7 , wherein the coefficients that convey weighting information detail proportion of the up to four different views recorded by the first pixel sensor.

13. The method according to claim 1 , wherein the coefficients that convey weighting information detail proportion of the up to four different views recorded by the first pixel sensor.

14. A method comprising:

recording, by an array of pixel sensors, raw light field data representative of an image through an array of micro-lenses, wherein each pixel sensor of the array of pixel sensors records data comprising a linear mixing of up to four different views of the image;

obtaining at least one sub-aperture image associated with one view of the image by applying a signal separation process on the raw data by using an inverse of a mixing matrix A, wherein the mixing matrix A comprises coefficients that convey weighting information of the up to four different views, and wherein the mixing matrix A is representative of a relationship between the data recorded by the array of pixel sensors and the at least one sub-aperture image.

15. The method according to claim 14 , wherein the coefficients that convey weighting information detail proportion of the up to four different views.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2019
From: THOMSON LICENSING SAS
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 051168/0753 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2019
From: BOISSON, GUILLAUME; SEIFI, MOZHDEH; SABATER, NEUS
To: THOMSON LICENSING
Reel/Frame 049952/0168 →
Priority Claims (1)
EP 16306020 · Aug 5, 2016 · regional
Continuity (1)
Related Publication 20190191142A1 · Jun 20, 2019
Cited By (1)
US 12,236,643