Method for obtaining a refocused image from a 4D raw light field data using a shift correction parameter
View Patent ↗A method for obtaining a refocused image from a 4D raw light field data for a given focus (z focus ) is described. The method is remarkable in that it comprises applying a shift correction parameter on shifted and summed images from said 4D raw light field data, the shifted and summed images being defined as a function of the given focus (z focus ), and the shift correction parameter (Δ) including, for at least a part of pixels of at least two sub-aperture images derived from at least one 4D light field data of a test-chart image, determined shifts for pixels belonging to the part of pixels between the at least two sub-aperture images, the test-chart image comprising patterns adequate to compute disparities between the sub-apertures images.
1. A method for obtaining a refocused image from a 4D raw light field data for a given focus (z focus ), the method being characterized in that it comprises applying a shift correction parameter on shifted and summed images from said 4D raw light field data, said shifted and summed images being defined as a function of said given focus (z focus ), and said shift correction parameter (Δ) comprising, for at least a part of pixels of at least two sub-aperture images derived from at least one 4D light field data of a test-chart image, determined shifts for pixels belonging to said part of pixels between said at least two sub-aperture images, said test-chart image chosen to be textured and comprising patterns adequate to compute disparities between said sub-apertures images ensuring robustness of a shift estimation.
2. The method according to claim 1 , wherein said determined shifts are obtained by a patch based shift estimation method that uses an expected shift ((uρ, vρ)) between pixels of said at least two sub-aperture images.
3. The method according to claim 1 , wherein said shifted and summed images correspond to shifted and summed sub-aperture images.
4. The method according to claim 1 , wherein said shifted and summed images correspond to on shifted and summed micro-lens images.
5. The method according to claim 1 , wherein said test chart image comprises locally contrasted textures visible on most of area of said at least two sub-aperture images derived from said 4D light field data of a test-chart image.
6. The method according to claim 1 , wherein said shift correction parameter is correlated to a main lens aberration, said main lens being comprised in a device that has acquired said 4D light field data of a test-chart image.
7. The method according to claim 6 , wherein said aberration is a spherical aberration.
8. The method according to claim 6 , wherein said aberration is a chromatic aberration.
9. The method according to claim 1 , wherein shift correction parameter is represented by a polynomial function.
10. The method according to claim 1 , wherein said at least two sub-aperture images derived from at least one 4D light field data of a test-chart image are further derived from 4D light field data of a white image for a normalization process.
11. The method according to claim 1 , wherein said shift correction parameter is further used on zoomed images derived from said 4D raw light field data.
12. The method according to claim 1 , wherein said shift correction parameter (Δ) comprises, for all the pixels of all sub-aperture images derived from at least one 4D light field data of a test-chart image, determined shifts for all the pixels.
13. A computer-readable and non-transient storage medium storing a computer program comprising a set of computer-executable instructions to implement a method for processing 4D raw light field data when the instructions are executed by a computer, wherein the instructions comprise instructions, which when executed, configure the computer to perform the method of claim 1 .
14. An electronic device for obtaining a refocused image from a 4D raw light field data for a given focus (z focus ), the electronic device being characterized in that it comprises a module for applying a shift correction parameter on shifted and summed images from said 4D raw light field data, said shifted and summed images being defined as a function of said given focus (z focus ), and said shift correction parameter (Δ) comprising, for at least a part of pixels of at least two sub-aperture images derived from at least one 4D light field data of a test-chart image, determined shifts for pixels belonging to said part of pixels between said at least two sub-aperture images, said test-chart image chosen to be textured and comprising patterns adequate to compute disparities between said sub-apertures images ensuring robustness of a shift estimation.
15. A method for calibrating a plenoptic camera, the method being characterized in that it comprises
acquiring a 4 D light field data of a test-chart image, said test-chart image chosen to be textured and comprising patterns adequate to compute disparities between said sub-apertures images ensuring robustness of a shift estimation;
obtaining at least two sub-aperture images from said a 4D light field data;
and for at least a part of pixels of said at least two sub-aperture images,
determining a shift correction parameter (Δ) comprising determined shifts for pixels belonging to said part of pixels between said at least two sub-aperture images.