Method for processing a light field video based on the use of a super-rays representation

1. A method comprising:

obtaining a light field video comprising a set of image views per unit of time, the light field video being associated with a scene without cuts;

determining a first super-rays representation of at least one reference image view being comprised in said set of image views at a given time, said super-rays representation being based on centroids, and each centroid being associated with a unique super-ray;

determining a second super-rays representation of at least one corresponding reference view in a subsequent set of image views following said given time, based on a de-projection and re-projection of centroids of said at least one reference image view;

determining a displacement of centroids between said first and second super-rays representation based on a tracking process; and

applying a determined displacement on centroids of said second super-rays representation for obtaining positions of modified centroids.

2. The method for processing according to claim 1 , wherein it further comprises de-projecting and re-projecting of modified centroids onto at least one another image view in said subsequent set of image views, for obtaining a super-rays representation of said subsequent set of image views.

3. The method for processing according to claim 2 , wherein it further comprises updating the position of said centroids by taking into account an average of values of projected rays, said rays being in a neighborhood of centroids in said first super-rays representation.

4. The method for processing according to claim 1 , wherein said tracking process is a minimization process that comprises the determination of argmin δ c x ,δ c y ,δ c z Σ s,t ∥RGB f (P s,t d c (x c f ,y c f ))−RGB f+1 (P s,t d c +δ c d (x c f +δ c x ,y c f +δ c y ))∥ B , where RGB f (P s,t d (x,y)) corresponds to the RGB pixel value of the projection of a ray r of coordinates (s, t, x, y) at a depth d, associated with a frame f.

5. The method for processing according to claim 1 , wherein at least two reference images views are used, and said at least two reference image views are far from each other's from an angular point of view.

6. The method for processing according to claim 1 , wherein said light field video has been acquired by a cameras array.

7. The method for processing according to claim 1 , wherein said light field video has been acquired by a plenoptic camera.

8. An electronic device comprising at least one processor, and a memory unit coupled to said at least one processor, the at least one processor being configured to:

obtain a light field video comprising a set of image views per unit of time, the light field video being associated with a scene without cuts;

determine a first super-rays representation of at least one reference image view being comprised in said set of image views at a given time, said super-rays representation being based on centroids, and each centroid being associated with a unique super-ray;

determine a second super-rays representation of at least one corresponding reference view in a subsequent set of image views following said given time, based on a de-projection and re-projection of centroids of said at least one reference image view;

determine a displacement of centroids between said first and second super-rays representation based on a tracking process; and

apply a determined displacement on centroids of said second super-rays representation for obtaining positions of modified centroids.

9. The electronic device for processing according to claim 8 , wherein the at least one processor is further configured to de-project and re-project modified centroids onto at least one another image view in said subsequent set of image views, for obtaining a super-rays representation of said subsequent set of image views.

10. The electronic device for processing according to claim 9 , wherein the at least one processor is further configured to update the position of said centroids by taking into account an average of values of projected rays, said rays being in a neighborhood of centroids in said first super-rays representation.

11. The electronic device for processing according to claim 8 , wherein said tracking process is a minimization process that comprises the determination of argmin δ c x ,δ c y ,δ c z Σ s,t ∥RGB f (P s,t d c (x c f ,y c f ))−RGB f+1 (P s,t d c +δ c d (x c f +δ c x ,y c f +δ c y ))∥ B , where RGB f (P s,t d (x,y)) corresponds to the RGB pixel value of the projection of a ray r of coordinates (s, t, x, y) at a depth d, associated with a frame f.

12. The electronic device for processing according to claim 8 , wherein at least two reference images views are used, and said at least two reference image views are far from each other's from an angular point of view.

13. The electronic device for processing according to any claim 8 , wherein said light field video has been acquired by a cameras array.

14. The electronic device for processing according to any claim 8 , wherein said light field video has been acquired by a plenoptic camera.