IP Library Granted Patent US 12,073,579
Granted Patent B2
US 12,073,579 · App. 18/008,843 · Granted Aug 27, 2024

Local light field flow as an alternative to plane-sweep volumes

Inventors: Guillaume Boisson (Pleumeleuc, FR); Tomas Volker (Buenos Aires, AR); Bertrand Chupeau (Rennes, FR); Didier Doyen (Cesson-Sévigné, FR)
Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
G06T7/557G06T7/80H04N23/957G06T2207/10024G06T2207/20021G06T2207/20084G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,073,579
App. No.
18/008,843
Granted
Aug 27, 2024
Kind
B2
Abstract

An apparatus and a method are provided for image processing. In one embodiment, the method comprises accessing a plurality of images captured by at least a reference camera, wherein the images represent a plurality of views corresponding to said same scene. A plurality of plane sweep volume (PSV) slices are then generated from said images and computing for each slice a flow map from at least the reference camera calibration parameter and this flow map a previous slice of the plane sweep volume is generated.

Claims (30)

1. A method, comprising:

accessing a plurality of images captured by one or more cameras, wherein said images represent a plurality of views corresponding to a same scene;

generating a plurality of plane sweep volume (PSV) slices from said images and computing for each slice a displacement map from calibration parameters of the one or more cameras, wherein PSV slices, corresponding to one reference camera, are located at successive depth planes in a coordinate system of said one reference camera; and

using this displacement map to generate at least one of a next and a previous slice of the plane sweep volume.

2. The method of claim 1 , wherein said corresponding displacement map for the next slice is different.

3. The method of claim 1 , wherein said corresponding displacement map for the previous slice is different.

4. The method of claim 1 , wherein a displacement component is provided for each slice of the PSV and said displacement component is appended to each slice that captures the displacement from the current slice to the next one.

5. The method claim 4 , wherein said displacement component occurs after a transmission of an encoded light field data relating to content has been generated and received.

6. The method of claim 1 , wherein said images are captured by a light field camera.

7. The method of claim 1 , wherein generating said PSV slices further comprises:

providing depth information of each of the selected views at a plurality of depths; matching pixels of the provided depth of the selected views; and

determining a depth for a requested pixel of the requested view and a color for each pixel of the selected view at the determined depth.

8. A non-transitory computer-readable medium storing computer-executable instructions executable to perform the method of claim 1 .

9. An apparatus, comprising:

at least one processor configured to:

access a plurality of images captured one or more cameras, wherein said images represent a plurality of views corresponding to a same scene;

generate, a plurality of plane sweep volume slices (PSV) from said images and computing for each slice a displacement map from calibration parameters of the one or more cameras, wherein PSV slices, corresponding to one reference camera, are located at successive depth planes in a coordinate system of said on reference camera; and

generate, from a given slice, a corresponding displacement map for at least one of a next and a previous slice of the plane sweep volume.

10. The apparatus of claim 9 , wherein said corresponding displacement map for the next slice is different.

11. The apparatus of claim 9 , wherein said corresponding displacement map for the previous slice is different.

12. The apparatus of claim 9 , wherein a displacement component is provided for each slice of the PSV and said displacement component is appended to each slice that captures the displacement from the current slice to the next one.

13. The apparatus of claim 12 , wherein said displacement component occurs after a transmission of an encoded light field data relating to content has been generated and received.

14. The apparatus of claim 9 , wherein said images are captured by a light field camera.

15. The apparatus of claim 9 , wherein generating said PSV slices further comprises:

providing depth information of each of the selected views at a plurality of depths; matching pixels of the provided depth of the selected views; and

determining a depth for a requested pixel of the requested view and a color for each pixel of the selected view at the determined depth.

16. A method comprising:

determining camera calibration parameters associated with a first plane sweep volume (PSV);

obtaining a slice of the PSV and its associated displacement map based on the determined camera calibration parameters; and

generating at least a previous or next PSV slice based on said first PSV slice and said camera calibration parameters.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064460/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2022
From: BOISSON, GUILLAME; VOLKER, TOMAS; CHUPEAU, BERTRAND; DOYEN, DIDIER
To: INTERDIGITAL VC HOLDINGS FRANCE, SAS
Reel/Frame 062013/0381 →
Priority Claims (1)
EP 20305618 · Jun 9, 2020 · regional
Continuity (1)
Related Publication 20230215030A1 · Jul 6, 2023