IP Library Granted Patent US 10,536,685
Granted Patent B2
US 10,536,685 · App. 15/050,524 · Granted Jan 14, 2020

Method and apparatus for generating lens-related metadata

Inventors: Thomas Brune (Hannover, DE); Oliver Theis (Kalletal, DE); Thierry Borel (Rennes, FR); Valter Drazic (Betton, FR)
Assignee: INTERDIGITAL CE PATENT HOLDINGS
H04N13/178H04N5/225H04N5/2228H04N5/23216H04N5/23293H04N5/23296H04N13/282
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,536,685
App. No.
15/050,524
Granted
Jan 14, 2020
Kind
B2
Abstract

A method and an apparatus for generating lens-related metadata for a light field imaging device. An image renderer generates a display image from a light field capture using a lens model. A metadata assembler then outputs parameters of the lens model used for generating the display image as lens-related metadata for the light field imaging device.

Claims (42)

1. A method for generating metadata comprising

receiving information having at least one image capture and associated metadata and generating a first set of parameters characterizing optical properties of a virtual lens modelling behavior of an actual lens from said received information

generating a display image from a light field capture using said first set of parameters characterizing said optical properties of said virtual lens wherein said first set of parameters characterizing said optical properties of said virtual lens are focal length, focal ratio, focus distance, lens tilt and lens shift;

outputting said first set of parameters used for generating the display image as the lens-related metadata representative of a light field imaging device from which the light field capture is obtained;

retrieving a time code for the light field capture; and

adding the time code to the lens-related metadata.

2. The method according to claim 1 , further comprising outputting the lens-related metadata as metadata packets.

3. The method according to claim 1 , further comprising:

receiving a user input to adjust one or more of the parameters characterizing said optical properties of said virtual lens; and

generating an updated display image based on a second set of parameters characterizing said optical properties of said virtual lens and comprising said adjusted parameters.

4. The method according to claim 1 , wherein the time code is read from the light field capture or received from a time code generator.

5. The method according to claim 1 , wherein the light field capture is received from a light field imaging device or read from a storage system.

6. A computer readable non-transitory storage medium having stored therein instructions enabling generation of metadata packets comprising:

receive a set of parameters characterizing optical properties of a virtual lens modelling behavior of an actual lens having at least a first set of parameters, called lens-related metadata:

generate a display image from a light field capture using said first set of parameters characterizing the optical properties of said virtual lens wherein said first set of parameters characterizing said optical properties of said virtual lens are focal length, focal ratio, focus distance, lens tilt and lens shift; and

output said first set of parameters used for generating the display image as lens-related metadata for a light field imaging device from which the light field capture is obtained;

retrieve a time code for the light field capture; and

add the time code to the lens-related metadata.

7. An apparatus configured to generate metadata comprising:

a processing device configured to receive information having at least one image and associated metadata to generate a set of parameters characterizing optical properties of a virtual lens modelling behavior of an actual lens in dependence of a first set of parameters, called lens-related metadata,

said processing device also configured to:

generate a display image from a light field capture using said first set of parameters characterizing the optical properties of said virtual lens wherein said first set of parameters characterizing said optical properties of said virtual lens are focal length, focal ratio, focus distance, lens tilt and lens shift;

output said first set of parameters used for generating the display image as lens-related metadata for a light field imaging device from which the light field capture is obtained;

retrieve a time code for the light field capture; and

add the time code to the lens-related metadata.

8. A method for generating a display image from a light field capture, the method comprising:

retrieving a light field capture from a storage medium having metadata frame information having a set of related parameters; wherein said parameters have characteristic optical properties of a virtual lens modelling behavior of an actual lens; said optical properties include lens focal length, focal ratio, focus distance, lens tilt and lens shift, for generating a display image from the light field capture;

retrieving a time code for the light field capture from the storage medium;

generating a display image from the light field capture using the retrieved parameters and the retrieved time code; and

providing the display image to a display.

9. A computer readable non-transitory storage medium having stored therein instructions enabling generation of a display image from a light field capture, which, when executed by a computer, cause the computer to:

retrieve a light field capture from a storage medium;

retrieve a set of parameters characterizing optical properties of a virtual lens modelling behavior of an actual lens having at least a set of parameters wherein -these parameters characterize optical properties of said virtual lens including focal length, focal ratio, focus distance, lens tilt and lens shift, for generating a display image from the light field capture;

retrieve a time code for the light field capture from the storage medium;

generate a display image from the light field capture using the retrieved parameters and the retrieved time code; and

provide the display image to a display.

10. An apparatus configured to generate a display image from a light field capture, the apparatus comprising a processing device configured to:

retrieve a light field capture from a storage medium;

retrieve a set of parameters characterizing optical properties of a virtual lens modelling behavior having at least a set of parameters characterizing optical properties including lens focal length, focal ratio, focus distance, lens tilt and lens shift, for generating a display image from the light field capture;

retrieve a time code for the light field capture from the storage medium;

generate a display image from the light field capture using the retrieved parameters and the retrieved time code; and

provide the display image to a display.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME FROM INTERDIGITAL CE PATENT HOLDINGS TO INTERDIGITAL CE PATENT HOLDINGS, SAS. PREVIOUSLY RECORDED AT REEL: 47332 FRAME: 511. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 28, 2024
From: THOMSON LICENSING
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 066703/0509 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2018
From: THOMSON LICENSING
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 047332/0511 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: BRUNE, THOMAS; THEIS, OLIVER; BOREL, THIERRY; DRAZIC, VALTER
To: THOMSON LICENSING
Reel/Frame 046317/0431 →