IP Library Granted Patent US 8,488,887
Granted Patent B2
US 8,488,887 · App. 12/599,048 · Granted Jul 16, 2013

Method of determining an image distribution for a light field data structure

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,488,887
App. No.
12/599,048
Granted
Jul 16, 2013
Kind
B2
Abstract

The invention relates to a method of determining an image distribution (D opt ) for a light field data structure, which method comprises obtaining a plurality of images (F 1 , F 2 , . . . , F n ) from a plurality of image sources (C 1 , C 2 , . . . , C n ), performing image analysis on each image (F 1 , F 2 , . . . , F n ) of the plurality of images (F 1 , F 2 , . . . , F n ) to determine whether a specified criterion is satisfied by the content of that image (F 1 , F 2 , . . . , F n ), and identifying a group ( 12 ) of images (F 1 , F 2 , . . . , F n ) whose contents satisfy the specified criterion. The image group ( 12 ) is compared to each reference image distribution (D 1 , D 2 , . . . , D m ) of a set of predefined reference image distributions (D 1 , D 2 , . . . , D m ,) to select an optimal image distribution (D opt ), wherein a reference image distribution (D 1 , D 2 , . . . , D m ) comprises a predefined arrangement of I-images and P-images of the light field data structure. Each image (F 1 , F 2 , . . . , F n ) of the plurality of images (F 1 , F 2 , . . . , F n ) of the light field data structure is subsequently designated to be either an I-image or a P-image according to the selected image distribution (D opt ). The invention also describes a system ( 1 ) for determining an image distribution (D opt ) for a light field data structure.

Claims (36)

1. A method of determining an image distribution for a light field data structure, which method comprises

obtaining a plurality of images from a plurality of image sources;

performing image analysis on each image of the plurality of images to determine whether a specified criterion is satisfied by content of that image;

identifying a group of images whose contents satisfy the specified criterion;

comparing the group of images to each reference image distribution of a set of predefined reference image distributions to select an optimal image distribution, wherein a reference image distribution includes a predefined arrangement of I-images and P-images of the light field data structure; and

designating each image of the plurality of images of the light field data structure to be either an I-image or a P-image according to the selected image distribution.

2. The method according to claim 1 , wherein the specified criterion includes parameters related to an object to be detected in content of an image.

3. The method according to claim 1 , wherein the step of identifying a group of images includes compiling an image-related array based on the images that satisfy the specified criterion.

4. The method according to claim 1 , wherein the optimal image distribution corresponds to the reference image distribution which provides a greatest number of I-images for the image group.

5. The method according to claim 1 , wherein the step of performing image analysis includes running a segmentation algorithm on that image.

6. A method of performing video coding of a light field data structure, which method comprises

determining an optimal image distribution for images of the light field data structure using the method of claim 1 ;

coding each image designated to be an I-image using a compression algorithm;

and coding each image designated to be a P-image using a previously coded image.

7. A system for determining an image distribution for a light field data structure, comprising

a plurality of image sources for obtaining a plurality of images;

an image analysis module for performing image analysis on each of the plurality of the plural images to determine whether a specified criterion is satisfied by content of that image;

an image group identification module for identifying a group of images whose contents satisfy the specified criterion;

a comparison module for comparing the image group to each reference image distribution of a set of predefined reference image distributions to select an optimal image distribution, wherein a reference image distribution includes a predefined arrangement of I-images and P-images of the light field data structure; and

an image designation module for designating each of the plural images of the light field data structure to be either an I-image or a P-image based on the selected image distribution.

8. A system for determining an image distribution for a light field data structure according to claim 7 , further comprising an interface for specifying a criterion.

9. A non-transitory computer readable medium encoded with data and instructions that when executed by a computer causes a computer to:

obtain a plurality of images from a plurality of image sources;

perform image analysis on each image of the plurality of images to determine whether a specified criterion is satisfied by content of that image;

identify a group of images whose contents satisfy the specified criterion;

compare the group of images to each reference image distribution of a set of predefined reference image distributions to select an optimal image distribution, wherein a reference image distribution includes a predefined arrangement of I-images and P-images of the light field data structure; and

designate each image of the plurality of images of the light field data structure to be either an I-image or a P-image according to the selected image distribution.

10. A system for performing video coding, comprising:

a system for determining an image distribution for a light field data structure comprising:

a plurality of image sources for obtaining a plurality of images;

an image analysis module for performing image analysis on each of the plurality of the plural images to determine whether a specified criterion is satisfied by content of that image;

an image group identification module for identifying a group of images whose contents satisfy the specified criterion;

a comparison module for comparing the image group to each reference image distribution of a set of predefined reference image distributions to select an optimal image distribution, wherein a reference image distribution includes a predefined arrangement of I-images and P-images of the light field data structure; and

an image designation module for designating each of the plural images of the light field data structure to be either an I-image or a P-image based on the selected image distribution;

an I-image coder for coding an image, designated to be an I-image, using a compression algorithm; and

a P-image coder for coding an image, designated to be a P-image, using a previously coded image.

Assignments (20)
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: MAXLINEAR INC.; ENTROPIC COMMUNICATIONS LLC
To: DYNAMIC DATA TECHNOLOGIES LLC
Reel/Frame 047914/0274 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
PATENT RELEASE Recorded Aug 17, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 039707/0471 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
MERGER AND CHANGE OF NAME Recorded May 19, 2015
From: ENTROPIC COMMUNICATIONS, INC.; EXCALIBUR SUBSIDIARY, LLC; ENTROPIC COMMUNICATIONS, LLC
To: ENTROPIC COMMUNICATIONS, LLC
Reel/Frame 035717/0628 →
MERGER AND CHANGE OF NAME Recorded May 18, 2015
From: EXCALIBUR ACQUISITION CORPORATION; ENTROPIC COMMUNICATIONS, INC.; ENTROPIC COMMUNICATIONS, INC.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 035706/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2012
From: TRIDENT MICROSYSTEMS, INC.; TRIDENT MICROSYSTEMS (FAR EAST) LTD.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 028146/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: NXP
To: NXP HOLDING 1 B.V.
Reel/Frame 023928/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: TRIDENT MICROSYSTEMS (EUROPE) B.V.; NXP HOLDING 1 B.V.
To: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
Reel/Frame 023928/0552 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2009
From: REME, JEAN-MARC
To: NXP, B.V.
Reel/Frame 023481/0259 →