IP Library Granted Patent US 9,197,821
Granted Patent B2
US 9,197,821 · App. 14/246,948 · Granted Nov 24, 2015

Systems and methods for transmitting and receiving array camera image data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,197,821
App. No.
14/246,948
Granted
Nov 24, 2015
Kind
B2
Abstract

Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.

Claims (42)

1. A method of transmitting image data comprising:

capturing image data using a plurality of active focal planes in a camera module that comprises an array of focal planes and a plurality of lens stacks, where an image is formed on each active focal plane by a separate lens stack from said plurality of lens stacks and the array of focal planes comprises a plurality of rows of focal planes and a plurality of columns of focal planes;

generating lines of image data by interleaving said image data captured by said plurality of active focal planes;

generating additional data, where said additional data includes information for deinterleaving a plurality of images from the generated lines of image data;

packetizing said lines of image data and said additional data to produce at least one packet of data; and

transmitting said at least one packet of data.

2. The method of claim 1 , wherein:

each of said at least one packet of data comprises:

a packet header containing at least a portion of said additional data; and

a plurality of lines of image data; and

said additional data contained in said packet header describes said array of focal planes.

3. The method of claim 1 , wherein each of said at least one packet of data further comprises a packet footer indicating the end of the transmission of said plurality of lines of image data.

4. The method of claim 1 , wherein:

each of said at least one packet of data comprises a plurality of lines of image data and a line header associated with each of said plurality of lines of image data; and

each of said line headers associated with each of said plurality of lines of image data includes additional data describing a line of image data with which the line header is associated.

5. The method of claim 4 , wherein each of said line headers associated with each of said plurality of lines of image data further comprises additional data describing said array of focal planes.

6. The method of claim 5 , further comprising:

pausing transmission during frame blanking intervals;

transmitting said plurality of lines of image data and said additional data between frame intervals; and

pausing during the transmission of said plurality of lines of image data and said additional data line blanking intervals.

7. The method of claim 6 , further comprising continuously transmitting said lines of image data and said additional data until all of said lines of image data are transmitted.

8. The method of claim 1 , wherein each of said plurality of lens stacks in the camera module has a different field of view.

9. The method of claim 1 , wherein capturing image data using a plurality of active focal planes further comprises capturing image data in such a way that individual focal planes from the plurality of active focal planes are independently controlled.

10. The method of claim 1 , wherein the additional data describes said array of focal planes.

11. The method of claim 1 , wherein said additional data includes data selected from a group consisting of additional data describing:

a number of active focal planes;

dimensions of said array of focal planes;

a number of pixels in each dimension of at least one of said plurality of active focal planes;

an integration time for pixels in at least one of said plurality of active focal planes; and

a gain for pixels in at least one of said plurality of active focal planes.

12. The method of claim 11 , wherein said additional data describing a gain for pixels in at least one of said plurality of active focal planes includes additional data describing an analog gain for pixels in said at least one of said plurality of active focal planes and additional data describing a digital gain for pixels in said at least one of said plurality of active focal planes.

13. The method of claim 1 , wherein:

generating said lines of image data further comprises combining captured image data from said plurality of active focal planes using a predetermined process selected from a plurality of predetermined processes for combining captured image data; and

said additional data includes additional data indicating said predetermined process selected from said plurality of predetermined processes used to combine said image data captured by said plurality of active focal planes.

14. The method of claim 13 , wherein:

each of said plurality of active focal planes comprises an array of pixels including a plurality of rows of pixels that also form a plurality of columns of pixels; and

said predetermined process selected from said plurality of predetermined processes comprises interleaving image data from a row selected from each of said plurality of active focal planes.

15. The method of claim 13 , wherein said predetermined process selected from said plurality of predetermined processes comprises using a modulo process, where said modulo process involves combining image data captured by pixels in selected rows of said plurality of active focal planes by interleaving predetermined numbers of pixels from each of said selected rows.

16. The method of claim 1 , wherein said additional data describes at least one of said lines of image data.

17. The method of claim 16 , wherein said additional data includes data selected from a group consisting of additional data describing:

a time at which each of said plurality of active focal planes started capturing image data; and

row numbers of rows in each of said plurality of active focal planes used to capture image data used to generate said at least one of said lines of image data.

Assignments (13)
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: FOTONATION CAYMAN LIMITED
To: FOTONATION LIMITED
Reel/Frame 046539/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: PELICAN IMAGING CORPORATION
To: FOTONATION CAYMAN LIMITED
Reel/Frame 040675/0025 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: KIP PELI P1 LP
To: PELICAN IMAGING CORPORATION
Reel/Frame 040674/0677 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040494/0930 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040423/0725 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 039117/0345 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 038982/0151 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR AND ASSIGNEE PREVIOUSLY RECORDED AT REEL: 037565 FRAME: 0439. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 25, 2016
From: KIP PELI P1 LP
To: DBD CREDIT FUNDING LLC
Reel/Frame 037591/0377 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0439 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: DBD CREDIT FUNDING LLC
Reel/Frame 037565/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2014
From: MCMAHON, ANDREW KENNETH JOHN
To: PELICAN IMAGING CORPORATION
Reel/Frame 033361/0791 →