IP Library Granted Patent US 8,164,669
Granted Patent B2
US 8,164,669 · App. 12/339,114 · Granted Apr 24, 2012

Charge-coupled device image sensor with efficient binning of same-color pixels

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,164,669
App. No.
12/339,114
Granted
Apr 24, 2012
Kind
B2
Abstract

A CCD image sensor comprises photosensitive elements arranged in rows and columns, vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns, and a horizontal CCD coupled to each of the vertical CCDs. The horizontal CCD comprises horizontal shift elements of two different types interspersed with one another. The horizontal shift elements of the first type are configured to receive shifted charge packets directly from respective ones of the vertical CCDs. The horizontal shift elements of the second type are configured not to receive shifted charge packets directly from any of the vertical CCDs. This configuration facilitates binning of same-color pixels for both sparse CFA patterns and Bayer CFA patterns.

Claims (87)

1. A charge-coupled device (CCD) image sensor, comprising:

a plurality of photosensitive elements arranged in rows and columns;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a horizontal CCD coupled to the vertical CCDs;

wherein the horizontal CCD comprises a repetitive arrangement of a group of three horizontal shift elements, wherein at least two adjacent horizontal shift elements in each group are configured to receive shifted charge packets directly from respective ones of the vertical CCDs and at least one horizontal shift element is configured to receive charge packets directly from an adjacent horizontal shift element.

2. The image sensor of claim 1 wherein the horizontal shift elements comprise two-phase horizontal shift elements.

3. The image sensor of claim 1 wherein the horizontal CCD is operative in at least first and second different modes of operation, wherein in the first mode of operation the number of horizontal shift elements in the horizontal CCD is greater than the number of vertical CCDs and in the second mode of operation the number of horizontal shift elements in the horizontal CCD is equal to the number of vertical CCDs.

4. The image sensor of claim 1 wherein the photosensitive elements are configured in accordance with a sparse color filter array pattern.

5. The image sensor of claim 4 wherein the horizontal CCD is configured to provide binning of same-color charge packets without binning of panchromatic charge packets.

6. The image sensor of claim 5 wherein the binning of same-color charge packets without binning of panchromatic charge packets is provided for a pair of the rows of photosensitive elements by a readout process that comprises a vertical shift in the vertical CCDs, followed by a horizontal shift in the horizontal CCD, followed by another vertical shift in the vertical CCDs.

7. The image sensor of claim 4 wherein a minimal repeating unit of the sparse color filter array pattern comprises 16 contiguous pixels arranged as follows:

Y P X P

P Y P X

Z P Y P

P Z P Y

where P represents a panchromatic pixel and X, Y and Z represent pixels having first, second and third colors, respectively.

8. The image sensor of claim 1 wherein the photosensitive elements are configured in accordance with a Bayer color filter array pattern.

9. The image sensor of claim 8 wherein the horizontal CCD comprises a bidirectional horizontal CCD.

10. The image sensor of claim 9 wherein the horizontal CCD is configured to provide binning of four green charge packets, binning of two red charge packets and binning of two blue charge packets.

11. The image sensor of claim 10 wherein the binning of four green charge packets, binning of two red charge packets and binning of two blue charge packets is provided for a given set of two pairs of adjacent ones of the rows by a readout process that comprises a first vertical shift in the vertical CCDs, followed by a shift in a first direction in the horizontal CCD, followed by a second vertical shift in the vertical CCDs, followed by a shift in a second direction in the horizontal CCD, followed by a third vertical shift in the vertical CCDs, followed by another shift in the first direction in the horizontal CCD, followed by a fourth vertical shift in the vertical CCDs.

12. The image sensor of claim 9 wherein the horizontal CCD is configured to provide binning of three green charge packets, binning of either two red charge packets or two blue charge packets, and no binning of charge packets of the remaining color.

13. A method of reading out a charge-coupled device (CCD) image sensor, the image sensor comprising a plurality of photosensitive elements arranged in rows and columns, a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns, and a horizontal CCD coupled to the vertical CCDs, wherein the horizontal CCD comprises a repetitive arrangement of a group of three horizontal shift elements where at least two adjacent horizontal shift elements in each group are configured to receive shifted charge packets directly from respective ones of the vertical CCDs and at least one horizontal shift element is configured to receive charge packets from an adjacent horizontal shift element, the method comprising:

shifting charge packets vertically from each vertical CCD into respective horizontal shift elements;

shifting the charge packets in the horizontal CCD horizontally one horizontal shift element; and

combining only respective ones of the charge packets in each group of three horizontal shift elements with additional charge packets by shifting charge packets vertically from each vertical CCD into respective horizontal shift elements.

14. The method of claim 13 wherein the horizontal CCD is operative in at least first and second different modes of operation, wherein in the first mode of operation the number of horizontal shift elements in the horizontal CCD is greater than the number of vertical CCDs and in the second mode of operation the number of horizontal shift elements in the horizontal CCD is equal to the number of vertical CCDs.

15. The method of claim 13 wherein the shifting steps further comprise a vertical shift in the vertical CCDs, followed by a horizontal shift in the horizontal CCD, followed by another vertical shift in the vertical CCDs.

16. The method of claim 13 wherein the shifting steps further comprise at least a first vertical shift in the vertical CCDs, followed by a shift in a first direction in the horizontal CCD, followed by a second vertical shift in the vertical CCDs, followed by a shift in a second direction in the horizontal CCD, followed by a third vertical shift in the vertical CCDs, followed by another shift in the first direction in the horizontal CCD, followed by a fourth vertical shift in the vertical CCDs.

17. The method of claim 13 wherein the photosensitive elements are configured in accordance with a sparse color filter array pattern and the combining only respective ones of the charge packets in each group of three horizontal shift elements with additional charge packets by shifting charge packets vertically from each vertical CCD into respective horizontal shift elements comprises combining only respective same-color charge packets.

18. A digital imaging device comprising:

a charge-coupled device (CCD) image sensor; and

one or more processing elements configured to process outputs of the image sensor to generate a digital image;

wherein said image sensor comprises:

a plurality of photosensitive elements arranged in rows and columns;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a horizontal CCD coupled to each of the vertical CCDs;

wherein the horizontal CCD comprises a repetitive arrangement of a group of three horizontal shift elements, wherein at least two adjacent horizontal shift elements in each group are configured to receive shifted charge packets directly from respective ones of the vertical CCDs and at least one horizontal shift element is configured to receive charge packets directly from an adjacent horizontal shift element.

19. The digital imaging device of claim 18 wherein said digital imaging device comprises a digital camera.

20. A charge-coupled device (CCD) image sensor, comprising:

a plurality of photosensitive elements arranged in rows and columns and configured in accordance with a sparse color filter array pattern;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a horizontal CCD, configured to provide binning of same-color charge packets without binning of panchromatic charge packets, coupled to each of the vertical CCDs,

wherein the horizontal CCD comprises horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs.

21. The image sensor of claim 20 wherein the binning of same-color charge packets without binning of panchromatic charge packets is provided for a pair of the rows of photosensitive elements by a readout process that comprises a vertical shift in the vertical CCDs, followed by a horizontal shift in the horizontal CCD, followed by another vertical shift in the vertical CCDs.

22. A charge-coupled device (CCD) image sensor, comprising:

a plurality of photosensitive elements arranged in rows and columns and configured in accordance with a sparse color filter array pattern, a minimal repeating unit of the sparse color filter array pattern comprising 16 contiguous pixels arranged as follows:

Y

P

X

P

P

Y

P

X

Z

P

Y

P

P

Z

P

Y

where P represents a panchromatic pixel and X, Y and Z represent pixels having first, second and third colors, respectively;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a horizontal CCD coupled to each of the vertical CCDs,

wherein the horizontal CCD comprises horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs.

23. A charge-coupled device (CCD) image sensor, comprising:

a plurality of photosensitive elements arranged in rows and columns and configured in accordance with a Bayer color filter array pattern;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a bidirectional horizontal CCD coupled to each of the vertical CCDs and configured to provide binning of four green charge packets, binning of two red charge packets and binning of two blue charge packets,

wherein the horizontal CCD comprises horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs.

24. The image sensor of claim 23 wherein the binning of four green charge packets, binning of two red charge packets and binning of two blue charge packets is provided for a given set of two pairs of adjacent ones of the rows by a readout process that comprises a first vertical shift in the vertical CCDs, followed by a shift in a first direction in the horizontal CCD, followed by a second vertical shift in the vertical CCDs, followed by a shift in a second direction in the horizontal CCD, followed by a third vertical shift in the vertical CCDs, followed by another shift in the first direction in the horizontal CCD, followed by a fourth vertical shift in the vertical CCDs.

25. A charge-coupled device (CCD) image sensor, comprising:

a plurality of photosensitive elements arranged in rows and columns and configured in accordance with a Bayer color filter array pattern;

a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

a bidirectional horizontal CCD coupled to each of the vertical CCDs and configured to provide binning of three green charge packets, binning of either two red charge packets or two blue charge packets, and no binning of charge packets of the remaining color;

wherein the horizontal CCD comprises and horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs.

26. A method of reading out a charge-coupled device (CCD) image sensor, the image sensor comprising a plurality of photosensitive elements arranged in rows and columns, the method comprising:

shifting charge packets through a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

shifting the charge packets through a horizontal CCD coupled to each of the vertical CCDs,

wherein the horizontal CCD comprises horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs, and

wherein the shifting steps further comprise at least a first vertical shift in the vertical CCDs, followed by a shift in a first direction in the horizontal CCD, followed by a second vertical shift in the vertical CCDs, followed by a shift in a second direction in the horizontal CCD, followed by a third vertical shift in the vertical CCDs, followed by another shift in the first direction in the horizontal CCD, followed by a fourth vertical shift in the vertical CCDs.

27. A method of reading out a charge-coupled device (CCD) image sensor, the image sensor comprising a plurality of photosensitive elements arranged in rows and columns and configured in accordance with a sparse color filter array pattern, the method comprising the steps of:

shifting charge packets through a plurality of vertical CCDs each having vertical shift elements associated with respective ones of the photosensitive elements of a corresponding one of the columns; and

shifting the charge packets through a horizontal CCD coupled to each of the vertical CCDs;

wherein the horizontal CCD comprises horizontal shift elements of two different types interspersed with one another, with horizontal shift elements of the first type being configured to receive shifted charge packets directly from respective ones of the vertical CCDs and horizontal shift elements of the second type being configured not to receive shifted charge packets directly from any of the vertical CCDs, and

wherein the shifting steps provide binning of same-color charge packets without binning of panchromatic charge packets.

Assignments (11)
RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 038620, FRAME 0087 Recorded Jun 22, 2023
From: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
To: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC; FAIRCHILD SEMICONDUCTOR CORPORATION
Reel/Frame 064070/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER 5859768 AND TO RECITE COLLATERAL AGENT ROLE OF RECEIVING PARTY IN THE SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 038620 FRAME 0087. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Aug 25, 2016
From: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 039853/0001 →
SECURITY INTEREST Recorded Apr 15, 2016
From: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 038620/0087 →
RELEASE OF SECURITY INTEREST Recorded Sep 22, 2015
From: TRUESENSE IMAGING, INC
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 036656/0412 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2014
From: TRUESENSE IMAGING, INC.
To: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
Reel/Frame 033460/0457 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT Recorded May 19, 2014
From: PNC BANK, NATIONAL ASSOCIATION
To: TRUESENSE IMAGING, INC.
Reel/Frame 032936/0167 →
CHANGE OF NAME Recorded Dec 29, 2011
From: IMAGE SENSOR TECHNOLOGIES ACQUISITION CORPORATION
To: TRUESENSE IMAGING, INC.
Reel/Frame 027463/0523 →
SECURITY AGREEMENT Recorded Dec 9, 2011
From: TRUESENSE IMAGING, INC.
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 027354/0722 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2011
From: EASTMAN KODAK COMPANY
To: IMAGE SENSOR TECHNOLOGIES ACQUISITION CORPORATION
Reel/Frame 027332/0085 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2011
From: EASTMAN KODAK COMPANY
To: IMAGE SENSOR TECHNOLOGIES ACQUISITION CORPORATION
Reel/Frame 027328/0892 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2008
From: COMPTON, JOHN T.; NICHOLS, DAVID N.
To: EASTMAN KODAK COMPANY
Reel/Frame 022005/0752 →