IP Library Granted Patent US 11,405,535
Granted Patent B2
US 11,405,535 · App. 16/715,570 · Granted Aug 2, 2022

Quad color filter array camera sensor configurations

Inventor: Micha Galor Gluskin (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N5/2254H01L27/14627H01L27/14643H04N5/3696H04N9/04553H01L27/14605
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,405,535
App. No.
16/715,570
Granted
Aug 2, 2022
Kind
B2
Abstract

Examples of capturing and processing image data are described. A device may include a camera including a camera sensor that includes a plurality of tiles that each include four sub-tiles. The camera may also include a color filter array coupled to the camera sensor and including a plurality of red, blue, and green color filters. A first sub-tile of each tile may include a phase detection pixel coupled to a microlens shared with at least one other pixel of the tile and an imaging pixel not coupled to a second microlens different from the first microlens. The device may also include a processor coupled to the camera and configured to control one or more first exposure settings of the phase detection pixel and control one or more second exposure settings of the non-phase detection pixel. Control of the second exposure settings is independent from control of the first exposure settings.

Claims (97)

1. A device, comprising:

a camera configured to capture image data, the camera comprising:

a camera sensor including a plurality of tiles of four pixels by four pixels, wherein each tile includes a first sub-tile, a second sub-tile, a third sub-tile, and a fourth sub-tile of two pixels by two pixels; and

a quad color filter array (QCFA) coupled to the camera sensor, the QCFA including a plurality of red color filters, a plurality of green color filters, and a plurality of blue color filters;

wherein a first sub-tile of a first tile includes:

a first phase detection (PD) pixel coupled to a first microlens shared with at least one other pixel of the first tile, wherein the first microlens includes a first orientation with respect to the camera sensor and is shared by the first PD pixel and a second PD pixel of the first sub-tile, and wherein the first PD pixel is coupled to a first green color filter and the second PD pixel is coupled to a second green color filter; and

a first imaging pixel coupled to a second microlens different from the first microlens, wherein the first imaging pixel is coupled to a third green color filter of the QCFA;

wherein the second sub-tile includes:

a third PD pixel coupled to a fourth green color filter and a third microlens, wherein the third microlens includes a second orientation 90 degrees with respect to the first orientation;

a fourth PD pixel coupled to a fifth green color filter and the third microlens shared with the third PD pixel; and

a second imaging pixel coupled to a sixth green color filter of the QCFA; and

a processor implemented in circuitry and coupled to the camera, wherein the processor is configured to:

control one or more first exposure settings of the first PD pixel; and

control one or more second exposure settings of the first imaging pixel independent from the one or more first exposure settings.

2. The device of claim 1 , wherein the processor is further configured to:

receive image data captured using the first PD pixel and a second PD pixel of the first sub-tile sharing the first microlens;

receive image data captured using the first imaging pixel;

detect one or more phases based on the captured image data from the first PD pixel and the second PD pixel; and

generate an image based on the captured image data from the first imaging pixel.

3. The device of claim 2 , wherein the processor is further configured to:

receive image data captured using the third PD pixel of the second sub-tile;

receive image data captured using a fourth PD pixel coupled to the third microlens shared with the third PD pixel;

receive image data captured using the second imaging pixel coupled to a sixth green color filter of the QCFA;

detect one or more phases based on the captured image data from the third PD pixel and the fourth PD pixel; and

generate the image further based on the captured image data from the second imaging pixel.

4. A computer-implemented method, comprising:

controlling, by a processor, one or more first exposure settings of a first phase detection (PD) pixel of a camera sensor of a camera;

controlling, by the processor, one or more second exposure settings of a first imaging pixel of the camera sensor independently from controlling the one or more first exposure settings;

receiving, by the processor, captured image data from the camera coupled to the processor, wherein the camera includes:

the camera sensor including a plurality of tiles of four pixels by four pixels, wherein each tile includes a first sub-tile, a second sub-tile, a third sub-tile, and a fourth sub-tile of two pixels by two pixels; and

a quad color filter array (QCFA) coupled to the camera sensor, the QCFA including a plurality of red color filters, a plurality of green color filters, and a plurality of blue color filters;

wherein a first sub-tile of a first tile includes:

the first PD pixel coupled to a first microlens shared with at least one other pixel of the first tile, wherein the first microlens includes a first orientation with respect to the camera sensor and is shared by the first PD pixel and a second PD pixel of the first sub-tile, and wherein the first PD pixel is coupled to a first green color filter and the second PD pixel is coupled to a second green color filter; and

the first imaging pixel coupled to a second microlens different from the first microlens, wherein the first imaging pixel is coupled to a third green color filter of the QCFA;

wherein the second sub-tile includes:

a third PD pixel coupled to a fourth green color filter and a third microlens, wherein the third microlens includes a second orientation 90 degrees with respect to the first orientation;

a fourth PD pixel coupled to a fifth green color filter and the third microlens shared with the third PD pixel; and

a second imaging pixel coupled to a sixth green color filter of the QCFA.

5. The method of claim 4 , further comprising:

capturing image data by the first PD pixel and a second PD pixel of the first sub-tile sharing the first microlens;

capturing image data by the first imaging pixel;

detecting, by the processor, one or more phases based on the captured image data from the first PD pixel and the second PD pixel; and

generating an image based on the captured image data from the first imaging pixel.

6. The method of claim 5 , further comprising:

capturing image data by the third PD pixel of the second sub-tile;

capturing image data by a fourth PD pixel coupled to the third microlens shared with the third PD pixel;

capturing image data by the second imaging pixel coupled to a sixth green color filter of the QCFA; and

detecting, by the processor, one or more phases based on the captured image data from the third PD pixel and the fourth PD pixel;

wherein generating the image is further based on the captured image data from the second imaging pixel.

7. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a device, cause the device to:

control one or more first exposure settings of a first phase detection (PD) pixel of a camera sensor of a camera;

control one or more second exposure settings of a first imaging pixel of the camera sensor independently from controlling the one or more first exposure settings;

receive, by a processor of the device, captured image data from the camera coupled to the processor, wherein the camera includes:

the camera sensor including a plurality of tiles of four pixels by four pixels, wherein each tile includes a first sub-tile, a second sub-tile, a third sub-tile, and a fourth sub-tile of two pixels by two pixels; and

a quad color filter array (QCFA) coupled to the camera sensor, the QCFA including a plurality of red color filters, a plurality of green color filters, and a plurality of blue color filters;

wherein a first sub-tile of a first tile includes:

the first PD pixel coupled to a first microlens shared with at least one other pixel of the first tile, wherein the first microlens includes a first orientation with respect to the camera sensor and is shared by the first PD pixel and a second PD pixel of the first sub-tile, and wherein the first PD pixel is coupled to a first green color filter and the second PD pixel is coupled to a second green color filter; and

the first imaging pixel coupled to a second microlens different from the first microlens, wherein the first imaging pixel is coupled to a third green color filter of the QCFA;

wherein the second sub-tile includes:

a third PD pixel coupled to a fourth green color filter and a third microlens, wherein the third microlens includes a second orientation 90 degrees with respect to the first orientation;

a fourth PD pixel coupled to a fifth green color filter and the third microlens shared with the third PD pixel; and

a second imaging pixel coupled to a sixth green color filter of the QCFA.

8. The computer-readable medium of claim 7 , wherein execution of the instructions further causes the device to:

capture image data by the first PD pixel and a second PD pixel of the first sub-tile sharing the first microlens;

capture image data by the first imaging pixel;

detect one or more phases based on the captured image data from the first PD pixel and the second PD pixel; and

generate an image based on the captured image data from the first imaging pixel.

9. The computer-readable medium of claim 8 , wherein execution of the instructions further causes the device to:

capture image data by a third PD pixel of the second sub tile;

capture image data by a fourth PD pixel coupled to the third microlens shared with the third PD pixel;

capture image data by the second imaging pixel coupled to a sixth green color filter of the QCFA; and

detect, by the processor, one or more phases based on the captured image data from the third PD pixel and the fourth PD pixel;

wherein generating the image is further based on the captured image data from the second imaging pixel.

10. A device, comprising:

means for controlling one or more first exposure settings of a first phase detection (PD) pixel of a camera sensor of a camera;

means for controlling one or more second exposure settings of a first imaging pixel of the camera sensor independently from controlling the one or more first exposure settings;

means for receiving captured image data from the camera, wherein the camera includes:

the camera sensor including a plurality of tiles of four pixels by four pixels, wherein each tile includes a first sub-tile, a second sub-tile, a third sub-tile, and a fourth sub-tile of two pixels by two pixels; and

a quad color filter array (QCFA) coupled to the camera sensor, the QCFA including a plurality of red color filters, a plurality of green color filters, and a plurality of blue color filters;

wherein a first sub-tile of a first tile includes:

the first PD pixel coupled to a first microlens shared with at least one other pixel of the first tile, wherein the first microlens includes a first orientation with respect to the camera sensor and is shared by the first PD pixel and a second PD pixel of the first sub-tile, and wherein the first PD pixel is coupled to a first green color filter and the second PD pixel is coupled to a second green color filter; and

the first imaging pixel coupled to a second microlens different from the first microlens, wherein the first imaging pixel is coupled to a third green color filter of the QCFA;

wherein the second sub-tile includes:

a third PD pixel coupled to a fourth green color filter and a third microlens, wherein the third microlens includes a second orientation 90 degrees with respect to the first orientation;

a fourth PD pixel coupled to a fifth green color filter and the third microlens shared with the third PD pixel; and

a second imaging pixel coupled to a sixth green color filter of the QCFA.

11. The device of claim 10 , further comprising:

means for receiving image data captured using the first PD pixel and a second PD pixel of the first sub-tile sharing the first microlens;

means for receiving image data captured using the first imaging pixel;

means for detecting one or more phases based on the captured image data from the first PD pixel and the second PD pixel; and

means for generating an image based on the captured image data from the first imaging pixel.

12. The device of claim 11 , further comprising:

means for receiving image data captured using the third PD pixel of the second sub-tile;

means for receiving image data captured using a fourth PD pixel coupled to the third microlens shared with the third PD pixel;

means for receiving image data captured using the second imaging pixel coupled to a sixth green color filter of the QCFA; and

means for detecting one or more phases based on the captured image data from the third PD pixel and the fourth PD pixel;

wherein the means for generating is configured to generate the image further based on the captured image data from the second imaging pixel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2020
From: GALOR GLUSKIN, MICHA
To: QUALCOMM INCORPORATED
Reel/Frame 051656/0624 →
Continuity (2)
Provisional Application 62812234 · Feb 28, 2019
Related Publication 20200280659A1 · Sep 3, 2020
Cited By (1)
US 12,511,768