IP Library Granted Patent US 12713144
Granted Patent B2
US 12713144 · App. 18/533,435 · Granted Aug 18, 2026

Alternate subsampling in colour filter arrays

Inventor: Mikko Ollila (Tampere, FI)
Assignee: Varjo Technologies Oy
H04N25/134H04N23/62H04N25/445H04N25/78H04N25/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12713144
App. No.
18/533,435
Granted
Aug 18, 2026
Kind
B2
Abstract

Image data from an image sensor is read out, wherein when reading out, processor(s) is/are configured to employ subsampling by: reading out the image data from photo-sensitive cells that correspond to a first set of lines in a colour filter array (CFA), wherein a given line in the first set has colour filters of each of at least three different colours, the given line being a row (R 1 -R 8 ) or a column (C 1 -C 8 ) of the CFA; and skipping read out from photo-sensitive cells that correspond to a second set of lines in the CFA, wherein the first set of lines has one of: odd lines in the CFA, even lines in the CFA, while the second set of lines has another of: the odd lines, the even lines. The image data is processed to generate an image.

Claims (44)

1 . An imaging system comprising:

an image sensor comprising:

a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor; and

a colour filter array comprising colour filters of at least three different colours; and

at least one processor configured to:

read out image data from the image sensor, wherein when reading out, the at least one processor is configured to employ subsampling in at least a region of the photo-sensitive surface, by:

reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array, wherein a given line in the first set comprises colour filters of each of the at least three different colours; and

skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, wherein the first set of lines comprises one of: odd lines in the colour filter array, even lines in the colour filter array, while the second set of lines comprises another of: the odd lines, the even lines;

obtaining information indicative of a gaze direction of a user;

determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction; and

while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;

the at least one processor further configured to process the image data to generate an image;

wherein the given line in the first set is a row of the colour filter array, and wherein another given line in the first set comprising colour filters of each of the at least three different colours is a column of the colour filter array.

2 . The imaging system of claim 1 , wherein the at least one processor is configured to select the first set of lines and the second set of lines as sets of at least one of: rows, columns, based on whether colour filters of each of the at least three different colours are arranged in rows, columns, or both rows and columns.

3 . A method comprising:

reading out image data from an image sensor, wherein the image sensor comprises a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor, and a colour filter array comprising colour filters of at least three different colours, and wherein the step of reading out comprises employing subsampling in at least a region of the photo-sensitive surface, by:

reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array, wherein a given line in the first set comprises colour filters of each of the at least three different colours; and

skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, wherein the first set of lines comprises one of: odd lines in the colour filter array, even lines in the colour filter array, while the second set of lines comprises another of: the odd lines, the even lines;

obtaining information indicative of a gaze direction of a user;

determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction; and

while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density; and

processing the image data to generate an image;

wherein the given line in the first set is a row of the colour filter array, and wherein another given line in the first set comprising colour filters of each of the at least three different colours is a column of the colour filter array.

4 . The method of claim 3 , further comprising selecting the first set of lines and the second set of lines as sets of at least one of: rows, columns, based on whether colour filters of each of the at least three different colours are arranged in rows, columns, or both rows and columns.

5 . An imaging system comprising:

an image sensor comprising:

a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor; and

a colour filter array comprising sets of repeating rows or columns, wherein a given set of repeating rows or columns comprises N rows or columns that repeat consecutively; and

at least one processor configured to:

read out image data from the image sensor, wherein when reading out, the at least one processor is configured to employ subsampling in at least a region of the photo-sensitive surface, by:

reading out the image data from those photo-sensitive cells that correspond to at most N-1 rows or columns out of the N rows or columns in each set of repeating rows or columns; and

skipping read out from those photo-sensitive cells that correspond to a remainder of the N rows or columns in each set of repeating rows or columns;

obtaining information indicative of a gaze direction of a user;

determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction; and

while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;

the at least one processor further configured to process the image data to generate an image.

6 . A method comprising:

reading out image data from an image sensor, wherein the image sensor comprises a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor, and a colour filter array comprising sets of repeating rows or columns, wherein a given set of repeating rows or columns comprises N rows or columns that repeat consecutively, and wherein the step of reading out comprises employing subsampling in at least a region of the photo-sensitive surface, by:

reading out the image data from those photo-sensitive cells that correspond to at most N-1 rows or columns out of the N rows or columns in each set of repeating rows or columns; and

skipping read out from those photo-sensitive cells that correspond to a remainder of the N rows or columns in each set of repeating rows or columns;

obtaining information indicative of a gaze direction of a user;

determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction, and

while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density; and

processing the image data to generate an image.