IP Library › Granted Patent US 11,445,133
Granted Patent B2
US 11,445,133 · App. 16/632,103 · Granted Sep 13, 2022

Low power and low data-rate imager

Inventors: Vladimir Petkov (San Jose, CA); Pedram Lajevardi (Menlo Park, CA); Christoph Lang (Sunnyvale, CA); Nikhil Naikal (Washington, DC); Sam Kavusi (Menlo Park, CA)
Assignee: Robert Bosch GmbH
H04N5/343H04N5/3456H04N5/351H04N5/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,445,133
App. No.
16/632,103
Granted
Sep 13, 2022
Kind
B2
Abstract

An imaging system for low-power and low data-rate applications is provided. The imaging system comprises a pixel array having a plurality of photosensitive elements (pixels) divided into a plurality of groups of photosensitive elements (super pixels). An image processor is operably connected to the pixel array and configured to selectively operate each group of photosensitive elements in either (i) a high resolution mode in which the pixel array outputs readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements or (ii) a low resolution mode in which the pixel array outputs readout voltages corresponding to only a subset of the photosensitive elements in the respective group of photosensitive elements. Groups of photosensitive elements corresponding to detected motion in each image frame are operated in the high resolution mode, while the remaining groups of photosensitive elements are operated in the low resolution mode.

Claims (48)

1. An imaging system comprising:

a pixel array having a plurality of photosensitive elements arranged in a grid formation and being divided into a plurality of groups of photosensitive elements, the photosensitive elements in each group of photosensitive elements being adjacent to one another in the grid formation, the pixel array being configured to output readout voltages proportional to light intensities at individual photosensitive elements in the plurality of photosensitive elements;

an analog-to-digital converter operably connected to the pixel array to receive the readout voltages and convert the readout voltages into digitized light intensity values; and

at least one processor operably connected to the pixel array and the analog-to-digital converter, the at least one processor being configured to selectively operate each group of photosensitive elements in the plurality of groups of photosensitive elements in one of (i) a high resolution mode in which the pixel array outputs readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements and (ii) a low resolution mode in which the pixel array outputs readout voltages corresponding to only a subset of the photosensitive elements in the respective group of photosensitive elements,

wherein each group of photosensitive elements in the plurality of groups of photosensitive elements is operable by the at least one processor in both the high resolution mode and the low resolution mode at different times

wherein the at least one processor is configured to:

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the low resolution mode, control the analog-to-digital converter to convert the readout voltages corresponding to the respective the subset of the photosensitive elements in the respective group of photosensitive elements with a first bit depth that is less than a maximum bit depth of the analog-to-digital converter; and

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the high resolution mode, control the analog-to-digital converter to convert the readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements with the maximum bit depth of the analog-to-digital converter.

2. The imaging system of claim 1 , the at least one processor being configured to:

receive an image frame, from the analog-to-digital converter, comprising digitized light intensity values corresponding to at least some of the photosensitive elements in each group of photosensitive elements in the plurality of groups of photosensitive elements; and

selectively operate each group of photosensitive elements in the plurality of groups of photosensitive elements in the high resolution mode and the low resolution mode at different times depending on the digitized light intensity values of the image frame.

3. The imaging system of claim 2 , the at least one processor being configured to:

operate a first group of photosensitive elements in the plurality of groups of photosensitive elements in the low resolution mode depending on to the digitized light intensity values in the image frame corresponding to the photosensitive elements in the first group of photosensitive elements; and

operate a second group of photosensitive elements in the plurality of groups of photosensitive elements in the high resolution mode depending on to the digitized light intensity values in the image frame corresponding to the photosensitive elements in the second group of photosensitive elements.

4. The imaging system of claim 2 , the at least one processor being configured to, for each group of photosensitive elements in the plurality of groups of photosensitive elements:

detect whether any moving objects are present in a respective portion of the image frame corresponding to the respective group of photosensitive elements based on the digitized light intensity values in the image frame corresponding to the photosensitive elements in the respective group of photosensitive elements;

operate the respective group of photosensitive elements in the low resolution mode in response to no moving object being detected in the respective portion of the image frame corresponding to the respective group of photosensitive elements; and

operate the respective group of photosensitive elements in the high resolution mode in response to a moving object being detected in the respective portion of the image frame corresponding to the respective group of photosensitive elements.

5. The imaging system of claim 4 , the at least one processor being configured to, for each group of photosensitive elements in the plurality of groups of photosensitive elements:

compare the respective portion of the image frame corresponding to the respective group of photosensitive elements with a corresponding portion of a reference background image frame to detect whether any moving objects are present in the respective portion of the image frame.

6. The imaging system of claim 5 , the at least one processor being configured to:

generate an intermediate image frame comprising light intensity difference values by subtracting the reference background image frame from the received image frame.

7. The imaging system of claim 6 , the at least one processor being configured to, for each group of photosensitive elements in the plurality of groups of photosensitive elements:

operate the respective group of photosensitive elements in the low resolution mode in response to the absolute value of each light intensity difference value of a respective portion of the intermediate image frame that corresponds to the respective group of photosensitive elements being less than a predetermined threshold difference value; and

operate the respective group of photosensitive elements in the high resolution mode in response to the absolute value of any light intensity difference value of a respective portion of the intermediate image frame that corresponds to the respective group of photosensitive elements being greater than a predetermined threshold difference value.

8. The imaging system of claim 5 , the at least one processor being configured to:

detect a change of lighting conditions in the image frame based on the digitized light intensity values of the image frame; and

operate the pixel array with an adjusted exposure time that depends on the change in the lighting conditions.

9. The imaging system of claim 6 , the at least one processor being configured to:

identify at least one portion of the reference background image frame to be updated based on the intermediate image frame, the at least one portion corresponding to at least one group of photosensitive elements in the plurality of groups of photosensitive elements; and

update the at least one portion of the reference background image frame based on at least one corresponding portion of the image frame.

10. The imaging system of claim 1 , wherein:

each group of photosensitive elements in the plurality of groups of photosensitive elements comprises a common number of photosensitive elements arranged in a common formation within the grid formation; and

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the low resolution mode, the subset of the photosensitive elements for which the pixel array outputs readout voltages corresponds to a defined pattern of photosensitive elements within the common formation.

11. The imaging system of claim 10 , wherein the defined pattern of photosensitive elements within the common formation is adjustable by the at least one processor.

12. The imaging system of claim 1 , wherein the first bit depth is adjustable by the at least one processor.

13. The image system of claim 1 , the at least one processor being configured to:

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the low resolution mode, control the pixel array and the analog-to-digital converter to update and convert the readout voltages corresponding to the subset of the photosensitive elements in the respective group of photosensitive elements with a first update rate that is less than a maximum update rate; and

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the high resolution mode, control the pixel array and the analog-to-digital converter to update and convert the readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements with the maximum update rate.

14. The imaging system of claim 13 , wherein the first update rate is adjustable by the at least one processor.

15. An imaging system comprising:

a pixel array having a plurality of photosensitive elements arranged in a grid formation and being divided into a plurality of groups of photosensitive elements, the photosensitive elements in each group of photosensitive elements being adjacent to one another in the grid formation, the pixel array being configured to output readout voltages proportional to light intensities at individual photosensitive elements in the plurality of photosensitive elements;

an analog-to-digital converter operably connected to the pixel array to receive the readout voltages and convert the readout voltages into digitized light intensity values; and

at least one processor operably connected to the pixel array and the analog-to-digital converter, the at least one processor being configured to selectively operate each group of photosensitive elements in the plurality of groups of photosensitive elements in one of (i) a high resolution mode in which the pixel array outputs readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements and (ii) a low resolution mode in which the pixel array outputs readout voltages corresponding to only a subset of the photosensitive elements in the respective group of photosensitive elements,

wherein each group of photosensitive elements in the plurality of groups of photosensitive elements is operable by the at least one processor in both the high resolution mode and the low resolution mode at different times, and

wherein the at least one processor is further configured to:

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the low resolution mode, control the pixel array and the analog-to-digital converter to update and convert the readout voltages corresponding to the subset of the photosensitive elements in the respective group of photosensitive elements with a first update rate that is less than a maximum update rate; and

for each group of photosensitive elements in the plurality of groups of photosensitive elements that is operated in the high resolution mode, control the pixel array and the analog-to-digital converter to update and convert the readout voltages corresponding to all of the photosensitive elements in the respective group of photosensitive elements with the maximum update rate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2020
From: PETKOV, VLADIMIR; LAJEVARDI, PEDRAM; LANG, CHRISTOPH; NAIKAL, NIKHIL; KAVUSI, SAM
To: ROBERT BOSCH GMBH
Reel/Frame 053318/0103 →
Continuity (3)
Provisional Application 62547297 · Aug 18, 2017
Provisional Application 62543646 · Aug 10, 2017
Related Publication 20200169669A1 · May 28, 2020
Cited By (1)
US 12,395,729