IP Library Granted Patent US 11,765,337
Granted Patent B2
US 11,765,337 · App. 17/834,190 · Granted Sep 19, 2023

Multi-processor support for array imagers

Inventors: John T. Bretscher (Elgin, IL); Randall S. Vaas (Wyoming, MI)
Assignee: GOOGLE TECHNOLOGY HOLDINGS LLC
H04N13/282G06T1/20H04N13/161H04N19/107H04N19/436H04N19/439H04N19/503H04N19/593H04N19/597H04N19/62H04N23/45H04N23/75H04N23/80H04N23/957
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,765,337
App. No.
17/834,190
Granted
Sep 19, 2023
Kind
B2
Abstract

Using the techniques discussed herein, a set of images is captured by one or more array imagers ( 106 ). Each array imager includes multiple imagers configured in various manners. Each array imager captures multiple images of substantially a same scene at substantially a same time. The images captured by each array image are encoded by multiple processors ( 112, 114 ). Each processor can encode sets of images captured by a different array imager, or each processor can encode different sets of images captured by the same array imager. The encoding of the images is performed using various image-compression techniques so that the information that results from the encoding is smaller, in terms of storage size, than the uncompressed images.

Claims (30)

1. A smartphone, comprising:

at least one non-transitory computer-readable media to store instructions;

at least one processor;

a display; and

at least one array imager including a plurality of first imagers and at least one second imager,

wherein

at least one of the first imagers and the at least one second imager are operable to capture a first set of images and a second set of images, the first set of images including a first plurality of images that depict substantially a same scene at substantially a same time and the second set of images including a second plurality of images that depict substantially a same scene at substantially a same time, and

the at least one processor includes a single processor with two or more distinct cores configured to execute the instructions to:

obtain the first set of images and the second set of images,

encode, using one of the two or more distinct cores, the first set of images, and

encode, using another of the two or more distinct cores, the second set of images.

2. The smartphone of claim 1 , wherein the display is disposed on a first side of the smartphone, and the array imager is disposed on a second side of the smartphone which is opposite to the first side of the smartphone.

3. The smartphone of claim 1 , wherein the at least one array imager includes at least two imagers that have different filters.

4. The smartphone of claim 1 , wherein the at least one array imager includes at least two imagers that have different spectral sensitivities.

5. The smartphone of claim 1 , wherein the at least one array imager includes at least two imagers that have different pixel sizes.

6. The smartphone of claim 1 , wherein the at least one array imager includes at least two imagers that have a same resolution.

7. The smartphone of claim 1 , wherein the first set of images is encoded using spatial prediction, temporal prediction, or spectral prediction.

8. The smartphone of claim 1 , wherein at least one imager among the plurality of first imagers and the at least one second imager is configured to sense visible light and at least one other imager among the plurality of first imagers and the at least one second imager is configured to sense infrared light.

9. The smartphone of claim 1 , further comprising an imaging controller to adjust at least one imager among the plurality of first imagers and the at least one second imager from being configured to sense visible light to being configured to sense infrared light and to adjust the at least one imager among the plurality of first imagers and the at least one second imager from being configured to sense infrared light to being configured to sense visible light.

10. The smartphone of claim 1 , wherein the at least one array imager is configured to capture 24 sets of images per second, 30 sets of images per second, or 60 sets of images per second.

11. The smartphone of claim 1 , wherein the one of the two or more distinct cores encodes the first set of images in a plurality of stages.

12. The smartphone of claim 11 , wherein the plurality of stages include a first stage to perform spatial prediction or spectral prediction, and a second stage to perform temporal prediction.

13. The smartphone of claim 1 , wherein the two or more distinct cores of the single processor includes three or more distinct cores of the single processor.

14. The smartphone of claim 1 , wherein the plurality of first imagers are aligned along a first direction and the at least one second imager is offset from the plurality of first imagers in a second direction perpendicular to the first direction.

15. The smartphone of claim 1 , wherein the display is disposed on a first side of the smartphone, and the array imager is disposed on the first side of the smartphone.

16. The smartphone of claim 15 , wherein at least one imager among the plurality of first imagers and the at least one second imager is configured to sense visible light and at least one other imager among the plurality of first imagers and the at least one second imager is configured to sense infrared light.

17. The smartphone of claim 15 , wherein the at least one array imager includes at least two imagers that have different filters.

18. The smartphone of claim 15 , wherein the at least one array imager includes at least two imagers that have different spectral sensitivities.

19. The smartphone of claim 15 , wherein the at least one array imager includes at least two imagers that have different pixel sizes.

20. The smartphone of claim 15 , wherein the at least one array imager includes at least two imagers that have a same resolution.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2022
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 060398/0082 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2022
From: BRETSCHER, JOHN T.; VAAS, RANDALL S.
To: MOTOROLA MOBILITY LLC
Reel/Frame 060423/0444 →