IP Library › Granted Patent US 10,477,137
Granted Patent B2
US 10,477,137 · App. 15/777,816 · Granted Nov 12, 2019

Array camera imaging system having distributed memory

Inventors: David Jones Brady (Durham, NC); Scott Thomas McCain (Durham, NC); Steven Douglas Feller (Durham, NC)
Assignee: Aqueti Incorporated
H04N5/765G06T3/40G06T3/4038H04N5/247H04N5/265H04N5/7605
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,477,137
App. No.
15/777,816
Granted
Nov 12, 2019
Kind
B2
Abstract

An array-camera imaging system and method for producing a rendered image are presented, wherein the system includes a plurality of imagers, a plurality of image processors, and a plurality of memory modules that are networked with the image processors via a communications bus. Each image processor provides processed and processed image data from at least one imager to the memory modules. Preferably, the processed image data is distributed among the memory modules at multiple resolution scales. In response to a request from an image rendering system, image data is read out from the memory modules at the resolution scale of the request.

Claims (34)

1. A system for forming an image of a scene, the system comprising:

(1) a plurality of imagers that is operative for providing a plurality of image-data sets, each imager including:

a first lens; and

a sensor array that is operative for receiving an optical sub-image of the scene from the first lens and providing an image-data set of the plurality thereof, the image-data set being based on the received optical sub-image;

(2) a plurality of processors that is operative for receiving the plurality of image-data sets and providing a plurality of processed image-data sets; and

(3) a plurality of memory modules, each of the plurality of memory modules being operative for storing a processed image-data set from each of at least two of the plurality of imagers, wherein said processed image-data at different resolution scales are distributed across the plurality of memory modules based on the resolution scale.

2. The system of claim 1 wherein at least one of the plurality of processors is operatively coupled with at least two imagers of the plurality thereof such that the at least one processor receives at least two image-data sets of the plurality thereof.

3. The system of claim 1 wherein at least one of the plurality of memory modules is operative for storing a first processed image-data set at a plurality of resolution scales.

4. The system of claim 3 wherein the plurality of memory modules is operative for storing a first processed image-data set at a hierarchy of resolution scales.

5. The system of claim 1 further comprising (4) a rendering processor that is operative for:

requesting an image of the scene at a first resolution scale; and

forming a composite image of the scene based on at least a first processed image-data set and a second processed image-data set of the plurality thereof received from a first memory module and second memory module of the plurality thereof.

6. The system of claim 1 further comprising (4) an objective lens that is operative for forming an intermediate image of the scene at a first focal region, wherein the plurality of imagers and the objective lens are arranged such that each first lens of the plurality thereof forms its respective optical sub-image by relaying a portion of the intermediate image onto its respective sensor array.

7. The system of claim 1 wherein the plurality of processors and the plurality of imagers are arranged such that at least one of the plurality of imagers provides a different portion of its respective image-data set to each of at least two processors of the plurality thereof.

8. The system of claim 1 further comprising an image-rendering processor that is operative for rendering an image of the scene based on processed image-data sets stored in a plurality of memory modules.

9. The system of claim 1 further comprising a first memory controller operative for routing image data to memory locations in the plurality of memory modules and maintaining a routing table for the stored image data.

10. The system of claim 9 further comprising a second memory controller and a third memory controller, each of the second and third memory controllers being operative for routing image data to at least one memory module of the plurality thereof and maintaining a routing table for the image data stored in its respective at least one memory module, wherein the second and third memory controllers route image data to different memory modules of the plurality thereof.

11. A method for forming an image of a scene, the method comprising:

providing a plurality of imagers, each imager comprising a sensor array and a lens that forms an optical sub-image of the scene on the sensor array;

providing a plurality of first image-data sets, wherein each first image-data set of the plurality thereof is based on a different optical sub-image of the plurality thereof; and

storing the plurality of first image-data sets in a plurality of memory modules such that each first image-data set is distributed among a plurality of memory modules wherein said processed image-data at different resolution scales are distributed across the plurality of memory modules based on the resolution scale.

12. The method of claim 11 further comprising:

at each sensor array of the plurality thereof, converting the optical sub-image into a second image-data set; and

processing the plurality of second image-data sets to provide the plurality of first image-data sets.

13. The method of claim 12 further comprising:

providing a plurality of processors for processing the plurality of second image-data sets; and

arranging the plurality of processors and the plurality of sensor arrays such that each sensor array provides its second image-data set to at least two processors of the plurality thereof.

14. The method of claim 12 further comprising forming an intermediate image of the scene at a first image field, wherein each lens of the plurality thereof forms its respective sub-image by relaying a portion of the intermediate image onto its respective sensor array.

15. The method of claim 11 wherein at least one first image-data set of the plurality thereof is stored in the plurality of memory modules at each of a plurality of resolution scales.

16. The method of claim 11 wherein at least one first image-data set of the plurality thereof is stored in the plurality of memory modules at a hierarchy of resolution scales.

17. The method of claim 11 further comprising:

retrieving image data from a plurality of memory modules, wherein the retrieved image data is included in at least one first image-data set; and

rendering the image of the scene based on the retrieved image data.

18. The method of claim 17 wherein the image data is retrieved from N memory modules, wherein N is based on the resolution scale at which the image is rendered.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AQUETI, INCORPORATED
To: TRANSFORMATIVE OPTICS CORPORATION
Reel/Frame 067007/0868 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2018
From: BRADY, DAVID JONES; MCCAIN, SCOTT THOMAS; FELLER, STEVEN DOUGLAS
To: AQUETI INCORPORATED
Reel/Frame 045863/0067 →
Continuity (1)
Related Publication 20180338108A1 · Nov 22, 2018
Cited By (1)
US 12,360,064