IP Library Granted Patent US 9,615,022
Granted Patent B2
US 9,615,022 · App. 14/566,835 · Granted Apr 4, 2017

High-resolution imaging devices using low-resolution sensors and compressive sensing exploiting joint sparsity

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,615,022
App. No.
14/566,835
Granted
Apr 4, 2017
Kind
B2
Abstract

A method and system for reconstructing an image of a scene comprises configuring a digital light modulator according to a spatially varying pattern. Light energy associated with the scene and incident on the spatially varying pattern is collected and optically focused on the photodetectors. Data indicative of the intensity of the focused light energy from each of said at least two photodetectors is collected. Data from the photodetectors is then combined to reconstruct an image of the scene.

Claims (50)

1. A method for ‘reconstructing: an Image of a scene comprising; configuring a digital light modulator according to a spatially varied pattern; collecting and optically focusing light energy associated with said scene incident on said spatially varying pattern on each of at least two photodetectors; altering said spatially varied pattern at least once and collecting and optically focusing light energy associated with said scene incident on said at least one altered spatially varied pattern on each of said at least two photodetectors; collecting data indicative of an intensity of the focused light energy from each of said at least two photodetectors for each of said at least one altered spatially varied pattern: and combining said data from said at least two photodetectors to reconstruct an image of said scene; combining said data from said at least two photodetectors to reconstruct an image of said scene further comprises: forming a plurality of photodetector groups by associating at least two photodetectors with at least two overlapping groups of elements in said digital light modulator, wherein said image of said scene associated with each photodetector meets a sparsity requirement;

aggregating said data associated with each of said photodetector groups; applying a compressive sensing algorithm on said aggregated data from each of said photodetector groups to create an image associated with each of said photodetector groups; and arranging said images associated with each of said photodetector groups according to the relative location of the photodetector groups.

2. The method of claim 1 wherein combining said data from said at least two photodetectors to reconstruct an image of said scene further comprises:

applying a compressive sensing reconstruction algorithm on said data from each of said at least two photodetectors independently to create an image associated with each of said photodetectors; and

arranging said images associated with each of said at least two photodetectors according to a relative location of the photodetectors.

3. The method of claim 1 wherein combining said data from said at least two photodetectors to reconstruct an image of said scene further comprises:

forming a plurality of photodetector groups by associating said at least two photodetectors with at least two groups of elements in said digital light modulator, wherein said image of said scene associated with each photodetector meets a sparsity requirement;

applying a compressive sensing algorithm on said collected data from each of said photodetector groups to create an image associated with each of said photodetector groups; and

arranging said images associated with each of said photodetector groups according to the relative location of the photodetector groups.

4. The method of claim 3 wherein said sparsity requirement is a joint sparsity requirement.

5. The method of claim 4 wherein said joint sparsity requirement is one of:

a sparse common component model; and

a common supports model.

6. The method of claim 3 wherein said at least two photodetectors comprise at least two pixels associated with a sensor.

7. The method of claim 1 wherein said sparsity requirement is a joint spartsity requirement comprising one of: a sparse common component model; and a common supports model.

8. The method of claim 1 wherein said digital light modulator comprises at least one of:

an array of at least one pixel;

an array of at least one transmissive light modulator;

an array of at least one reflective light modulator; and

an array of micro-mirrors.

9. A method for reconstructing an image of a scene comprising:

configuring a digital light modulator according to a spatially varied pattern;

collecting and optically focusing light energy associated with said scene incident on said spatially varied scan pattern on each of at least two photodetectors comprising pixels associated with a sensor;

altering said spatially varied pattern at least once and collecting and optically focusing light energy associated with said scene incident on said at least one altered spatially varied pattern on each of said at least two photodetectors:

collecting data indicative of an intensity of the focused light energy from each of said at least two pixels for each of said at least one altered spatially varied pattern;

forming a plurality of photodetector groups by associating at least two photodetectors with at least two overlapping groups of elements in said digital light modulator, wherein said image of said scene associated with each photodetector meets a sparsity requirement;

aggregating said data associated with each of said photodetector groups;

applying a compressive sensing algorithm on said aggregated data from each of said photodetector groups to create an image associated with each of said photodetector groups; and

arranging said images associated with each of said photodetector groups adjacent to each other in order to reconstruct said image of said scene.

10. The method of claim 9 wherein collecting and optically focusing light energy associated with a scene incident on said at least one spatially varied pattern on each of at least two photodetectors comprising pixels associated with a sensor further comprises:

directing said light energy passing through at least one discrete sub-section of said at least one spatially varied pattern on a discrete one of said at least two photodetectors.

11. The method of claim 10 wherein said sparsity requirement is a joint sparsity requirement.

12. The method of claim 11 wherein the joint sparsity requirement is one of:

a sparse common component model; and

a common supports model.

13. The method of claim 12 wherein said digital light modulator comprises at least one of:

an array of at least one pixel;

an array of at least one transmissive light modulator;

an array of at least one reflective light modulator; and

an array of micro-mirrors.

14. A system for reconstructing an image of a scene comprising: a digital fight modulator configured according to a spatially varied pattern wherein said spatially varied pattern is altered at least once:

a lens system configured to optically focus light energy associated with said scene incident on said at least one spatially varying varied pattern on each of at least two photodetectors,

wherein said at least two photodetectors collect data Indicative of an intensity of the focused light energy; and a processing module configured to combine said data from said at least two photodetectors for each of said at least one altered spatially varied pattern to reconstruct an image of said scene wherein said processing module configured to combine said data from said at least two photodetectors to reconstruct an image of said scene further comprises:

a pixel grouping module configured to form a plurality of photodetector groups by associating said at least two photodetectors with at least two groups of elements in said digital fight modulator, wherein said image of said scene associated with each photodetector meets a sparsity requirement; a compressive sensing module configured to apply a compressive sensing algorithm on said collected data from each of said photodetector groups to create an image associated with each of said photodetector groups; and an electronic stitching module configured to arrange said images associated with each of said photodetector groups according to the relative location of the photodetector groups.

15. The system of claim 14 wherein said processing module configured to combine said data from said at least two photodetectors to reconstruct an image of said scene further comprises:

a compressive sensing module configured to apply a compressive sensing reconstruction algorithm on said data from each of said at least two photodetectors independently to create an image associated with each of said photodetectors; and

an electronic stitching module configured to arrange said images associated with each of said at least two photodetectors according to a relative location of the photodetectors.

16. The system of claim 14 wherein said sparsity requirement is a joint sparsity requirement comprising one of: a sparse common component model; and a common supports model.

17. The system of claim 14 wherein said at least two photodetectors comprise at least two pixels associated with a sensor.

18. The system of claim 14 wherein said digital light modulator, said lens system, said at least two pixels, and said processing module are integrated in an image capturing device.

Assignments (4)
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2017
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 041542/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2014
From: BERNAL, EDGAR A.; WEN, XUEJIN; LI, QUN; BALA, RAJA
To: XEROX CORPORATION
Reel/Frame 034476/0871 →