IP Library Granted Patent US 11,747,135
Granted Patent B2
US 11,747,135 · App. 16/516,664 · Granted Sep 5, 2023

Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

Inventors: Srinivasa Narasimhan (McDonald, PA); Supreeth Achar (Seattle, WA); Matthew O'Toole (Palo Alto, CA); Kiriakos Neoklis Kutulakos (Toronto, CA)
Assignees: Carnegie Mellon University; The Governing Council of the University of Toronto
G01B11/2513G01B11/2518G01B11/2545G03B21/2033H04N5/30H04N9/3129H04N13/271G06T7/521G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,747,135
App. No.
16/516,664
Granted
Sep 5, 2023
Kind
B2
Abstract

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

Claims (28)

1. A method of detecting an image, comprising:

enabling a first row of a pixels of a two-dimensional pixel array to detect light reflected from at least one object illuminated by a first light pulse from a first scanning line of a directable light source, the first row of pixels in an epipolar configuration with the first scanning line; and

enabling a second row of pixels of a two-dimensional pixel array to detect light reflected from the at least one object illuminated by a second light pulse from a second scanning line of the directable light source, the second row of pixels in an epipolar configuration with the second scanning line.

2. The method of claim 1 , further comprising:

generating detection signals corresponding to the detected light reflected from the at least one object when illuminated by each of the first and second light pulses.

3. The method of claim 2 further comprising:

generating depth information based on the generated detection signals corresponding to the detected light reflected from the object by the first and second light pulses.

4. The method of claim 2 , wherein enabling the two-dimensional pixel array to detect light reflected from the at least one object illuminated by the first or second light pulses comprises:

determining an active region of the two-dimensional pixel array corresponding to a portion of the object being illuminated by the first or second light pulse; and

enabling the determined active region during the first or second light pulses.

5. A device, comprising:

a two-dimensional pixel array comprising a plurality of lines of pixels;

a directable light source; and

a controller to:

enable a first row of pixels of the two-dimensional pixel array to detect light reflected from at least one object illuminated by a first light pulse from a first scanning line of the directable light source, the first row of pixels in an epipolar configuration with the first scanning line; and

enable a second row of pixels of the two-dimensional pixel array to detect light reflected from the at least one object illuminated by a second light pulse from a second scanning line of the directable light source, the second row of pixels in an epipolar configuration with the second scanning line.

6. The device of claim 5 wherein the controller further:

generates detection signals corresponding to the detected light reflected from the object when illuminated by each of the first and second light pulses;

generates depth information based on the generated detection signals.

7. The device of claim 5 wherein the controller further:

determines a sequence of portions of the object to be illuminated;

directs the directable light source to sequentially illuminate the sequence of portions; and

directs the two-dimensional pixel array to sequentially capture light from the sequence of illuminated portions.

8. The device of claim 7 wherein the controller further:

temporally synchronizes the directable light source and the two-dimensional pixel array such that the two-dimensional pixel array captures light from a portion of the object illuminated by the directable light source.

9. The device of claim 7 wherein the controller further:

spatially synchronizes the directable light source and the two-dimensional pixel array such that the directable light source illuminates a portion of the object that the two-dimensional pixel array is configured to capture.

10. The device of claim 9 wherein the sequence of portions of the object to be illuminated is chosen to maximize total energy transferred from the directable light source to the two-dimensional pixel array.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: NARASIMHAN, SRINIVASA; ACHAR, SUPREETH
To: CARNEGIE MELLON UNIVERSITY
Reel/Frame 056620/0628 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: O'TOOLE, MATTHEW; KUTULAKOS, KIRIAKOS NEOKLIS
To: THE GOVERNING COUNCIL OF THE UNIVERSITY OF TORONTO
Reel/Frame 056620/0895 →
CONFIRMATORY LICENSE Recorded Sep 23, 2019
From: CARNEGIE-MELLON UNIVERSITY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 050460/0280 →
Continuity (3)
Continuation 15545391
Provisional Application 62176352 · Feb 13, 2015
Related Publication 20200018592A1 · Jan 16, 2020