IP Library › Granted Patent US 10,043,051
Granted Patent B2
US 10,043,051 · App. 15/221,494 · Granted Aug 7, 2018

Triggered image sensing with a display

Inventors: Jiandong Huang (Bellevue, WA); Timothy Andrew Large (Bellevue, WA); Liying Chen (Redmond, WA); Steven Nabil Bathiche (Bellevue, WA)
Assignee: Microsoft Technology Licensing, LLC
G06K9/0004G06F3/042G06F3/044G06F3/045G06F3/0414G06F3/0421G06K9/0008G06K9/00013G06K9/00026G06K9/209G06K9/2027G06K9/2081G06T11/60H01L27/14609H01L27/3234H04N5/2253H04N5/2254H04N5/3698H01L27/323
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,043,051
App. No.
15/221,494
Granted
Aug 7, 2018
Kind
B2
Abstract

An electronic device includes a cover glass having a display surface, a pixelated photoemitting element array, and a pixelated photodetecting element array. The pixelated photoemitting element array emits a light signal through the cover glass to the display surface. The pixelated photodetecting element array is positioned relative to the pixelated photoemitting element array and the cover glass to receive a reflected light signal. The reflected light signal includes a portion of the emitted light signal reflected by total internal reflection from a refractive boundary at the display surface. Operation of each pixel is switched between the one or more photodetecting elements and the one or more photoemitting elements by the pixel selector signal component received from the pixel selector signal bus. A sensing trigger is configured to trigger the imaging scan by the pixelated photoemitting element array and the pixelated photodetecting element array, responsive to detection of an initiating action.

Claims (38)

1. An imaging system comprising:

a cover glass having a display surface;

a pixelated photoemitting element array, one or more selected photoemitting elements of the pixelated photoemitting element array being configured to emit a light signal through the cover glass to the display surface as part of an imaging scan;

a pixelated photodetecting element array positioned relative to the pixelated photoemitting element array and the cover glass to receive a reflected light signal at individual photodetecting elements of the pixelated photodetecting element array as part of the imaging scan; and

a sensing trigger configured to trigger the imaging scan by the pixelated photoemitting element array and the pixelated photodetecting element array, responsive to detection of an initiating action by the sensing trigger; and

wherein the reflected light signal received at individual photodetecting elements of the pixelated photodetecting element array comprises light which is reflected from a refractive boundary at the display surface of the cover glass by total internal reflection.

2. The imaging system of claim 1 wherein the sensing trigger includes a pressure sensor.

3. The imaging system of claim 1 wherein the sensing trigger includes a capacitive sensor.

4. The imaging system of claim 1 wherein the sensing trigger includes a resistive sensor.

5. The imaging system of claim 1 further comprising:

image processing circuitry coupled to the sensing trigger, the pixelated photoemitting element array and the pixelated photodetecting element array, the sensing trigger transmitting trigger data to image processing circuitry to initiate an imaging scan through the cover glass.

6. The imaging system of claim 1 further comprising:

image processing circuitry coupled to the sensing trigger, the pixelated photoemitting element array and the pixelated photodetecting element array, the sensing trigger transmitting location information in the trigger data to the image processing circuitry to localize the imaging scan through the cover glass.

7. The imaging system of claim 1 , wherein the pixelated photoemitting element array includes pixelated elements that are also light-emitting elements of the display surface.

8. The imaging system of claim 1 , wherein the reflected light signal passes through at least a portion of the display surface prior to arriving at the pixelated photodetecting element array.

9. A method comprising:

emitting a light signal through a cover glass of a display to a display surface of the display, the light signal being emitted from one or more selected photoemitting elements of a pixelated photoemitting element array of the display as part of an imaging scan;

capturing a reflected light signal at individual photodetecting elements of a pixelated photodetecting element array positioned relative to a pixelated photoemitting element array and the cover glass to receive the reflected light signal as part of the imaging scan; and

triggering the imaging scan by the pixelated photoemitting element array and the pixelated photodetecting element array, responsive to detection of an initiating action by a sensing trigger positioned relative to the pixelated photodetecting element array; and

wherein the reflected light signal received at individual photodetecting elements of the pixelated photodetecting element array comprises light which is reflected from a refractive boundary at the display surface of the cover glass by total internal reflection.

10. The method of claim 9 wherein the sensing trigger includes a pressure sensor.

11. The method of claim 9 wherein the sensing trigger includes a capacitive sensor.

12. The method of claim 9 wherein the sensing trigger includes a resistive sensor.

13. The method of claim 9 further comprising:

initiating the imaging scan through the cover glass responsive to receipt of triggering data transmitted by the imaging sensor and received by image processing circuitry.

14. The method of claim 9 further comprising:

localizing the imaging scan through the cover glass responsive to receipt of location information in the trigger data transmitted by the imaging sensor and received by the image processing circuitry.

15. An electronic device comprising:

a cover glass having a display surface;

a pixelated photoemitting element array, one or more selected photoemitting elements of the pixelated photoemitting element array being configured to emit a light signal through the cover glass to the display surface as part of an imaging scan;

a pixelated photodetecting element array positioned relative to the pixelated photoemitting element array and the cover glass to receive a reflected light signal at individual photodetecting elements of the pixelated photodetecting element array as part of the imaging scan;

a sensing trigger configured to trigger the imaging scan by the pixelated photoemitting element array and the pixelated photodetecting element array, responsive to detection of an initiating action by the sensing trigger; and

image processing circuitry coupled to the sensing trigger, the pixelated photoemitting element array and the pixelated photodetecting element array, the sensing trigger transmitting trigger data to image processing circuitry to initiate the imaging scan through the cover glass; and

wherein the reflected light signal received at individual photodetecting elements of the pixelated photodetecting element array comprises light which is reflected from a refractive boundary at the display surface of the cover glass by total internal reflection.

16. The electronic device of claim 15 wherein the sensing trigger includes a pressure sensor.

17. The electronic device of claim 15 wherein the sensing trigger includes a capacitive sensor.

18. The electronic device of claim 15 wherein the sensing trigger includes a resistive sensor.

19. The electronic device of claim 15 wherein the image processing circuitry is coupled to the sensing trigger, the pixelated photoemitting element array and the pixelated photodetecting element array, the sensing trigger transmitting location information in the trigger data to the image processing circuitry to localize the imaging scan through the cover glass.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2016
From: HUANG, JIANDONG; LARGE, TIMOTHY ANDREW; CHEN, LIYING; BATHICHE, STEVEN NABIL
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039280/0090 →
Continuity (2)
Provisional Application 62304853 · Mar 7, 2016
Related Publication 20170255809A1 · Sep 7, 2017
Cited By (1)
US 12,190,840