IP Library Granted Patent US 9,100,536
Granted Patent B2
US 9,100,536 · App. 14/043,993 · Granted Aug 4, 2015

Imaging device and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,100,536
App. No.
14/043,993
Granted
Aug 4, 2015
Kind
B2
Abstract

A display is disclosed that comprises an array of display pixels, in which light sensing pixels are interspersed with the display pixels substantially across the area of the display. At least one color display sub-pixel is arranged to be switched off when the corresponding color light sensor pixel closest to that display sub-pixel is detecting light to generate an image. A portable electronic device is disclosed which comprises the display. The display is then operable to capture an image from the light sensing pixels, so that for example it can then operate as one or more of a digital mirror, scanner, biometric lock or touch panel. When a user looks at the display for a video call, the captured image of the user appears to look directly the other party.

Claims (36)

1. A display, comprising:

an array of display pixels;

and in which

light sensing pixels are interspersed with the display pixels substantially across the area of the display; and

at least one colour display sub-pixel is arranged to be switched off when a corresponding colour light sensing pixel closest to that colour display sub-pixel is detecting light to generate an image.

2. A portable electronic device, comprising

a display according to claim 1 ; and

a housing, and in which

the portable electronic device is operable to capture an image from the light sensing pixels.

3. The portable electronic device according to claim 2 , configured to display the captured image on the display, thereby operating as a mirror.

4. The portable electronic device according to claim 2 , configured to scan an object placed on a surface of the display.

5. The portable electronic device according to claim 4 , in which if the light sensing pixels are greyscale, then the portable electronic device is configured to successively scan the object using each respective colour of sub-pixel in the display, and then combine the resulting scans to form a colour scan.

6. The portable electronic device according to claim 2 , configured to capture an image of part of a user using the light sensing pixels, and to selectively provide access to at least a first function in dependence upon whether the captured image of part of the user corresponds to a reference image of part of the user.

7. The portable electronic device according to claim 2 , configured to capture an image using the light sensing pixels, and detect a position at which an object in the image is touching the display.

8. The portable electronic device according to claim 7 , in which operation of a function of the device is modified in response to one or more detected positions of the object.

9. The portable electronic device according to claim 2 , comprising

a memory for storing the displayed image; and

an image processing apparatus operable to delete from the captured image a processed version of the displayed image.

10. A display according to claim 1 , in which:

the display pixels comprise red, green and blue display sub-pixels; and

the light sensing pixels comprise red, green and blue sensor sub-pixels;

and in which at least one sensor sub-pixel of one colour is positioned substantially between display sub-pixels of the other two colours.

11. A display according to claim 1 , in which:

microlenses are positioned substantially over respective light sensing pixels.

12. A display according to claim 1 , in which:

at least one light sensing sub-pixel is recessed with respect to the display pixels.

13. An imaging method for a display that comprises an array of display pixels, and in which light sensing pixels are interspersed with the display pixels substantially across an area of the display, the method comprising:

capturing an image responsive to detected light levels at each light sensor pixel within the display; wherein the step of capturing an image comprises

switching off at least one colour display sub-pixel when a corresponding colour light sensor pixel closest to that display sub-pixel is detecting light to capture the image.

14. The imaging method according to claim 13 for a portable electronic device comprising a housing and the display, the method comprising the steps of:

initiating a video call to a second party;

displaying an image received from the second party on the display of the portable electronic device; and

transmitting a captured image responsive to the detected light levels at each light sensor pixel within the display to the second party.

15. A non-transitory computer program product comprising processor implementable instructions that when implemented on a computer cause the computer to carry out an imaging method for a display that comprises an array of display pixels, and in which light sensing pixels are interspersed with the display pixels substantially across the area of the display, the method comprising:

capturing an image responsive to detected light levels at each light sensor pixel within the display; wherein the step of capturing an image comprises

switching off at least one colour display sub-pixel when a corresponding colour light sensor pixel closest to that display sub-pixel is detecting light to capture the image.

Assignments (3)
CHANGE OF NAME Recorded Oct 13, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 040350/0891 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2016
From: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 037954/0602 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2013
From: HUGHES, COLIN JONATHAN
To: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
Reel/Frame 031659/0588 →