IP Library › Granted Patent US 9,530,342
Granted Patent B2
US 9,530,342 · App. 14/023,326 · Granted Dec 27, 2016

Ambient light context-aware display

Inventors: Cynthia Sue Bell (Kirkland, WA); Kevin Woo (Bellevue, WA); Philip L. Barnes (Seattle, WA); Steven C. Glenner (Bellevue, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G09G3/2003G09G2320/0242G09G2320/0626G09G2320/0653G09G2320/0666G09G2320/0673G09G2340/06G09G2360/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,530,342
App. No.
14/023,326
Granted
Dec 27, 2016
Kind
B2
Abstract

Embodiments are disclosed that relate to modifying a display of a portable electronic device to account for ambient light. For example, one disclosed embodiment provides a method comprising determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by an ambient light sensor, reading a display-ready image having a plurality of pixels from an image source, adjusting a manner in which the display-ready image is displayed by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, and displaying the color-modified image on the display of the portable electronic device.

Claims (59)

1. A portable electronic device comprising:

a display;

a light sensor configured to sense an ambient light color condition;

a processor configured to:

determine an ambient light history including a plurality of ambient light color conditions, including a plurality of correlated color temperatures and luminance data, sensed over a duration of device operation by a light sensor;

read a display-ready image from an image source, the display-ready image having a plurality of pixels;

adjust a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, wherein color-shifting the subset of the plurality of pixels includes adjusting white points of the subset of the plurality of pixels;

display the color-modified image on the display of the portable electronic device;

detect a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history; and

apply a dimming pattern with a target brightness that varies with time to effect a graduated dimming of the brightness of the display over a predetermined time in response to the detection of the threshold brightness decrease.

2. The portable electronic device of claim 1 , wherein the light sensor is an ambient light sensor configured to detect a luminance.

3. The portable electronic device of claim 1 , wherein the light sensor is a camera.

4. The portable electronic device of claim 3 ,

wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to capture ambient light; and

wherein the processor is configured to determine the ambient light history including the plurality of ambient light color conditions sensed over the duration of device operation by both the front and the rear camera to determine the ambient light history.

5. The portable electronic device of claim 1 ,

wherein the plurality of ambient color conditions includes a white point.

6. The portable electronic device of claim 1 , the processor further configured to:

detect a threshold brightness increase during a predetermined time period based on the luminance data in the ambient light history; and

apply a brightening pattern with a target brightness that varies with time to effect a graduated brightening of the brightness of the display over a predetermined time in response to the detection of the threshold brightness increase;

wherein the brightening pattern increases the brightness at a faster rate than the dimming pattern decreases the brightness.

7. The portable electronic device of claim 1 ,

wherein the image source includes an associated display pipeline from which the display-ready image is read; and

wherein color-shifting at least the subset of the plurality of pixels occurs after the display-ready image is read from the associated display pipeline of the image source.

8. The portable electronic device of claim 1 , wherein the processor is configured to modify a gamma curve and/or background brightness level associated with the display to adjust the manner in which the display-ready image is displayed.

9. The portable electronic device of claim 1 , wherein the processor is configured to modify color reproduction and/or peak luminance associated with the display-ready image to adjust the manner in which the display-ready image is displayed.

10. The portable electronic device of claim 1 , where the processor is further configured to:

transmit user profile data including the ambient light history, mode settings, and/or contextual data to one or more other computing devices each having a display to enable images displayed on the one or more other computing devices to be color-modified based on the transmitted user profile data.

11. A portable electronic device, comprising:

a display;

a light sensor configured to sense an ambient light color condition;

a processor configured to execute an adaptive display module, the adaptive display module configured to:

determine an ambient light history including a plurality of ambient light color conditions, including a plurality of correlated color temperatures and luminance data, sensed over a duration of device operation by the light sensor;

read a display-ready image from an image source, the display-ready image having a plurality of pixels;

adjust a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, wherein color-shifting the subset of the plurality of pixels includes adjusting white points of the subset of the plurality of pixels;

display the color-modified image on the display;

detect a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history; and

apply a dimming pattern with a target brightness that varies with time to effect a graduated dimming of the brightness of the display over a predetermined time in response to the detection of the threshold brightness decrease.

12. The portable electronic device of claim 11 , wherein the light sensor is an ambient light sensor configured to detect a luminance.

13. The portable electronic device of claim 11 , wherein the light sensor is a camera.

14. The portable electronic device of claim 13 ,

wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to configured to capture ambient light; and

wherein the ambient light history includes a plurality of ambient light color conditions sensed over a duration of device operation by both the front camera and the rear camera.

15. The portable electronic device of claim 11 ,

wherein the plurality of ambient light color conditions includes a white point.

16. The portable electronic device of claim 11 ,

wherein the adaptive display module is configured to determine a display brightness change responsive to the luminance data; and

wherein the adaptive display module is configured to detect a threshold brightness increase during a predetermined time period based on the luminance data in the ambient light history, and apply a brightening pattern with a target brightness that varies with time to effect a graduated brightening of the brightness of the display over a predetermined time;

wherein the brightening pattern increases the brightness at a faster rate than the dimming pattern decreases the brightness.

17. The portable electronic device of claim 11 , wherein the ambient light history has a temporal duration of at least ten minutes.

18. A method for adjusting a display to account for ambient light, the method comprising:

at a portable electronic device:

receiving ambient light data from an ambient light sensor, the ambient light data including ambient color data indicating an ambient light condition external to the portable electronic device and luminance data;

receiving contextual data from a contextual data source;

reading a display-ready image from an image source, the display-ready image having a plurality of pixels;

modifying one or more properties of at least a subset of the plurality of pixels based on at least the ambient light data and the contextual data;

displaying the modified display-ready image on the display;

detecting a threshold brightness decrease during a predetermined time period based on the luminance data; and

applying a dimming pattern with a target brightness that varies with time to effect a graduated dimming of the brightness of the display over a predetermined time in response to the detecting of the threshold brightness decrease.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2016
From: BELL, CYNTHIA SUE; WOO, KEVIN; BARNES, PHILIP L.; GLENNER, STEVEN C.
To: MICROSOFT CORPORATION
Reel/Frame 037601/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
Continuity (1)
Related Publication 20150070337A1 · Mar 12, 2015