IP Library › Granted Patent US 10,204,539
Granted Patent B2
US 10,204,539 · App. 15/278,767 · Granted Feb 12, 2019

Ambient light context-aware display

Inventors: Cynthia Sue Bell (Kirkland, WA); Kevin Woo (Bellevue, WA); Philip L. Barnes (Seattle, WA); Steven C. Glenner (Bellevue, WA)
Assignee: Microsoft Technology Licensing, LLC
G09G3/2003G09G3/007G09G3/2096G06F3/1423G09G2320/0242G09G2320/0606G09G2320/0626G09G2320/0653G09G2320/0666G09G2320/0673G09G2340/06G09G2354/00G09G2360/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,204,539
App. No.
15/278,767
Granted
Feb 12, 2019
Kind
B2
Abstract

Embodiments are disclosed that relate to modifying a display of a portable electronic device to account for ambient light. For example, one disclosed embodiment provides a method comprising determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by an ambient light sensor, reading a display-ready image having a plurality of pixels from an image source, adjusting a manner in which the display-ready image is displayed by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, and displaying the color-modified image on the display of the portable electronic device.

Claims (89)

1. A portable electronic device, comprising:

a display;

a light sensor; and

a processor configured to:

determine an ambient light color condition based on output from the light sensor;

read a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by a GPS unit of the portable electronic device;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

display the first color-modified image on the display of the portable electronic device;

read a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

display the second color-modified image on the display of the portable electronic device; and

output, at the display, a user interface operable to receive a user input turning on or off an ambient light matching mode, such that at least the subsets of the first and second plurality of pixels are color-shifted when the ambient light matching mode is turned on, and at least the subsets of the first and second plurality of pixels are not color-shifted when the ambient light matching mode is turned off.

2. The portable electronic device of claim 1 , wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

3. The portable electronic device of claim 1 ,

wherein the light sensor is a front camera, the portable electronic device further comprising a rear camera configured to capture ambient light; and

wherein the ambient light color condition is determined by both the front and the rear camera.

4. The portable electronic device of claim 1 ,

wherein the first display-ready image has a first white point substantially equal to 6500K; and

wherein the first color-modified image has a second white point different from the first white point.

5. The portable electronic device of claim 1 , wherein the ambient light color condition further includes luminance data, and wherein the processor is further configured to:

detect a threshold brightness increase based on the luminance data; and

apply a brightening pattern to effect a graduated brightening of the display.

6. The portable electronic device of claim 1 , wherein the ambient light color condition further includes luminance data, and wherein the processor is further configured to:

detect a threshold brightness decrease based on the luminance data; and

apply a dimming pattern to effect a graduated dimming of the display.

7. The portable electronic device of claim 1 ,

wherein the ambient light color condition is one of a plurality of ambient light color conditions of an ambient light history sensed over a duration of device operation; and

wherein the processor is configured to adjust the manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least the subset of the first plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate the first color-modified image.

8. The portable electronic device of claim 1 , wherein the ambient light color condition includes a white point; and

wherein adjusting the manner in which the first display-ready image is displayed includes adjusting respective white points of at least the subset of the first plurality of pixels.

9. The portable electronic device of claim 8 , wherein adjusting the respective white points of at least the subset of the first plurality of pixels includes adjusting respective chromaticity coordinates of at least the subset of the first plurality of pixels.

10. The portable electronic device of claim 8 ,

wherein the respective white points of at least the subset of the first plurality of pixels are increased in response to a transition from indoor light to outdoor light; and

wherein the respective white points of at least the subset of the first plurality of pixels are decreased in response to a transition from outdoor light to indoor light.

11. At a portable electronic device, a method, comprising:

determining an ambient light color condition based on output from a light sensor;

reading a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receiving clock data and a geographic location of the portable electronic device, the geographic location detected by a GPS unit of the portable electronic device;

adjusting a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

displaying the first color-modified image on a display; and

reading a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjusting a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

displaying the second color-modified image on the display; and

displaying a user interface operable to receive a user input turning on or off an ambient light matching mode, such that at least the subsets of the first and second plurality of pixels are color-shifted when the ambient light matching mode is turned on, and at least the subsets of the first and second plurality of pixels are not color-shifted when the ambient light matching mode is turned off.

12. The method of claim 11 , wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

13. The method of claim 11 ,

wherein the first display-ready image has a first white point substantially equal to 6500K; and

wherein the first color-modified image has a second white point different from the first white point.

14. The method of claim 11 ,

wherein the ambient light color condition further includes luminance data, the method further comprising:

detecting a threshold brightness increase based on the luminance data; and

applying a brightening pattern to effect a graduated brightening of the display.

15. The method of claim 11 ,

wherein the ambient light color condition further includes luminance data, the method further comprising:

detecting a threshold brightness decrease based on the luminance data; and

applying a dimming pattern to effect a graduated dimming of the display.

16. The method of claim 11 , wherein the ambient light color condition includes a white point; and

wherein adjusting the manner in which the first display-ready image is displayed includes adjusting respective white points of at least the subset of the first plurality of pixels.

17. A portable electronic device, comprising:

a display;

a light sensor;

a GPS unit; and

a processor configured to:

determine an ambient light color condition based on output from the light sensor, the ambient light color condition including a white point and luminance data;

read a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by the GPS unit of the portable electronic device;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by adjusting respective white points of at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

display the first color-modified image on the display of the portable electronic device;

read a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by adjusting respective white points of at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

display the second color-modified image on the display of the portable electronic device;

in response to detecting a threshold brightness increase based on the luminance data, apply a brightening pattern to effect a graduated brightening of the display;

in response to detecting a threshold brightness decrease based on the luminance data, apply a dimming pattern to effect a graduated dimming of the display; and

output, at the display, a user interface operable to receive a user input turning on or off an ambient light matching mode, such that the respective white points of at least the subsets of the first and second plurality of pixels are adjusted when the ambient light matching mode is turned on, and the respective white points of at least the subsets of the first and second plurality of pixels are not adjusted when the ambient light matching mode is turned off.

18. The portable electronic device of claim 17 , wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

19. A portable electronic device, comprising:

a display having a plurality of display pixels;

a light sensor;

a GPS unit; and

a processor configured to:

determine an ambient light color condition based on output from the light sensor;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by the GPS unit of the portable electronic device;

read a first display-ready image from an image source, the first display-ready image having a first plurality of image pixels;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a first subset of the plurality of display pixels relative to a corresponding subset of the first plurality of image pixels based on the ambient light color condition, the geographic location, and the clock data;

display the first display-ready image on the display of the portable electronic device including the color-shifted first subset of the plurality of display pixels;

read a second display-ready image from the image source, the second display-ready image having a second plurality of image pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a second subset of the plurality of display pixels relative to a corresponding subset of the second plurality of image pixels based on the geographic location and the clock data, and not based on the ambient light color condition; and

display the second display-ready image on the display of the portable electronic device including the color-shifted second subset of the plurality of display pixels.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2016
From: BELL, CYNTHIA SUE; WOO, KEVIN; BARNES, PHILIP L.; GLENNER, STEVEN C.
To: MICROSOFT CORPORATION
Reel/Frame 039878/0853 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2016
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039878/0939 →
Continuity (2)
Continuation 14023326 · Sep 10, 2013
Related Publication 20170076653A1 · Mar 16, 2017