IP Library › Granted Patent US 10,497,767
Granted Patent B2
US 10,497,767 · App. 15/698,192 · Granted Dec 3, 2019

Low-visibility display sensing

Inventors: Junhua Tan (Santa Clara, CA); Sun-Il Chang (San Jose, CA); Sebastian Knitter (San Francisco, CA); Jie Won Ryu (Sunnyvale, CA); Hyunwoo Nho (Stanford, CA); Lu Zhang (Cupertino, CA); Nicolas P. Bonnier (Campbell, CA); Hung Sheng Lin (San Jose, CA); Rui Zhang (Santa Clara, CA)
Assignee: APPLE INC.
H01L27/3269G09G3/20G09G2310/0202G09G2360/141G09G2360/144G09G2360/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,497,767
App. No.
15/698,192
Granted
Dec 3, 2019
Kind
B2
Abstract

Electronic devices, storage medium containing instructions, and methods pertain to scanning a display during a sensing phase for the display. One or more parameters pertaining to operation or conditions around the display are obtained. Using the obtained one or more parameters, scanning mode parameters used for sensing are set based at least in part on the obtained one or more parameters. Using the scanning mode parameters, the display is scanned during a sensing phase of the display while reducing the likelihood of visible artifacts.

Claims (43)

1. An electronic device comprising:

a display including one or more pixels configured to:

display images during a display mode; and

provide information in response to a sense mode;

a memory storing instructions; and

a processor configured to execute the instructions, wherein the instructions are configured to cause the processor to:

receive a parameter pertaining to operation of the display or pertaining to conditions around the electronic device, wherein the parameter comprises luminance of user interface content including relatively darker content, relatively lighter content, or a combination thereof;

determine whether the parameter exceeds a threshold value for the parameter;

cause a scan of the display using a first scanning scheme during the sense mode when the parameter exceeds the threshold value; and

cause a scan of the display using a second scanning scheme during the sense mode when the parameter does not exceed the threshold value.

2. The electronic device of claim 1 , wherein the parameter comprises an ambient light level.

3. The electronic device of claim 2 , comprising an ambient light sensor to detect the ambient light level.

4. The electronic device of claim 1 , wherein the instructions are configured to cause the processor to scan pixels corresponding to the relatively lighter content using the first scanning scheme.

5. The electronic device of claim 1 , wherein the instructions are configured to cause the processor to scan pixels corresponding to the relatively darker content using the second scanning scheme.

6. A tangible, non-transitory, machine-readable storage medium storing one or more programs that are executable by one or more processors of an electronic device with a display, the one or more programs including instructions to:

receive one or more parameters corresponding to visibility of a sense mode of the display, wherein the one or more parameters comprise ambient light levels, video content luminance levels, location of one or more eyes, or any combination thereof, and the instructions are configured to cause the one or more processors to track the location of one or more eyes using a camera;

set one or more scanning mode parameters used for sensing based at least in part on the received one or more parameters to enable more aggressive scanning when the one or more parameters indicate a low visibility of the sense mode of the display, wherein setting one or more scanning mode parameters comprises:

determining whether a closest location of the one or more eyes is greater than a threshold distance away from the display;

utilizing a first set of scanning mode parameters when the closest location is greater than a threshold distance threshold away from the display; and

utilizing a second set of scanning mode parameters when the closest location is not greater than the threshold distance threshold away from the display, wherein the second set of scanning mode parameters are more likely to result in apparent artifacts than the first set of scanning mode parameters; and

scan the display using the scanning mode parameters.

7. The tangible, non-transitory, machine-readable storage medium of claim 6 , wherein setting one or more scanning mode parameters comprises:

determining whether a closest location of the one or more eyes is greater than a threshold distance away from the display;

determining whether any of the one or more eyes are directed at the display;

utilizing a first set of scanning mode parameters when the closest location is greater than a threshold distance threshold away from the display;

utilizing a second set of scanning mode parameters when the closest location is not greater than the threshold distance threshold away from the display and any of the one or more eyes within the threshold distance are directed at the display, wherein the second set of scanning mode parameters are more likely to result in apparent artifacts than the first set of scanning mode parameters; and

utilizing the first set of scanning mode parameters when the closest location is not greater than a threshold distance threshold away from the display but none of the one or more eyes within the threshold distance are directed at the display.

8. A method for sensing a display, comprising:

obtaining one or more parameters of operation of the display or conditions around the display;

setting scanning mode parameters used for sensing based at least in part on the obtained one or more parameters, wherein setting the scanning mode parameters comprises:

determining, for each obtained parameter of the one or more parameters, whether a value of the obtained parameter exceeds a first threshold;

setting the scanning mode to a first scanning scheme when the value of the obtained parameter exceeds the first threshold;

when the value of the obtained parameter does not exceed the first threshold, determining, for each obtained parameter of the one or more parameters, whether the value of the obtained parameter exceeds a second threshold; and

setting the scanning mode to a second scanning scheme when the value of the obtained parameter exceeds the second threshold; and

scanning the display using the scanning mode parameters during a sensing phase of the display.

9. The method of claim 8 , wherein the one or more parameters comprises an ambient light level, user interface luminance, eye locations, or any combination thereof.

10. The method of claim 8 , wherein the scanning mode parameters comprise a sensing current, a number of pixels per line scanned, colors of pixels that are to be scanned, or some combination thereof.

11. The method of claim 8 , wherein setting the scanning mode parameters comprises: setting the scanning mode to a third scanning scheme when the value of the obtained parameter exceeds a third threshold.

12. The method of claim 11 , wherein the first scanning scheme comprises scanning all colors of pixels of the display using the same scanning mode parameters.

13. The method of claim 12 , wherein the second scanning scheme comprises using reduced values for one or more of the scanning mode parameters for at least one of the colors of pixels of the display.

14. The method of claim 13 , wherein the at least one of the colors comprises blue or green colored pixels.

15. The method of claim 8 , wherein the first scanning scheme comprises using all pixel colors and the second scanning scheme comprises using only a portion of the colors.

16. The method of claim 15 , wherein the second scanning scheme utilizes, for at least one color of the pixel colors, a lower sensing level or lower number of pixels per scan than used for other colors of the pixel colors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2017
From: TAN, JUNHUA; CHANG, SUN-IL; KNITTER, SEBASTIAN; RYU, JIE WON; NHO, HYUNWOO; ZHANG, LU; BONNIER, NICOLAS P.; LIN, HUNG SHENG; ZHANG, RUI
To: APPLE INC.
Reel/Frame 043526/0669 →
Continuity (2)
Provisional Application 62396659 · Sep 19, 2016
Related Publication 20180082633A1 · Mar 22, 2018