IP Library › Granted Patent US 10,963,998
Granted Patent B1
US 10,963,998 · App. 16/705,025 · Granted Mar 30, 2021

Electronic devices with dynamic control of standard dynamic range and high dynamic range content

Inventors: Teun R. Baar (San Francisco, CA); Jiaying Wu (San Jose, CA); Nicolas P. Bonnier (Campbell, CA); Ramin Samadani (Menlo Park, CA)
Assignee: Apple Inc.
G06T5/008G06F3/013G06F3/04812G06F3/04847G06T5/50G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,963,998
App. No.
16/705,025
Granted
Mar 30, 2021
Kind
B1
Abstract

An electronic device may be provided with a display. Standard and high dynamic range content may be produced by content generators operating on control circuitry. Standard dynamic range content and high dynamic range content may be simultaneously displayed. Tone mapping parameters may be produced by a tone mapping engine for use in displaying the standard and high dynamic range content. The tone mapping parameters may be selected based on factors such as ambient light level, user brightness setting, content statistics, display characteristics, point of gaze information, power consumption information, and per-window information. Tone mapping parameters may be selected to accommodate simultaneous display of standard and high dynamic range content. Tone mapping parameters may be temporarily modified in response to a user's point of gaze switching between standard dynamic range content and high dynamic range content.

Claims (45)

1. An electronic device, comprising:

a gaze-tracker that obtains point of gaze information;

a display; and

control circuitry configured to:

generate first content having a first dynamic range and a first maximum brightness level;

generate second content having a second dynamic range that is larger than the first dynamic range and a second maximum brightness level that is brighter than the first maximum brightness level;

while at a first point of gaze determined using the point of gaze information, simultaneously display the first and second content using the first and second maximum brightness levels, wherein a difference between the first and second maximum brightness levels has a first magnitude while at the first point of gaze; and

in response to detecting a change from the first point of gaze to a second point of gaze based on the point of gaze information, change the difference between the first and second maximum brightness levels from a first magnitude to a second magnitude that is different than the first magnitude.

2. The electronic device defined in claim 1 , wherein the control circuitry is configured to:

provide initial first and second maximum brightness levels for the first and second content based at least on ambient light conditions; and

in response to detecting the change from the first point of gaze to the second point of gaze based on the point of gaze information, modifying the initial first and second maximum brightness levels to determine the first and second maximum brightness levels that are used to simultaneously display the first and second content.

3. The electronic device defined in claim 2 , wherein the first point of gaze overlaps the first content and the second point of gaze overlaps the second content.

4. The electronic device defined in claim 2 , wherein the first point of gaze overlaps the second content and the second point of gaze overlaps the first content.

5. The electronic device defined in claim 2 , wherein providing the initial first and second maximum brightness levels for the first and second content based at least on the ambient light conditions comprises providing the initial first and second maximum brightness levels for the first and second content based at least on the ambient light conditions, at least one brightness setting, display characteristics associated with the display, and content statistics.

6. The electronic device defined in claim 1 , wherein the first point of gaze overlaps the first content and the second point of gaze overlaps the second content.

7. The electronic device defined in claim 1 , wherein the first point of gaze overlaps the second content and the second point of gaze overlaps the first content.

8. The electronic device defined in claim 1 , wherein the control circuitry is configured to, in response to detecting the change from the first point of gaze to the second point of gaze:

increase the first maximum brightness level from a third magnitude to a fourth magnitude then decrease the first maximum brightness level from the fourth magnitude back towards the third magnitude.

9. The electronic device defined in claim 8 , wherein the control circuitry is configured to, in response to detecting the change from the first point of gaze to the second point of gaze:

decrease the second maximum brightness level from a fifth magnitude to a sixth magnitude.

10. The electronic device defined in claim 1 , wherein changing the difference between the first and second maximum brightness levels from the first magnitude to the second magnitude that is different than the first magnitude comprises changing the first maximum brightness level.

11. The electronic device defined in claim 1 , wherein changing the difference between the first and second maximum brightness levels from the first magnitude to the second magnitude that is different than the first magnitude comprises changing the second maximum brightness level.

12. The electronic device defined in claim 1 , wherein:

after changing the difference between the first and second maximum brightness levels from the first magnitude to the second magnitude, the second maximum brightness level remains brighter than the first maximum brightness level.

13. An electronic device, comprising:

a display; and

control circuitry configured to:

generate first content having a first dynamic range;

generate second content having a second dynamic range that is different than the first dynamic range;

simultaneously display the first and second content; and

in response to received point of gaze information indicating a change from a first point of gaze on the first content to a second point of gaze on the second content, gradually change a difference between magnitudes of maximum brightness levels of the first and second content.

14. The electronic device defined in claim 13 , wherein the point of gaze information includes information from a gaze-tracker.

15. The electronic device defined in claim 13 , wherein the first content is contained in a first window on the display, wherein the second content is contained in a second window on the display, and wherein the point of gaze information includes active window information.

16. The electronic device defined in claim 15 , wherein gradually changing the difference between magnitudes of maximum brightness levels of the first and second content comprises gradually changing a maximum brightness level of at least one of the first and second content based on a respective size and location of each of the first and second windows.

17. The electronic device defined in claim 13 , wherein the point of gaze information includes cursor location information.

18. The electronic device defined in claim 13 , further comprising:

an input-output device, wherein the point of gaze information includes information from the input-output device.

19. The electronic device defined in claim 13 , wherein the second dynamic range is greater than the first dynamic range both before and after gradually changing the difference between magnitudes of maximum brightness levels of the first and second content.

20. An electronic device, comprising:

a display; and

control circuitry configured to:

generate first content having a first dynamic range;

generate second content having a second dynamic range that is less than the first dynamic range;

simultaneously display the first and second content using respective tone mapping parameters; and

in response to received point of gaze information indicating a change in point of gaze from the first content to the second content, change a tone mapping parameter for a selected one of the first content and the second content from a first magnitude at a first time to a second magnitude at a second time subsequent to the first time, wherein the tone mapping parameter has at least one intermediate magnitude between the first magnitude and second magnitude at a time between the first and second times and wherein, after changing the tone mapping parameter, the second dynamic range remains less than the first dynamic range.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2019
From: BAAR, TEUN R.; WU, JIAYING; BONNIER, NICOLAS P.; SAMADANI, RAMIN
To: APPLE INC.
Reel/Frame 051196/0207 →
Priority Claims (1)
CN 201911134736.7 · Nov 19, 2019 · national
Cited By (8)
US 12,211,466 US 12,288,316 US 12,327,500 US 12,394,176 US 12,483,682 US 12,567,364 US 12,592,177 US 12,725,484