IP Library › Granted Patent US 12,242,070
Granted Patent B2
US 12,242,070 · App. 18/539,088 · Granted Mar 4, 2025

Modifying display operating parameters based on light superposition from a physical environment

Inventors: Anselm Grundhoefer (Campbell, CA); Michael J. Rockwell (Palo Alto, CA)
Assignee: APPLE INC.
G02B27/0172G06F3/1407G02B2027/0112G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,242,070
App. No.
18/539,088
Granted
Mar 4, 2025
Kind
B2
Abstract

A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.

Claims (38)

1. A method comprising:

at an electronic device including one or more processors, a non-transitory memory, and a translucent display:

obtaining a plurality of light superposition characteristic values associated with ambient light from a physical environment, wherein the ambient light emanates from the physical environment towards one side of the translucent display and the plurality of light superposition characteristic values quantifies interactions with the ambient light;

determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and a predetermined display characteristic of a computer-generated reality (CGR) object; and

changing a tint level associated with the translucent display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristic of the CGR object within a performance threshold.

2. The method of claim 1 , wherein changing the tint level associated with the translucent display includes globally tinting the translucent display.

3. The method of claim 1 , wherein changing the tint level associated with the translucent display includes tinting a portion of the translucent display that is less than the entirety of the translucent display.

4. The method of claim 3 , wherein the portion of the translucent display corresponds to a location on the translucent display where the CGR object is to be displayed.

5. The method of claim 1 , wherein the electronic device includes a plurality of tinting layers and changing the tint level associated with the translucent display includes applying one or more of the plurality of tinting layers.

6. The method of claim 5 , wherein each of plurality of tinting layers is associated with a respective opacity value.

7. The method of claim 1 , wherein the predetermined display characteristic of the CGR object includes a predetermined brightness characteristic of the CGR object.

8. The method of claim 1 , further comprising adding colors to the translucent display in order to satisfy the predetermined display characteristic of the CGR object within the performance threshold.

9. The method of claim 1 , further comprising:

rendering the CGR object; and

adding the CGR object to the translucent display after changing the tint level.

10. The method of claim 1 , wherein changing the tint level comprises locally dimming the translucent display at a location corresponding to the CGR object.

11. An electronic device comprising:

one or more processors;

a non-transitory memory;

a translucent display; and

one or more programs, wherein the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

obtaining a plurality of light superposition characteristic values associated with ambient light from a physical environment, wherein the ambient light emanates from the physical environment towards one side of the translucent display and the plurality of light superposition characteristic values quantifies interactions with the ambient light;

determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and a predetermined display characteristic of a computer-generated reality (CGR) object; and

changing a tint level associated with the translucent display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristic of the CGR object within a performance threshold.

12. The electronic device of claim 11 , wherein changing the tint level associated with the translucent display includes globally tinting the translucent display.

13. The electronic device of claim 11 , wherein changing the tint level associated with the translucent display includes tinting a portion of the translucent display that is less than the entirety of the translucent display.

14. The electronic device of claim 13 , wherein the portion of the translucent display corresponds to a location on the translucent display where the CGR object is to be displayed.

15. The electronic device of claim 11 , wherein the electronic device includes a plurality of tinting layers and changing the tint level associated with the translucent display includes applying one or more of the plurality of tinting layers.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors and a translucent display, cause the electronic device to:

obtain a plurality of light superposition characteristic values associated with ambient light from a physical environment, wherein the ambient light emanates from the physical environment towards one side of the translucent display and the plurality of light superposition characteristic values quantifies interactions with the ambient light;

determine a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and a predetermined display characteristic of a computer-generated reality (CGR) object; and

change a tint level associated with the translucent display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristic of the CGR object within a performance threshold.

17. The non-transitory computer readable storage medium of claim 16 , wherein the electronic device includes a plurality of tinting layers associated with respective opacity values and changing the tint level associated with the translucent display includes applying one or more of the plurality of tinting layers.

18. The non-transitory computer readable storage medium of claim 16 , wherein the predetermined display characteristic of the CGR object includes a predetermined brightness characteristic of the CGR object.

19. The non-transitory computer readable storage medium of claim 16 , wherein the instructions further cause the electronic device to add colors to the translucent display in order to satisfy the predetermined display characteristic of the CGR object within the performance threshold.

20. The non-transitory computer readable storage medium of claim 16 , wherein the instructions further cause the electronic device to:

render the CGR object; and

add the CGR object to the translucent display after changing the tint level.

Continuity (3)
Continuation 17028043 · Sep 22, 2020
Provisional Application 62939815 · Nov 25, 2019
Related Publication 20240111162A1 · Apr 4, 2024
References Cited (27)
US 9904058B2 · Yeoh et al. · 2018 [cited by applicant]
US 10345151B1 · Sarkar et al. · 2019 [cited by applicant]
US 10643548B2 · Seibert et al. · 2020 [cited by applicant]
US 10798373B2 · Speigle et al. · 2020 [cited by applicant]
US 20130141434A1 · Sugden et al. · 2013 [cited by applicant]
US 20130194259A1 · Bennett et al. · 2013 [cited by applicant]
US 20130221855A1 · Lazaridis et al. · 2013 [cited by applicant]
US 20160048021A1 · Border · 2016 [cited by applicant]
US 20160133227A1 · Yoon et al. · 2016 [cited by applicant]
US 20160225190A1 · Yamazaki · 2016 [cited by applicant]
US 20170221450A1 · Kim et al. · 2017 [cited by applicant]
US 20170343809A1 · Benesh et al. · 2017 [cited by applicant]
US 20180332268A1 · Xiao et al. · 2018 [cited by applicant]
US 20190094554A1 · Benesh et al. · 2019 [cited by applicant]
US 20200128173A1 · Lee et al. · 2020 [cited by applicant]
US 20210141229A1 · Mathur et al. · 2021 [cited by applicant]
US 20220237913A1 · Wyble et al. · 2022 [cited by applicant]
CN 109144264A · 2019 [cited by applicant]
KR 20160055534A · 2016 [cited by applicant]
KR 1020180108041A · 2018 [cited by applicant]
WO 2018174648A1 · 2018 [cited by applicant]
WO 2020023266A1 · 2020 [cited by applicant]
Office Action for corresponding Korean Appl. No. 10-2020-0126028 dated Dec. 23, 2021. [cited by applicant]
Office Action for corresponding Korean Appl. No. 10-2022-0124355 dated Jan. 27, 2023. [cited by applicant]
Kyu-Ho Lee et al., “Visibility Enhancement Via Optimal Gamma Tone Mapping for OST Displays Under Ambient Light,” 2017 IEEE International Conference on Image Processing (ICIP). IEEE, 2017, pp. 470-474. [cited by applicant]
Thomas H. Harding et al., “Modeling perceptual color confusion of helmet-mounted display symbology as a function of see-through contrast,” Optical Engineering 58.5 (2019): 051804-051804, pp. 1-11. [cited by applicant]
Notification of the First Office Action for Chinese Application No. 202011031426.5 dated Apr. 25, 2024, pp. 1-17 (Includes English Translation of Office Action). [cited by applicant]
Cited By (1)
US 12,744,019