IP Library › Granted Patent US 12,430,826
Granted Patent B2
US 12,430,826 · App. 17/454,124 · Granted Sep 30, 2025

Overlay contrast control in augmented reality displays

Inventor: John Tinsman (Fallbrook, CA)
Assignee: OpenTV, Inc.
G06T11/60A63F13/537G06T11/00G06T19/006G06T19/20A63F2300/8082G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,826
App. No.
17/454,124
Granted
Sep 30, 2025
Kind
B2
Abstract

Example embodiments provide systems and methods for overlay contrast control in augmented reality displays. In an example method, contrast enhancement data including data describing at least a portion of a background image for presentation under an informational overlay on a display device is accessed. The informational overlay includes at least one of a graphical element or a textual element to partially obscure a scene. Data identifying at least a portion of the information overlay under which the background image is to be presented is generated. The background image is presented on a display device atop the portion of the scene corresponding to the portion of the informational overlay, and the information overlay is presented on the display device atop the background image and the scene.

Claims (46)

1. A computerized method comprising:

causing, by one or more hardware processors, presentation of an information overlay atop a scene on a display device;

accessing scene change data indicating a change in the scene; and

modifying a visual emphasis of at least a portion of the informational overlay based on the scene change data.

2. The computerized method of claim 1 , wherein the scene is a representation of an actual environment or a virtual environment.

3. The computerized method of claim 1 , further comprising:

identifying the at least a portion of the informational overlay based on a brightness of a portion of the scene corresponding to the at least a portion of the informational overlay.

4. The computerized method of claim 1 , further comprising:

identifying of the at least a portion of the informational overlay based on a visual complexity of a portion of the scene corresponding to the at least a portion of the informational overlay.

5. The computerized method of claim 1 , further comprising:

detecting an object of interest in the scene.

6. The computerized method of claim 1 , further comprising:

generating the scene change data by comparing a current version of the scene to a previous version of the scene.

7. The computerized method of claim 1 , further comprising:

generating the scene change data based on movement data indicating movement of the display device.

8. The computerized method of claim 7 , wherein the movement data indicates translational movement of the display device.

9. The computerized method of claim 7 , wherein the movement data indicates rotational movement of the display device.

10. A device comprising:

one or more hardware processors; and

a memory having stored therein instructions that, when executed by at least one of the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:

causing presentation of an information overlay atop a scene on a display device;

accessing scene change data indicating a change in the scene; and

modifying a visual emphasis of at least a portion of the informational overlay based on the scene change data.

11. The device of claim 10 , wherein the scene is a representation of an actual environment or a virtual environment.

12. The device of claim 10 , wherein the operations further comprise:

identifying the at least a portion of the informational overlay based on a brightness of a portion of the scene corresponding to the at least a portion of the informational overlay.

13. The device of claim 10 , wherein the operations further comprise:

identifying of the at least a portion of the informational overlay based on a visual complexity of a portion of the scene corresponding to the at least a portion of the informational overlay.

14. The device of claim 10 , wherein the operations further comprise:

generating the scene change data by comparing a current version of the scene to a previous version of the scene.

15. A system comprising:

a display device;

a memory having instructions stored thereon; and

one or more processors configured by the instructions to perform operations comprising:

causing presentation of an information overlay atop a scene on the display device;

accessing scene change data indicating a change in the scene; and

modifying a visual emphasis of at least a portion of the informational overlay based on the scene change data.

16. The system of claim 15 , further comprising:

a camera that captures the scene.

17. The system of claim 15 , wherein the scene is a representation of an actual environment or a virtual environment.

18. The system of claim 15 , wherein the operations further comprise:

identifying the at least a portion of the informational overlay based on a brightness of a portion of the scene corresponding to the at least a portion of the informational overlay.

19. The system of claim 15 , wherein the operations further comprise:

detecting an object of interest in the scene.

20. The system of claim 15 , wherein the operations further comprise:

generating the scene change data by comparing a current version of the scene to a previous version of the scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2022
From: TINSMAN, JOHN
To: OPENTV, INC.
Reel/Frame 058692/0728 →
Continuity (3)
Continuation 16258213 · Jan 25, 2019
Continuation 15407491 · Jan 17, 2017
Related Publication 20220139014A1 · May 5, 2022
References Cited (91)
US 5913591A · Melville · 1999 [cited by applicant]
US 6257727B1 · Melville · 2001 [cited by applicant]
US 8670000B2 · Braun et al. · 2014 [cited by applicant]
US 9305400B2 · Kochi et al. · 2016 [cited by applicant]
US 9480919B2 · Kalaboukis et al. · 2016 [cited by applicant]
US 9791917B2 · Kamhi et al. · 2017 [cited by applicant]
US 10152815B2 · Tinsman · 2018 [cited by applicant]
US 10235788B2 · Tinsman · 2019 [cited by applicant]
US 11200716B2 · Tinsman · 2021 [cited by applicant]
US 11501658B2 · Ramani · 2022 [cited by examiner]
US 20030118183A1 · Struyk · 2003 [cited by applicant]
US 20060098029A1 · Clas · 2006 [cited by applicant]
US 20100103075A1 · Kalaboukis et al. · 2010 [cited by applicant]
US 20110102424A1 · Hibbert et al. · 2011 [cited by applicant]
US 20120056896A1 · Border · 2012 [cited by applicant]
US 20120127284A1 · Bar-zeev et al. · 2012 [cited by applicant]
US 20130031582A1 · Tinsman et al. · 2013 [cited by applicant]
US 20130050258A1 · Liu et al. · 2013 [cited by applicant]
US 20130127980A1 · Haddick et al. · 2013 [cited by applicant]
US 20130339907A1 · Matas et al. · 2013 [cited by applicant]
US 20140002474A1 · Ashbrook et al. · 2014 [cited by applicant]
US 20140132484A1 · Pandey et al. · 2014 [cited by applicant]
US 20140132629A1 · Pandey et al. · 2014 [cited by applicant]
US 20140191928A1 · Kobayashi · 2014 [cited by applicant]
US 20150070388A1 · Sheaffer et al. · 2015 [cited by applicant]
US 20150146265A1 · Kim et al. · 2015 [cited by applicant]
US 20150187108A1 · Mullins · 2015 [cited by applicant]
US 20150249817A1 · Roelen et al. · 2015 [cited by applicant]
US 20150262428A1 · Tatzgern · 2015 [cited by examiner]
US 20150363914A1 · Boyle et al. · 2015 [cited by applicant]
US 20150379351A1 · Dibenedetto et al. · 2015 [cited by applicant]
US 20160284134A1 · Kamhi et al. · 2016 [cited by applicant]
US 20160343116A1 · Park et al. · 2016 [cited by applicant]
US 20160378861A1 · Eledath · 2016 [cited by examiner]
US 20180204361A1 · Tinsman · 2018 [cited by applicant]
US 20180204362A1 · Tinsman · 2018 [cited by applicant]
US 20190259189A1 · Tinsman · 2019 [cited by applicant]
CN 102540464 · 2012 [cited by applicant]
CN 102741858 · 2012 [cited by applicant]
CN 103365414 · 2013 [cited by applicant]
CN 103995352 · 2014 [cited by applicant]
CN 104781853 · 2015 [cited by applicant]
CN 110168616 · 2019 [cited by applicant]
CN 110199319 · 2019 [cited by applicant]
EP 2886039 · 2015 [cited by applicant]
GB 2252224 · 1992 [cited by applicant]
JP H0759095 · 1995 [cited by applicant]
WO 2009122213 · 2009 [cited by applicant]
WO 2015102904 · 2015 [cited by applicant]
WO 2016139208 · 2016 [cited by applicant]
WO 2018136420 · 2018 [cited by applicant]
WO 2018136426 · 2018 [cited by applicant]
U.S. Appl. No. 15/407,435 U.S. Pat. No. 10,152,815, filed Jan. 17, 2017, Overlay Emphasis Modification In Augmented Reality Displays. [cited by applicant]
U.S. Appl. No. 15/407,491 U.S. Pat. No. 10,235,788, filed Jan. 17, 2017, Overlay Contrast Control In Augmented Reality Displays. [cited by applicant]
U.S. Appl. No. 16/258,213 U.S. Pat. No. 11,200,716, filed Jan. 25, 2019, Overlay Contrast Control In Augmented Reality Displays. [cited by applicant]
“Chinese Application Serial No. 201880006028.2, Voluntary Amendment filed Mar. 24, 2020”, with English translation of claims, 59 pgs. [cited by applicant]
“Chinese Application Serial No. 201880006951.6, Voluntary Amendment filed Apr. 14, 2020”, with English translation of claims, 62 pgs. [cited by applicant]
“European Application Serial No. 18712721.2, Response filed Jun. 6, 2022 to Communication Pursuant to Article 94(3) EPC mailed Feb. 10, 2022”, 11 pgs. [cited by applicant]
“European Application Serial No. 18712721.2, Communication Pursuant to Article 94(3) EPC mailed Feb. 10, 2022”, 3 pages. [cited by applicant]
“European Application Serial No. 18714879.6, Response Filed Jan. 28, 2022 to Communication Pursuant to Article 94(3) EPC mailed Oct. 18, 2021”, 12 pages. [cited by applicant]
“U.S. Appl. No. 15/407,435, Non Final Office Action mailed Feb. 23, 2018”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,491, Non Final Office Action mailed Mar. 19, 2018”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,435, Response filed May 22, 2018 to Non Final Office Action mailed Feb. 23, 2018”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013875, International Search Report mailed May 28, 2018”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013875, Written Opinion mailed May 28, 2018”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013893, International Search Report mailed Jun. 1, 2018”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013893, Written Opinion mailed Jun. 1, 2018”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,491, Response filed Jun. 19, 2018 to Non Final Office Action mailed Mar. 19, 2018”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,491, Examiner Interview Summary mailed Aug. 2, 2018”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,435, Examiner Interview Summary mailed Aug. 24, 2018”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,435, Notice of Allowance mailed Sep. 24, 2018”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 15/407,491, Notice of Allowance mailed Oct. 30, 2018”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Preliminary Amendment filed May 13, 2019”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013875, International Preliminary Report on Patentability mailed Aug. 1, 2019”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2018 013893, International Preliminary Report on Patentability mailed Aug. 1, 2019”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Non Final Office Action mailed Aug. 8, 2019”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Response filed Dec. 9, 2019 to Non Final Office Action mailed Aug. 8, 2019”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Examiner Interview Summary mailed Jan. 16, 2020”, 3 pgs. [cited by applicant]
“European Application Serial No. 18714879.6 Response filed Mar. 2, 2020 to Communication pursuant to Rules 161(1) and 162 EPC filed Aug. 23, 2019”, 12 pgs. [cited by applicant]
“European Application Serial No. 18712721.2, Response filed Mar. 2, 2020 to Communication pursuant to Rules 161 (1) and 162 EPC Aug. 23, 2019”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Final Office Action mailed Mar. 20, 2020”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Non Final Office Action mailed Jun. 5, 2020”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Response filed Oct. 2, 2020 to Non Final Office Action mailed Jun. 5, 2020”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Advisory Action mailed Oct. 22, 2020”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Non Final Office Action mailed Jan. 29, 2021”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Response filed Apr. 29, 2021 to Non Final Office Action mailed Jan. 29, 2021”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/258,213, Notice of Allowance mailed Aug. 9, 2021”, 8 pgs. [cited by applicant]
“European Application Serial No. 18714879.6, Communication Pursuant to Article 94(3) EPC mailed Oct. 18, 2021”, 7 pages. [cited by applicant]
“Chinese Application Serial No. 201880006028.2, Office Action mailed Nov. 3, 2022”, with machine translation, 12 pgs. [cited by applicant]
“Chinese Application Serial No. 201880006951.6, Office Action mailed Dec. 5, 2022”, with machine translation, 25 pgs. [cited by applicant]
Office Action issued on Nov. 12, 2024, in corresponding Brazilian Application No. 112019014333-5, with partial English translation, 5 pages. [cited by applicant]