IP Library › Granted Patent US 12,332,438
Granted Patent B2
US 12,332,438 · App. 17/848,179 · Granted Jun 17, 2025

Color calibration tool for see-through augmented reality environment

Inventor: Pawel Wawruch (Yverdon-les-Bains, CH)
Assignee: Snap Inc.
G02B27/017G06F3/04847G06T19/006G06T19/20G02B2027/0178G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,332,438
App. No.
17/848,179
Granted
Jun 17, 2025
Kind
B2
Abstract

A color calibration system is configured to permit a user to adjust tint/temperature parameters while displaying a virtual color reference card on a see-through display of a computing device. The virtual color reference card corresponds to a physical color reference card that is placed in front of the AR glasses. Based on the adjustments made by the user via the color calibration UI, the color calibration system makes changes to the color properties of the see-through display. The user can continue adjusting the properties of the see-through display by interacting with the user-selectable elements in the color calibration UI, until the colors of the virtual color reference card overlayed over the field of view of the wearer of the AR glasses match the colors of the physical color reference card seen by the wearer of the AR glasses.

Claims (37)

1. A method to calibrate a head-worn computing device with a see-through display and transparent lens, the method comprising:

detecting a physical color reference card in an output of a digital image sensor of a camera of the head-worn computing device by identifying in the output of the digital image sensor of the camera a portion of the output corresponding to the physical color reference card positioned at a first location in a field of view of the camera and having at least a predetermined number of different colors in substantially adjacent locations;

in response to detecting the physical color reference card, generating a color calibration user interface (UI) including a virtual color reference card and having user-selectable elements to color-calibrate the see-through display by updating one or more values of one or more color parameters used by the see-through display in color rendering; and

causing display of the color calibration UI on the see-through display of the computing device, wherein i) the virtual color reference card is displayed at a second location, proximate to the physical color reference card, when the physical color reference card is in the field of view of the camera, such that the virtual color reference card does not obscure the view of the physical color reference card through the transparent lens of the head-worn computing device, and ii) the virtual color reference card is rendered with the one or more color parameters having a first set of values; and

receiving user input via an interaction with a user-selectable element of the color calibration UI, and in response, updating the one or more color parameters of the see-through display to have a second set of values, thereby adjusting the color rendering of the virtual color reference card.

2. The method of claim 1 , wherein a first control from the user-selectable elements is a vertically oriented slider to adjust tint.

3. The method of claim 2 , wherein the first control is to select from a plurality of tints including red, green and blue.

4. The method of claim 1 , wherein a second control from the user-selectable elements is a horizontally oriented slider to adjust temperature of a tint indicated by a setting of a first control from the user-selectable elements.

5. The method of claim 1 , comprising:

detecting a user interaction with a control from the user-selectable elements; and

in response to the detecting, effectuating a change to the control from the user-selectable elements.

6. The method of claim 5 , wherein the user interaction is a hand gesture.

7. The method of claim 1 , wherein the head-worn computing device is AR glasses.

8. The method of claim 1 , wherein the color calibration UI does not include a control for adjusting brightness.

9. A head-worn computing device, comprising:

a camera;

a see-through display;

a transparent lens;

one or more processors; and

a non-transitory computer readable storage medium comprising instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising:

detecting a physical color reference card in an output of a digital image sensor of the camera of the head-worn computing device by identifying in the output of the digital image sensor of the camera a portion of the output corresponding to the physical color reference card positioned at a first location in a field of view of the camera and having at least a predetermined number of different colors in substantially adjacent locations;

in response to detecting the physical color reference card, generating a color calibration user interface (UI) including a virtual color reference card and having user-selectable elements to color-calibrate the see-through display by updating one or more values of one or more color parameters used by the see-through display in color rendering; and

causing display of the color calibration UI on the see-through display of the computing device, wherein i) the virtual color reference card is displayed at a second location, proximate to the physical color reference card, when the physical color reference card is in the field of view of the camera, such that the virtual color reference card does not obscure the view of the physical color reference card through the transparent lens of the head-worn computing device, and ii) the virtual color reference card is rendered with the one or more color parameters having a first set of values; and

receiving user input via an interaction with a user-selectable element of the color calibration UI, and in response, updating the one or more color parameters of the see-through display to have a second set of values, thereby adjusting the color rendering of the virtual color reference card.

10. The head-worn computing device of claim 9 , wherein a first control from the user-selectable elements is a vertically oriented slider to adjust tint.

11. The head-worn computing device of claim 10 , wherein the first control is to select from a plurality of tints including red, green and blue.

12. The head-worn computing device of claim 9 , wherein a second control from the user-selectable elements is a horizontally oriented slider to adjust temperature of a tint indicated by a setting of a first control from the user-selectable elements.

13. The head-worn computing device of claim 9 , comprising:

detecting a user interaction with a control from the user-selectable elements; and

in response to the detecting, effectuating a change to the control from the user-selectable elements.

14. The head-worn computing device of claim 13 , wherein the user interaction is a hand gesture.

15. The head-worn computing device of claim 9 , wherein the head-worn computing device is AR glasses.

16. A machine-readable non-transitory storage medium having instruction data executable by a machine to cause the machine to perform operations for calibrating a head-worn computing device with a see-through display and a transparent lens, the operations comprising:

detecting a physical color reference card in an output of a digital image sensor of a camera of the head-worn computing device by identifying in the output of the digital image sensor of the camera a portion of the output corresponding to the physical color reference card positioned at a first location in a field of view of the camera and having at least a predetermined number of different colors in substantially adjacent locations;

in response to detecting the physical color reference card, generating a color calibration user interface (UI) including a virtual color reference card and having user-selectable elements to color-calibrate the see-through display by updating one or more values of one or more color parameters used by the see-through display in color rendering; and

causing display of the color calibration UI on the see-through display of the computing device, wherein i) the virtual color reference card is displayed at a second location, proximate to the physical color reference card, when the physical color reference card is in the field of view of the camera, such that the virtual color reference card does not obscure the view of the physical color reference card through the transparent lens of the head-worn computing device, and ii) the virtual color reference card is rendered with the one or more color parameters having a first set of values; and

receiving user input via an interaction with a user-selectable element of the color calibration UI, and in response, updating the one or more color parameters of the see-through display to have a second set of values, thereby adjusting the color rendering of the virtual color reference card.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: WAWRUCH, PAWEL
To: SNAP INC.
Reel/Frame 060297/0017 →
Continuity (1)
Related Publication 20230418062A1 · Dec 28, 2023
References Cited (113)
US 5638117A · Engeldrum · 1997 [cited by examiner]
US 5670985A · Cappels, Sr. et al. · 1997 [cited by applicant]
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 7996793B2 · Latta et al. · 2011 [cited by applicant]
US 8103094B2 · Wilensky · 2012 [cited by examiner]
US 8421826B2 · Hsieh · 2013 [cited by examiner]
US 8487938B2 · Latta · 2013 [cited by examiner]
US 8619101B2 · Marcu · 2013 [cited by examiner]
US 8711187B2 · Park · 2014 [cited by examiner]
US 8856691B2 · Geisner et al. · 2014 [cited by applicant]
US 9179044B2 · Zeng · 2015 [cited by examiner]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9230160B1 · Kanter · 2016 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9652897B2 · Osborn · 2017 [cited by examiner]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10579869B1 · Xiong et al. · 2020 [cited by applicant]
US 10591730B2 · Rodriguez, II et al. · 2020 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11302287B1 · Allard · 2022 [cited by examiner]
US 11307747B2 · Dancie et al. · 2022 [cited by applicant]
US 11531402B1 · Stolzenberg · 2022 [cited by applicant]
US 11546505B2 · Canberk · 2023 [cited by applicant]
US 20070065006A1 · Wilensky · 2007 [cited by examiner]
US 20080062442A1 · Olson · 2008 [cited by examiner]
US 20090012788A1 · Gilbert et al. · 2009 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20140171036A1 · Simmons · 2014 [cited by applicant]
US 20140368530A1 · James · 2014 [cited by examiner]
US 20150022830A1 · Kwak · 2015 [cited by examiner]
US 20150120293A1 · Wohlert et al. · 2015 [cited by applicant]
US 20150370320A1 · Connor · 2015 [cited by applicant]
US 20160379396A1 · Pandey · 2016 [cited by examiner]
US 20170061694A1 · Giraldi · 2017 [cited by examiner]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170277684A1 · Dharmarajan Mary · 2017 [cited by applicant]
US 20170277685A1 · Takumi · 2017 [cited by applicant]
US 20170351910A1 · Elwazer et al. · 2017 [cited by applicant]
US 20180158370A1 · Pryor · 2018 [cited by applicant]
US 20190146219A1 · Rodriguez, II · 2019 [cited by applicant]
US 20190362478A1 · Nanda · 2019 [cited by examiner]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210224889A1 · Colby · 2021 [cited by examiner]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210267732A1 · Kikkawa · 2021 [cited by examiner]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20210405761A1 · Canberk · 2021 [cited by applicant]
US 20220188539A1 · Chan et al. · 2022 [cited by applicant]
US 20220206588A1 · Canberk et al. · 2022 [cited by applicant]
US 20220252882A1 · Berliner · 2022 [cited by examiner]
US 20220255995A1 · Berliner · 2022 [cited by examiner]
US 20220300730A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220300731A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220301231A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220326781A1 · Hwang et al. · 2022 [cited by applicant]
US 20220334649A1 · Hwang et al. · 2022 [cited by applicant]
US 20220375174A1 · Arya et al. · 2022 [cited by applicant]
US 20230007085A1 · Berliner · 2023 [cited by examiner]
US 20230044356A1 · Todd · 2023 [cited by examiner]
US 20230247742A1 · Slivka · 2023 [cited by examiner]
US 20230289030A1 · Sullivan · 2023 [cited by examiner]
US 20230394727A1 · Clark · 2023 [cited by examiner]
CN 103049761B · 2016 [cited by applicant]
EP 3707693A1 · 2020 [cited by applicant]
EP 3985382A1 · 2022 [cited by applicant]
EP 4172726A1 · 2023 [cited by applicant]
EP 4172730A1 · 2023 [cited by applicant]
KR 20220158824A · 2022 [cited by applicant]
WO WO2016168591A1 · 2016 [cited by applicant]
WO WO2019094618A1 · 2019 [cited by applicant]
WO WO2022005687A1 · 2022 [cited by applicant]
WO WO2022005693A1 · 2022 [cited by applicant]
WO WO2022060549A2 · 2022 [cited by applicant]
WO WO2022066578A1 · 2022 [cited by applicant]
WO WO2022060549A3 · 2022 [cited by applicant]
WO WO2022132381A1 · 2022 [cited by applicant]
WO WO2022146678A1 · 2022 [cited by applicant]
WO WO2022198182A1 · 2022 [cited by applicant]
WO WO2022216784A1 · 2022 [cited by applicant]
WO WO2022225761A1 · 2022 [cited by applicant]
WO WO2022245765A1 · 2022 [cited by applicant]
WO WO2023250346A1 · 2023 [cited by applicant]
“International Application Serial No. PCT/US2023/068771, International Search Report mailed Sep. 22, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/068771, Written Opinion mailed Sep. 22, 2023”, 5 pgs. [cited by applicant]