IP Library Granted Patent US 12,298,501
Granted Patent B2
US 12,298,501 · App. 17/616,255 · Granted May 13, 2025

Optical see-through viewing device and method for calibrating provision of virtual content overlapping visual objects

Inventors: Alexander Hunt (Tygelsjö, SE); Saeed Bastani (Dalby, SE); Andreas Kristensson (Södra Sandby, SE); Yun Li (Lund, SE)
Assignee: Telefonaktiebolaget LM Ericsson (publ)
G02B27/0093G02B27/0149G02B27/0172G02B2027/0138G02B2027/014G02B2027/0159
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,298,501
App. No.
17/616,255
Granted
May 13, 2025
Kind
B2
Abstract

An Optical See-Through viewing device ( 100 ) comprising a controller ( 101 ) configured to control a display arrangement ( 110 ) comprising an image capturing device ( 112 ) and a reflective device ( 114 ), wherein the controller ( 101 ) is further configured to calibrate the Optical See-Through viewing device ( 100 ) by: a) adapting ( 600 ) the reflective device ( 114 ) to enable the image capturing device to capture an image of a user's eye (E); b) capturing ( 610 ) an image of a user's eye (E); c) determining ( 620 ) a location of the user's eye (E); d) determining ( 630 ) a displacement for adapting the display arrangement ( 110 ); e) adapting ( 640 ) at least a part of the display arrangement ( 110, 112, 111 ); and f) returning ( 650 ) the reflective device ( 114 ).

Claims (38)

1. An optical see-through viewing device comprising a controller configured to control a display arrangement comprising an image capturing device and a reflective device, wherein the controller is further configured to calibrate the optical see-through viewing device by:

a) adapting the reflective device to enable the image capturing device to capture an image of a user's eye;

b) capturing an image of a user's eye;

c) determining a location of the user's eye;

d) determining a displacement for adapting the display arrangement;

e) adapting at least a part of the display arrangement; and

f) returning the reflective device.

2. The optical see-through viewing device of claim 1 , wherein the controller is further configured to a) adapt and f) return the reflective device by rotating it.

3. The optical see-through viewing device of claim 2 , wherein the controller is further configured to rotate the reflective device around a rotation axis that is in line with a center line of the reflective device.

4. The optical see-through viewing device of claim 2 , wherein the controller is further configured to rotate the reflective device 90 degrees.

5. The optical see-through viewing device of claim 1 , wherein the controller is further configured to e) adapting the display arrangement by moving a part of it.

6. The optical see-through viewing device of claim 5 , wherein the controller is further configured to e) adapting the display arrangement by moving the image capturing device.

7. The optical see-through viewing device of claim 1 , wherein the controller is further configured to determinate that there is an eye present before capturing an image of the user's eye.

8. The optical see-through viewing device of claim 1 , wherein the controller is further configured to initiate the calibration when the optical see-through viewing device is activated.

9. The optical see-through viewing device of claim 8 , wherein the controller is further configured to a) adapt the reflective device when the optical see-through viewing device is de-activated.

10. The optical see-through viewing device of claim 1 , wherein the controller is further configured to determine that the optical see-through viewing device is being worn and in response thereto initiate the calibration.

11. The optical see-through viewing device of claim 10 , wherein the controller is further configured to determine that the optical see-through viewing device is no longer being worn and in response thereto adapt the reflective device.

12. The optical see-through viewing device of claim 10 , further comprising an activity sensor, wherein the controller is further configured to determine whether the optical see-through viewing device is being worn based on sensor input received from the activity sensor.

13. The optical see-through viewing device of claim 12 , wherein the activity sensor is a pressure sensor.

14. The optical see-through viewing device of claim 13 , further comprising at least one nose pad, wherein the pressure sensor is arranged in the at least one nose pad.

15. The optical see-through viewing device of claim 12 , wherein the activity sensor comprises at least one of any of: a capacitive sensor, a motion sensor, and a light sensor.

16. The optical see-through viewing device of claim 1 , wherein the controller is further configured to adapt the at least a part of the display arrangement by moving the at least a part of the display arrangement in at least one of two directions.

17. The optical see-through viewing device of claim 1 , wherein the controller is further configured to adapt the at least a part of the display arrangement by moving the at least a part of the display arrangement in at least one of three directions.

18. The optical see-through viewing device of claim 1 , wherein the controller is further configured to adapt the at least a part of the display arrangement by moving the at least a part of the display arrangement in an angular direction.

19. A method for calibrating an optical see-through viewing device comprising a display arrangement comprising an image capturing device and a reflective device, wherein the method comprises calibrating the optical see-through viewing device by:

a) adapting the reflective device to enable the image capturing device to capture an image of a user's eye;

b) capturing an image of a user's eye;

c) determining a location of the user's eye;

d) determining a displacement for adapting the display arrangement;

e) adapting at least a part of the display arrangement; and

f) returning the reflective device.

20. A non-transitory computer-readable medium comprising, stored thereupon, a software component arrangement for calibrating an optical see-through viewing device comprising a controller configured to control a display arrangement comprising an image capturing device and a reflective device, wherein the software component arrangement comprises:

a) a software component for adapting the reflective device to enable the image capturing device to capture an image of a user's eye;

b) a software component for capturing an image of a user's eye;

c) a software component for determining a location of the user's eye;

d) a software component for determining a displacement for adapting the display arrangement;

e) a software component for adapting at least a part of the display arrangement; and

f) a software component for returning the reflective device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: HUNT, ALEXANDER; BASTANI, SAEED; KRISTENSSON, ANDREAS; LI, YUN
To: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
Reel/Frame 058278/0459 →
Continuity (1)
Related Publication 20220244541A1 · Aug 4, 2022
References Cited (47)
US 5825340A · Torizuka et al. · 1998 [cited by applicant]
US 10070120B2 · Pedley · 2018 [cited by examiner]
US 10510137B1 · Kitain · 2019 [cited by examiner]
US 10608409B1 · Gibson · 2020 [cited by examiner]
US 10698481B1 · Najafi Shoushtari · 2020 [cited by examiner]
US 20020105484A1 · Navab · 2002 [cited by examiner]
US 20120007839A1 · Tsao et al. · 2012 [cited by applicant]
US 20130235191A1 · Miao et al. · 2013 [cited by applicant]
US 20140104692A1 · Bickerstaff · 2014 [cited by examiner]
US 20140267667A1 · Ellsworth · 2014 [cited by applicant]
US 20140300632A1 · Laor · 2014 [cited by applicant]
US 20150049201A1 · Liu · 2015 [cited by examiner]
US 20150279113A1 · Knorr et al. · 2015 [cited by applicant]
US 20160124230A1 · Hino et al. · 2016 [cited by applicant]
US 20160191887A1 · Casas · 2016 [cited by applicant]
US 20160225191A1 · Mullins · 2016 [cited by applicant]
US 20160240125A1 · Sridharan et al. · 2016 [cited by applicant]
US 20160267720A1 · Mandella et al. · 2016 [cited by applicant]
US 20170035293A1 · Nistico et al. · 2017 [cited by applicant]
US 20170039774A1 · Estable · 2017 [cited by applicant]
US 20170255013A1 · Tam · 2017 [cited by examiner]
US 20180018791A1 · Guoyi · 2018 [cited by applicant]
US 20180019791A1 · Molev Shteiman et al. · 2018 [cited by applicant]
US 20180084232A1 · Belenkii et al. · 2018 [cited by applicant]
US 20190019308A1 · Iwata · 2019 [cited by applicant]
US 20190025588A1 · Osterhout et al. · 2019 [cited by applicant]
US 20190025589A1 · Haddick · 2019 [cited by applicant]
US 20190025590A1 · Haddick · 2019 [cited by applicant]
US 20190041642A1 · Haddick et al. · 2019 [cited by applicant]
US 20190246889A1 · Marin · 2019 [cited by examiner]
US 20200201050A1 · Osterhout et al. · 2020 [cited by applicant]
US 20210278675A1 · Klug · 2021 [cited by examiner]
US 20210347318A1 · Knutsen et al. · 2021 [cited by applicant]
US 20220091423A1 · Haddick · 2022 [cited by applicant]
US 20220326528A1 · Haddick · 2022 [cited by applicant]
US 20230237703A1 · Ma · 2023 [cited by examiner]
CN 106125930A · 2016 [cited by applicant]
CN 107623803A · 2018 [cited by applicant]
EP 2966863A1 · 2016 [cited by applicant]
KR 20150020801A · 2015 [cited by applicant]
WO 2012118573A1 · 2012 [cited by applicant]
WO 2015048911A1 · 2015 [cited by applicant]
WO 2018116253A1 · 2018 [cited by applicant]
Bimber, Oliver , et al., “Modern Approaches to Augmented Reality”, Spatial Augmented Reality, Siggraph 2005, 2005, 1-86. [cited by applicant]
Toh, Yuta , et al., “Interaction-Free Calibration for Optical See-Through Head-Mounted Displays based on 3D Eye Localization”, IEEE Symposium on 3D User Interfaces, Minneapolis, Minnesota, Mar. 29-30, 2014, 1-8. [cited by applicant]
Langlotz, Tobias , et al., “Real-Time Radiometric Compensation for Optical See-Through Head-Mounted Displays”, IEEE Transactions on Visualization and Computer Graphics, vol. 22, No. 11, Nov. 2016, 1-10. [cited by applicant]
Owen, Charles B., et al., “Display-Relative Calibration for Optical See-Through Head-Mounted Displays”, Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2004), IEEE Com… [cited by applicant]