IP Library Granted Patent US 12,638,675
Granted Patent B2
US 12,638,675 · App. 18/819,573 · Granted May 26, 2026

Pairing with companion device

Inventors: Nitin Singh (Fremont, CA); Adrian Kaehler (Los Angeles, CA)
Assignee: Magic Leap, Inc.
G02B27/0093G02B27/017G06F21/32G06F21/44G06V20/80H04L63/0861H04L63/18H04M1/6066H04W4/80H04W8/005H04W12/065H04W12/069H04W12/50H04W12/77G02B6/0016G02B6/34G02B2027/0125G02B2027/0127G02B2027/0138G02B2027/014G02B2027/0178G02B2027/0181H04B2001/3866
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,638,675
App. No.
18/819,573
Granted
May 26, 2026
Kind
B2
Abstract

This disclosure describes techniques for device authentication and/or pairing. A display system can comprise a head mountable display, computer memory, and processor(s). In response to receiving a request to authenticate a connection between the display system and a companion device (e.g., controller or other computer device), first data may be determined, the first data based at least partly on biometric data associated with a user. The first data may be sent to an authentication device configured to compare the first data to second data received from the companion device, the second data based at least partly on the biometric data. Based at least partly on a correspondence between the first and second data, the authentication device can send a confirmation to the display system to permit communication between the display system and companion device.

Claims (43)

1 . A display system comprising:

a head mountable display;

memory storing executable instructions; and

one or more processors in communication with the memory and the display, the one or more processors programmed by the executable instructions to perform operations comprising:

receiving a request to authenticate a connection between the display system and a companion device;

responsive to receiving the request to form the connection, determining first data to be used in authenticating the connection between the display system and the companion device, wherein the first data is based at least partly on biometric data that is associated with a user of the display system;

transmitting the first data to an authentication device that is configured to authenticate the connection based at least in part on comparing the first data to second data that is received by the authentication device from the companion device, the second data based at least partly on the biometric data;

receiving, from the authentication device, a confirmation of a successful authentication of the connection, wherein the successful authentication is determined by the authentication device based at least partly on determining a match between the first data and the second data; and

in response to receiving the confirmation of successful authentication of the connection,

permitting bi-directional communication of data between the companion device and the display system using the connection, and

presenting, through the display, a notification to the user of the display system that the connection has been authenticated.

2 . The display system of claim 1 , wherein the biometric data is associated with an eye of the user.

3 . The display system of claim 2 , further comprising at least one image capture device, and wherein determining the first data includes:

receiving at least one image of the eye of the user captured by the at least one image capture device; and

determining the biometric data based on the at least one image of the eye; and

generating the first data based at least partly on the biometric data.

4 . The display system of claim 1 , wherein the biometric data is an iris code of an eye of the user.

5 . The display system of claim 1 , wherein the request to form the connection between the display system and the companion device is received from the companion device.

6 . The display system of claim 5 , wherein the request to form the connection between the display system and the companion device is received from the companion device through an out-of-band communication.

7 . The display system of claim 5 , wherein the request includes the first data that is generated by the companion device based at least partly on the biometric data, and wherein determining the first data includes extracting the first data from the request.

8 . The display system of claim 5 , wherein the companion device is configured to determine the biometric data and generate the first data based on the biometric data, and wherein the companion device is further configured to generate the second data based on the biometric data and communicate the second data to the authentication device.

9 . The display system of claim 8 , wherein the biometric data is associated with an eye of the user, wherein the companion device includes at least one image capture device configured to capture at least one image of the eye of the user, and wherein the companion device is further configured to determine the biometric data based on the at least one image of the eye, generate the second data based on the biometric data, and communicate the second data to the authentication device.

10 . The display system of claim 1 , wherein the companion device is configured to receive user input from the user and, based on the user input, use the connection to provide commands to control the display system.

11 . The display system of claim 1 , wherein the companion device is a portable computing device.

12 . A method for authenticating a connection between a companion device and a display system that includes a head mountable display, the method performed by the display system and comprising:

receiving a request to authenticate a connection between the display system and a companion device;

responsive to receiving the request to form the connection, determining first data to be used in authenticating the connection between the display system and the companion device, wherein the first data is based at least partly on biometric data that is associated with a user of the display system;

transmitting the first data to an authentication device that is configured to authenticate the connection based at least in part on comparing the first data to second data that is received by the authentication device from the companion device, the second data based at least partly on the biometric data;

receiving, from the authentication device, a confirmation of a successful authentication of the connection, wherein the successful authentication is determined by the authentication device based at least partly on determining a match between the first data and the second data; and

in response to receiving the confirmation of successful authentication of the connection,

permitting bi-directional communication of data between the companion device and the display system using the connection, and

presenting, through the display, a notification to the user of the display system that the connection has been authenticated.

13 . The method of claim 12 , wherein the biometric data is associated with an eye of the user.

14 . The method of claim 13 , further comprising at least one image capture device, and wherein determining the first data includes:

receiving at least one image of the eye of the user captured by the at least one image capture device; and

determining the biometric data based on the at least one image of the eye; and

generating the first data based at least partly on the biometric data.

15 . The method of claim 12 , wherein the biometric data is an iris code of an eye of the user.

16 . The method of claim 12 , wherein the request to form the connection between the display system and the companion device is received from the companion device.

17 . The method of claim 16 , wherein the request to form the connection between the display system and the companion device is received from the companion device through an out-of-band communication.

18 . The method of claim 16 , wherein the request includes the first data that is generated by the companion device based at least partly on the biometric data, and wherein determining the first data includes extracting the first data from the request.

19 . The method of claim 16 , wherein the companion device is configured to determine the biometric data and generate the first data based on the biometric data, and wherein the companion device is further configured to generate the second data based on the biometric data and communicate the second data to the authentication device.

20 . The method of claim 19 , wherein the biometric data is associated with an eye of the user, wherein the companion device includes at least one image capture device configured to capture at least one image of the eye of the user, and wherein the companion device is further configured to determine the biometric data based on the at least one image of the eye, generate the second data based on the biometric data, and communicate the second data to the authentication device.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2024
From: SINGH, NITIN
To: MAGIC LEAP, INC.
Reel/Frame 069485/0888 →
PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Dec 4, 2024
From: KAEHLER, ADRIAN
To: MAGIC LEAP, INC.
Reel/Frame 069506/0977 →
Continuity (5)
Continuation 18493113 · Oct 24, 2023
Continuation 17179110 · Feb 18, 2021
Continuation 15982844 · May 17, 2018
Provisional Application 62509427 · May 22, 2017
Related Publication 20240418990A1 · Dec 19, 2024
References Cited (124)
US 6046712A · Beller et al. · 2000 [cited by applicant]
US 6850221B1 · Tickle · 2005 [cited by applicant]
US D514570S · Ohta · 2006 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US D752529S · Loretan et al. · 2016 [cited by applicant]
US 9325828B1 · Oh et al. · 2016 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US D759657S · Kujawski et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9622180B1 · Yeung et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US D794288S · Beers et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US D805734S · Fisher et al. · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 10425392B2 · Tal et al. · 2019 [cited by applicant]
US 10425813B2 · Nakagawa et al. · 2019 [cited by applicant]
US 10955662B2 · Singh et al. · 2021 [cited by applicant]
US 11835717B2 · Singh et al. · 2023 [cited by applicant]
US 12105282B2 · Singh et al. · 2024 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20080303665A1 · Naik · 2008 [cited by examiner]
US 20090088076A1 · Mercurio et al. · 2009 [cited by applicant]
US 20100183246A1 · King et al. · 2010 [cited by applicant]
US 20110140841A1 · Bona · 2011 [cited by examiner]
US 20110249122A1 · Tricoukes et al. · 2011 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120206452A1 · Geisner et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130095924A1 · Geisner et al. · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140281547A1 · Modzelewski et al. · 2014 [cited by applicant]
US 20140282911A1 · Bare et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20140333413A1 · Kursun et al. · 2014 [cited by applicant]
US 20140337634A1 · Starner et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150089222A1 · White et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150119667A1 · Reihman et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150189006A1 · Smus et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150215292A1 · Novicov et al. · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150243100A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150248702A1 · Chatterton · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150294108A1 · Kim et al. · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · TeKolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20150371214A1 · Schröder et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160062623A1 · Howard et al. · 2016 [cited by applicant]
US 20160099774A1 · Sim et al. · 2016 [cited by applicant]
US 20160142703A1 · Park et al. · 2016 [cited by applicant]
US 20160142891A1 · Virhiä et al. · 2016 [cited by applicant]
US 20160150406A1 · Vincent et al. · 2016 [cited by applicant]
US 20160164867A1 · Jung et al. · 2016 [cited by applicant]
US 20160180072A1 · Ligatti et al. · 2016 [cited by applicant]
US 20160212103A1 · Rhoads et al. · 2016 [cited by applicant]
US 20160227358A1 · Lo · 2016 [cited by applicant]
US 20160269376A1 · Goyal · 2016 [cited by applicant]
US 20160275518A1 · Bowles et al. · 2016 [cited by applicant]
US 20160330182A1 · Jeon et al. · 2016 [cited by applicant]
US 20170004475A1 · White et al. · 2017 [cited by applicant]
US 20170077974A1 · Aoki et al. · 2017 [cited by applicant]
US 20170116846A1 · Wengrovitz et al. · 2017 [cited by applicant]
US 20170150533A1 · Alipour · 2017 [cited by examiner]
US 20170295492A1 · Nakagawa · 2017 [cited by applicant]
US 20170357973A1 · Van Os · 2017 [cited by examiner]
US 20180336332A1 · Singh et al. · 2018 [cited by applicant]
US 20210199960A1 · Singh et al. · 2021 [cited by applicant]
US 20240053605A1 · Singh et al. · 2024 [cited by applicant]
CN 104254373A · 2014 [cited by applicant]
CN 106973166A · 2017 [cited by examiner]
JP 2007228554A · 2007 [cited by applicant]
JP 2007323339A · 2007 [cited by applicant]
JP 2009135688A · 2009 [cited by applicant]
JP 2012157006A · 2012 [cited by applicant]
JP 2013515562A · 2013 [cited by applicant]
JP 2014523553A · 2014 [cited by applicant]
JP 2017500834A · 2017 [cited by applicant]
JP 2014225096A · 2017 [cited by applicant]
WO 2011026097A1 · 2011 [cited by applicant]
WO 2013100898A1 · 2013 [cited by applicant]
WO 2018217542A1 · 2018 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
AU2018271790 Examination Report dated Jun. 22, 2022. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit. edu/raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
International Preliminary Report for PCT Application No. PCT/US18/33242, dated Nov. 26, 2019. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US18/33242, dated Sep. 19, 2018. [cited by applicant]
Invitation to Pay Additional Fees and, Where Applicable, Protest Fee for PCT Application No. PCT/US18/33242, dated Jul. 20, 2018. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
JP2022-186380 Office Action mailed Jan. 24, 2024. [cited by applicant]
JP2022-84319 Office Action dated Aug. 24, 2022. [cited by applicant]
JP2022-84319 Office Action mailed Feb. 21, 2023. [cited by applicant]
KR2023-7015702 Office Action dated Sep. 26, 2023. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. AMC CHI 2000 Human Factors in Computin… [cited by applicant]
Vapen, et al., “2-clickAuth—Optical Challenge-Response Authentication,” IEEE Computer Society—Availability, Reliability, and Security, 2010. ARES '10 International Conference on Feb. 15, 2010. [cited by applicant]
Wikipedia: “Bluetooth,” printed Nov. 17, 2016, in 22 pages; URL: https://en.wikipedia.org/wiki/Bluetooth#Pairing_and_bonding. [cited by applicant]
JP2024-62630 Office Action mailed Sep. 30, 2024. [cited by applicant]
EP21183149.0 Examination Report dated Dec. 3, 2025. [cited by applicant]