IP Library › Granted Patent US 12,388,647
Granted Patent B2
US 12,388,647 · App. 18/768,151 · Granted Aug 12, 2025

Device pairing with optical codes

Inventors: Peter Brook (Marina del Rey, CA); Nicolas Dahlquist (Venice, CA); Matthew Hanover (Los Angeles, CA)
Assignee: SNAP INC.
H04L9/3226G06K7/10762G06K19/10H04B10/114H04L9/0844H04L9/14H04L9/3066H04L63/18H04W4/80H04W12/04H04W12/06H04W12/50G06K7/1413G06K7/1417H04L2209/80H04W12/77
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,388,647
App. No.
18/768,151
Granted
Aug 12, 2025
Kind
B2
Abstract

Embodiments for device pairing using optical codes are described. One embodiment is a wearable device with an image sensor configured to capture an image including a first optical code from a first host device. The wearable device decodes the first optical code, and in response to the first optical code, initiates broadcast of a pairing advertisement. The host device displays a second optical code in response to the pairing advertisement, and the wearable device captures and processes the second optical code to determine a host pairing advertisement code. The wearable device then, in response to the second optical code, initiate broadcast of a second pairing advertisement including the host pairing advertisement code. In various embodiments, a secure wireless channel is then established and used for further secure communications.

Claims (58)

1. An apparatus of a wearable device comprising:

at least one processor; and

at least one memory storing instructions that, when executed by the at least one processor, configure the at least one processor to perform operations comprising:

causing an indication of an optical code to be displayed on a display of the wearable device, the optical code indicating a pairing code;

accessing a pairing message, the pairing message received from a wireless device in response to the optical code, the pairing message comprising an indication of the pairing code;

performing an application-level exchange to establish a shared secret and establish an encrypted connection between the wearable device and the wireless device; and

transmitting a wireless communication to the wireless device soliciting transmission of content from the wireless device to the wearable device via the encrypted connection.

2. The apparatus of claim 1 , wherein the operations further comprise:

in response to a determination that the pairing message comprises the indication of the optical code, transmitting wirelessly to the wireless device, a first key, the first key based on the optical code; and

receiving a second key from the wireless device, the second key based on the optical code and the first key.

3. The apparatus of claim 1 , wherein the optical code is a first optical code, and wherein before the causing, the operations further comprise:

causing an indication of a second optical code to be displayed on the display of the wearable device; and

accessing, an advertising message, the advertising message received from the wireless device in response to the second optical code, the advertising message indicating the wireless device is available for pairing.

4. The apparatus of claim 3 , wherein the causing the indication of the second optical code further comprises:

in response to receiving a user input to initiate pairing with the wireless device, causing the indication of the second optical code to be displayed on the display of the wearable device.

5. The apparatus of claim 1 , wherein the operations further comprise:

exchanging keys to establish an encrypted connection.

6. The apparatus of claim 1 , wherein the operations further comprise:

exchanging keys to establish an encrypted connection based on a shared secret, the shared secret based on the optical code.

7. The apparatus of claim 1 , wherein the encrypted connection is established using an elliptic curve Diffie-Hellman (ECDH) exchange to establish a shared secret.

8. The apparatus of claim 7 , wherein the operations further comprise:

generating a first keyed-hash message authentication code (HMAC) based on the shared secret, wherein the shared secret comprises a Diffie-Hellman Key (DHKey);

transmitting the first HMAC to the wireless device; and

processing a second HMAC based on the DHKey received from the wireless device.

9. The apparatus of claim 1 , further comprising:

an antenna coupled to the at least one memory, and wherein the accessing further comprises:

receiving, via the antenna, the pairing message.

10. The apparatus of claim 1 , wherein the optical code comprises a custom reference shape associated with a shape feature rule.

11. The apparatus of claim 1 , wherein the wireless device is a first mobile device and the pairing message is a first pairing message, and wherein the operations further comprise:

receiving a second pairing message from a second wireless device; and

in response to a determination that the second pairing message does not indicate pairing code, refraining from initiating a secure communication with the second wireless device.

12. The apparatus of claim 1 , wherein the optical code is a first optical code, and wherein the apparatus further comprises:

an image sensor coupled to the at least one memory and configured to capture images, and wherein the pairing message is received from the wireless device as a second optical code by the image sensor.

13. A non-transitory computer-readable storage medium including instructions that, when processed by an apparatus of a wearable device, configure the apparatus to perform operations comprising:

causing an indication of an optical code to be displayed on a display of the wearable device, the optical code indicating a pairing code;

accessing a pairing message, the pairing message received from a wireless device in response to the optical code, the pairing message comprising an indication of the pairing code;

performing an application-level exchange to establish a shared secret and establish an encrypted connection between the wearable device and the wireless device; and

transmitting a wireless communication to the wireless device soliciting transmission of content from the wireless device to the wearable device via the encrypted connection.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the operations further comprise:

in response to a determination that the pairing message comprises the indication of the optical code, transmitting wirelessly to the wireless device, a first key, the first key based on the optical code; and

receiving a second key from the wireless device, the second key based on the optical code and the first key.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the optical code is a first optical code, and wherein before the causing the operations further comprise:

causing an indication of a second optical code to be displayed on the display of the wearable device; and

accessing, an advertising message, the advertising message received from the wireless device in response to the second optical code, the advertising message indicating the wireless device is available for pairing.

16. A method performed on an apparatus of a wearable device, the method comprising:

causing an indication of an optical code to be displayed on a display of the wearable device, the optical code indicating a pairing code;

accessing a pairing message, the pairing message received from a wireless device in response to the optical code, the pairing message comprising an indication of the pairing code;

performing an application-level exchange to establish a shared secret and establish an encrypted connection between the wearable device and the wireless device; and

transmitting a wireless communication to the wireless device soliciting transmission of content from the wireless device to the wearable device via the encrypted connection.

17. The method of claim 16 , wherein the method further comprises:

in response to a determination that the pairing message comprises the indication of the optical code, transmitting wirelessly to the wireless device, a first key, the first key based on the optical code; and

receiving a second key from the wireless device, the second key based on the optical code and the first key.

18. The method of claim 16 , wherein the optical code is a first optical code, and wherein before the causing the method further comprises:

causing an indication of a second optical code to be displayed on the display of the wearable device; and

accessing, an advertising message, the advertising message received from the wireless device in response to the second optical code, the advertising message indicating the wireless device is available for pairing.

19. The non-transitory computer-readable storage of claim 13 , wherein the optical code comprises a custom reference shape associated with a shape feature rule.

20. The non-transitory computer-readable storage of claim 13 , wherein the operations further comprise:

exchanging keys to establish an encrypted connection based on a shared secret, the shared secret based on the optical code.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2024
From: BROOK, PETER; DAHLQUIST, NICOLAS; HANOVER, MATTHEW
To: SNAP INC.
Reel/Frame 068152/0907 →
Continuity (5)
Continuation 18132636 · Apr 10, 2023
Continuation 16947339 · Jul 29, 2020
Continuation 15716124 · Sep 26, 2017
Provisional Application 62399901 · Sep 26, 2016
Related Publication 20240364525A1 · Oct 31, 2024
References Cited (109)
US 6038295A · Mattes · 2000 [cited by applicant]
US 6980909B2 · Root et al. · 2005 [cited by applicant]
US 7173651B1 · Knowles · 2007 [cited by applicant]
US 7411493B2 · Smith · 2008 [cited by applicant]
US 7535890B2 · Rojas · 2009 [cited by applicant]
US 8131597B2 · Hudetz · 2012 [cited by applicant]
US 8199747B2 · Rojas et al. · 2012 [cited by applicant]
US 8332475B2 · Rosen et al. · 2012 [cited by applicant]
US 8718333B2 · Wolf et al. · 2014 [cited by applicant]
US 8724622B2 · Rojas · 2014 [cited by applicant]
US 8874677B2 · Rosen et al. · 2014 [cited by applicant]
US 8909679B2 · Root et al. · 2014 [cited by applicant]
US 8995433B2 · Rojas · 2015 [cited by applicant]
US 9040574B2 · Wang et al. · 2015 [cited by applicant]
US 9055416B2 · Rosen et al. · 2015 [cited by applicant]
US 9100806B2 · Rosen et al. · 2015 [cited by applicant]
US 9100807B2 · Rosen et al. · 2015 [cited by applicant]
US 9111164B1 · Anderton et al. · 2015 [cited by applicant]
US 9191776B2 · Root et al. · 2015 [cited by applicant]
US 9204252B2 · Root · 2015 [cited by applicant]
US 9381420B2 · Burroughs · 2016 [cited by applicant]
US 9443227B2 · Evans et al. · 2016 [cited by applicant]
US 9489661B2 · Evans et al. · 2016 [cited by applicant]
US 9491134B2 · Rosen et al. · 2016 [cited by applicant]
US 9668217B1 · Bamberger et al. · 2017 [cited by applicant]
US 9678338B1 · Bamberger et al. · 2017 [cited by applicant]
US 10045214B2 · Weast · 2018 [cited by applicant]
US 10581608B2 · Brook et al. · 2020 [cited by applicant]
US 10764053B2 · Brook et al. · 2020 [cited by applicant]
US 10798568B2 · Wang et al. · 2020 [cited by applicant]
US 11652635B2 · Brook et al. · 2023 [cited by applicant]
US 20110202598A1 · Evans et al. · 2011 [cited by applicant]
US 20120209924A1 · Evans et al. · 2012 [cited by applicant]
US 20120223883A1 · Solomon · 2012 [cited by examiner]
US 20130171939A1 · Tian et al. · 2013 [cited by applicant]
US 20140108151A1 · Bookstaff · 2014 [cited by applicant]
US 20140207591A1 · Acker, Jr. et al. · 2014 [cited by applicant]
US 20150162994A1 · Rodzevski et al. · 2015 [cited by applicant]
US 20150184963A1 · Milde, Jr. · 2015 [cited by applicant]
US 20150222517A1 · Mclaughlin et al. · 2015 [cited by applicant]
US 20150286976A1 · Hirschfeld et al. · 2015 [cited by applicant]
US 20150332031A1 · Mistry et al. · 2015 [cited by applicant]
US 20160127293A1 · Song et al. · 2016 [cited by applicant]
US 20160180072A1 · Ligatti et al. · 2016 [cited by applicant]
US 20160210545A1 · Anderton et al. · 2016 [cited by applicant]
US 20160342784A1 · Beveridge et al. · 2016 [cited by applicant]
US 20160350922A1 · Tofolo et al. · 2016 [cited by applicant]
US 20170041309A1 · Ekambaram et al. · 2017 [cited by applicant]
US 20170086015A1 · Elkehag · 2017 [cited by applicant]
US 20170140791A1 · Das et al. · 2017 [cited by applicant]
US 20170161851A1 · Li et al. · 2017 [cited by applicant]
US 20170237736A1 · Eber · 2017 [cited by examiner]
US 20170374414A1 · Knox · 2017 [cited by applicant]
US 20180091303A1 · Brook et al. · 2018 [cited by applicant]
US 20180091304A1 · Brook et al. · 2018 [cited by applicant]
US 20180131408A1 · Austad · 2018 [cited by applicant]
US 20180300364A1 · Xu · 2018 [cited by applicant]
US 20190122577A1 · Mora et al. · 2019 [cited by applicant]
US 20190132236A1 · Rahman et al. · 2019 [cited by applicant]
US 20200112844A1 · Greenberg et al. · 2020 [cited by applicant]
US 20210051016A1 · Brook et al. · 2021 [cited by applicant]
US 20230299961A1 · Brook et al. · 2023 [cited by applicant]
CA 2887596A1 · 2015 [cited by applicant]
CN 103002125A · 2013 [cited by applicant]
CN 103347306A · 2013 [cited by applicant]
CN 109791621A · 2019 [cited by applicant]
CN 109791621B · 2022 [cited by applicant]
KR 20150080561A · 2015 [cited by applicant]
KR 20160031797A · 2016 [cited by applicant]
KR 20160098522A · 2016 [cited by applicant]
KR 102334821B1 · 2021 [cited by applicant]
KR 102462271B1 · 2022 [cited by applicant]
WO WO2018058127A1 · 2018 [cited by applicant]
“U.S. Appl. No. 15/716,124, Examiner Interview Summary mailed Mar. 25, 2020”, 4 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,124, Final Office Action mailed Nov. 20, 2019”, 84 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,124, Non Final Office Action mailed Apr. 1, 2019”, 80 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,124, Notice of Allowance mailed Apr. 22, 2020”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,124, Response filed Mar. 19, 2020 to Final Office Action mailed Nov. 20, 2019”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,124, Response filed Sep. 3, 2019 to Non-Final Office Action mailed Apr. 1, 2019”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,164, Non Final Office Action mailed Apr. 2, 2019”, 57 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,164, Notice of Allowance mailed Oct. 9, 2019”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/716,164, Response filed Jul. 2, 2019 to Non Final Office Action mailed Apr. 2, 2019”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 16/947,339, Final Office Action mailed Oct. 14, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/947,339, Non Final Office Action mailed Mar. 29, 2022”, 24 pgs. [cited by applicant]
“U.S. Appl. No. 16/947,339, Notice of Allowance mailed Jan. 11, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/947,339, Preliminary Amendment filed Nov. 6, 2020”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 16/947,339, Response filed Jun. 29, 2022 to Non Final Office Action mailed Mar. 29, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/132,636, Non Final Office Action mailed Dec. 22, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/132,636, Notice of Allowance mailed Apr. 11, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/132,636, Response filed Mar. 22, 2024 to Non Final Office Action mailed Dec. 22, 2023”, 9 pgs. [cited by applicant]
“Chinese Application Serial No. 201780058980.2, Office Action mailed Apr. 21, 2022”, w/ English translation, 8 pgs. [cited by applicant]
“Chinese Application Serial No. 201780058980.2, Office Action mailed Oct. 9, 2021”, w/ English translation, 20 pgs. [cited by applicant]
“Chinese Application Serial No. 201780058980.2, Response Filed Feb. 24, 2022 to Office Action mailed Oct. 9, 2021”, w/ English claims, 27 pgs. [cited by applicant]
“Chinese Application Serial No. 201780058980.2, Response filed Jun. 18, 2022 to Office Action mailed Apr. 21, 2022”, w/ English claims, 17 pgs. [cited by applicant]
“International Application Serial No. PCT/US2017/053509, International Preliminary Report on Patentability mailed Apr. 4, 2019”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2017/053509, International Search Report mailed Dec. 13, 2017”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2017/053509, Written Opinion mailed Dec. 13, 2017”, 5 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7011685, Notice of Preliminary Rejection mailed Feb. 25, 2021”, w/ English translation, 11 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7011685, Notice of Preliminary Rejection mailed Aug. 24, 2020”, w/ English translation, 18 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7011685, Response filed Apr. 26, 2021 to Office Action mailed Feb. 25, 2021”, w/ English Translation of Claims, 26 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7011685, Response filed Oct. 23, 2020 to Notice of Preliminary Rejection mailed Aug. 24, 2020”, w/ English Claims, 31 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7039215, Notice of Preliminary Rejection mailed Feb. 28, 2022”, w/ English translation, 5 pgs. [cited by applicant]
Choi, Jaehyuk, et al., “Always-On CMOS Image Sensor for Mobile and Wearable Devices”, IEEE Journal of Solid-State Circuits, (Jan. 2016), 130-140. [cited by applicant]
Flanagan, “Pairing devices using QR-Codes”, [Online] Retrieved from the Internet on Sep. 30, 2019: <URL: https://www.qrcode.es/en/pairing-devices-using-qr-codes/>, (Apr. 24, 2013), 3 pgs. [cited by applicant]
Kim, Eunah, et al., “Providing secure mobile device pairing based on visual confirmation”, IEEE 13th International Symposium on Consumer Electronics, (2009), 5 pgs. [cited by applicant]
Leyden, John, “This SMS will self-destruct in 40 seconds”, [Online] Retrieved from the Internet: <URL: http://www.theregister.co.uk/2005/12/12/stealthtext/>, (Dec. 12, 2005), 1 pg. [cited by applicant]
Liu, Sha, et al., “A novel asymmetric three-party based authentication scheme in wearable devices environment”, Journal of Network and Computer Applications, Academic Press, New York, NY, US, vol. 60, (Oct. 31, 2015), 1… [cited by applicant]
Liu, Sha, “Research on certification framework and certification scheme in wearable environment”, China Excellent Master Degree Thesis Full-text Database Information Technology Series, pp. 19-41, (Dec. 15, 2015), 27 pgs. [cited by applicant]
Ngu, Nguyen, et al., “Pattern-Based Alignment of Audio Data for Ad Hoc Secure Device Pairing”, 16th International Symposium on Wearable Computers, IEEE, (Jun. 8-22, 2012), 88-91. [cited by applicant]