IP Library › Granted Patent US 12,320,642
Granted Patent B2
US 12,320,642 · App. 18/413,840 · Granted Jun 3, 2025

Wearable skin vibration or silent gesture detector

Inventors: Mehmet Mutlu (Grover Beach, CA); Ahmet Fatih Cihan (San Jose, CA)
Assignee: Apple Inc.
G01B9/02092G06F3/017G06F3/167H04R1/1091H04R2460/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,320,642
App. No.
18/413,840
Granted
Jun 3, 2025
Kind
B2
Abstract

Disclosed herein are wearable devices, their configurations, and methods of operation that use self-mixing interferometry signals of a self-mixing interferometry sensor to recognize user inputs. The user inputs may include voiced commands or silent gesture commands. The devices may be wearable on the user's head, with the self-mixing interferometry sensor configured to direct a beam of light toward a location on the user's head. Skin deformations or vibrations at the location may be caused by the user's speech or the user's silent gestures and recognized using the self-mixing interferometry signal. The self-mixing interferometry signals may be used for bioauthentication and/or audio conditioning of received sound or voice inputs to a microphone.

Claims (88)

1. A wearable device, comprising:

a frame configured to attach the wearable device to a user;

a self-mixing interferometry sensor mounted to the frame and configured to emit a beam of light; and

a command interpreter configured to:

receive a self-mixing interferometry signal from the self-mixing interferometry sensor; and

detect skin vibration information in the self-mixing interferometry signal;

wherein:

the frame is configured to direct the beam of light toward a head of the user;

and

the command interpreter is configured to identify and authenticate a command using the skin vibration information.

2. The wearable device of claim 1 , wherein the wearable device is an earbud further comprising:

a microphone; and

an in-ear speaker; and wherein:

the self-mixing interferometry sensor directs the beam of light toward a location in an ear of the user; and

the command interpreter identifies a voiced command of the user using the skin vibration information.

3. The wearable device of claim 1 , wherein:

the wearable device is an eyeglasses set;

the self-mixing interferometry sensor is mounted to an arm of the eyeglasses set and directs the beam of light toward a location proximate to a temporal bone of the user; and

the command interpreter identifies a voiced command of the user based on the skin vibration information.

4. The wearable device of claim 1 , wherein the skin vibration information includes temporomandibular joint movement information.

5. The wearable device of claim 4 , wherein:

the wearable device is a headphone;

the self-mixing interferometry sensor directs the beam of light toward a location on the user's head proximate to a temporomandibular joint of the user; and

the command interpreter identifies the temporomandibular joint movement information as a silent gesture command of the user.

6. The wearable device of claim 4 , wherein:

the wearable device is a visual display headset;

the self-mixing interferometry sensor is a first self-mixing interferometry sensor;

the beam of light is a first beam of light;

the self-mixing interferometry signal is a first self-mixing interferometry signal;

the first self-mixing interferometry sensor directs the beam of light toward a first location on the user's head proximate to a temporomandibular joint of the user;

the command interpreter identifies the temporomandibular joint movement information as a silent gesture command of the user;

the wearable device comprises a second self-mixing interferometry sensor that directs a second beam of light toward a second location on the user's head proximate to a parietal bone; and

the command interpreter is configured to receive a second self-mixing interferometry signal from the second self-mixing interferometry sensor; wherein:

the second self-mixing interferometry signal includes skin vibration information; and

the command interpreter is configured to identify a voiced command encoded in the skin vibration information of the second self-mixing interferometry signal.

7. The wearable device of claim 1 , wherein:

the beam of light is a laser light beam emitted by a laser diode;

a bias current of the laser diode is modulated with a sine wave; and

the command interpreter is configured to use a time domain I/Q analysis to identify the command encoded in the skin vibration information.

8. The wearable device of claim 1 , wherein:

the beam of light is a laser light emitted by a laser diode;

a bias current of the laser diode is modulated with a triangle wave; and

the command interpreter is configured to use a spectrum analysis to identify the command encoded in the skin vibration information.

9. A device, comprising:

a head-mountable frame configured to be worn by a user;

a self-mixing interferometry sensor mounted to the head-mountable frame and configured to emit a beam of light toward a location on the user's head;

a microphone;

a command interpreter configured to receive an output of the microphone and recognize a voiced command of the user; and

a bioauthentication circuit configured to:

determine skin vibration information from the received light of the emitted beam of light; and

authenticate the voiced command using the skin vibration information of the self-mixing interferometry sensor.

10. The device of claim 9 , wherein:

the received light includes skin deformation information;

the bioauthentication circuit is operable to:

detect, using at least the skin deformation information, that the user was speaking during a time interval of the received output of the microphone; and

authenticate the voiced command using the detection.

11. The device of claim 10 , wherein authentication of the voiced command further includes detecting a correlation of the voiced command of the user with a voice pattern detected in the skin vibration information.

12. The device of claim 9 , wherein the device is an earbud further comprising:

an in-ear speaker; and

a radio transmitter; wherein:

the device transmits the voiced command using the radio transmitter upon authentication.

13. The device of claim 9 , wherein:

the device is a headphone;

the location on the user's head is proximate to at least one of a temporal bone and a parietal bone; and

the device implements the voiced command upon authentication.

14. The device of claim 9 , wherein:

the beam of light is a laser light beam emitted by a laser diode;

the bioauthentication circuit is configured to authenticate the voiced command using at least one of:

a time domain I/Q analysis of the received light when a sine wave modulation is applied to a bias current of the laser diode, and

a spectrum analysis of the received light when a triangle wave modulation is applied to the bias current of the laser diode.

15. A device, comprising:

a head-mountable frame configured to be worn by a user;

a self-mixing interferometry sensor mounted to the head-mountable frame and configured to emit a beam of light toward skin of the user and determine skin vibration information from a detected portion of the beam of light;

a microphone configured to produce an audio signal; and

an audio conditioning circuit configured to modify the audio signal using a self-mixing interferometry signal of the self-mixing interferometry sensor to detect intervals of speech using the skin vibration information and suppress background noise in the audio signal.

16. The device of claim 15 , wherein the device is an earbud further comprising:

an in-ear speaker; and

a radio transmitter; wherein:

the device transmits the audio signal only during the detected time intervals of speech of the user.

17. The device of claim 15 , wherein:

the device is a headphone further comprising a radio transmitter;

the self-mixing interferometry sensor directs the beam of light toward a location on the user's head proximate to at least one of the a temporal bone and the a parietal bone; and

the device transmits the audio signal only during the detected time intervals of speech of the user.

18. The device of claim 15 , wherein:

the beam of light is a laser light beam emitted by a laser diode;

the audio conditioning circuit is configured to modify the audio signal using at least one of:

a time domain I/Q analysis of the self-mixing interferometry signal when a sine wave modulation is applied to a bias current of the laser diode, and

a spectrum analysis of the self-mixing interferometry signal when a triangle wave modulation is applied to the bias current of the laser diode.

Continuity (4)
Continuation 17894571 · Aug 24, 2022
Continuation 16849826 · Apr 15, 2020
Provisional Application 62852481 · May 24, 2019
Related Publication 20240159512A1 · May 16, 2024
References Cited (182)
US 4254333A · Bergström · 1981 [cited by applicant]
US 4468131A · Bui et al. · 1984 [cited by applicant]
US 4913547A · Moran · 1990 [cited by applicant]
US 5500708A · Ohsawa · 1996 [cited by applicant]
US 5565986A · Knuttel · 1996 [cited by applicant]
US 5781297A · Castore · 1998 [cited by applicant]
US 5825465A · Nerin et al. · 1998 [cited by applicant]
US 6233045B1 · Suni et al. · 2001 [cited by applicant]
US 6531767B2 · Shrauger · 2003 [cited by applicant]
US 6724486B1 · Shull et al. · 2004 [cited by applicant]
US 6816523B1 · Glenn et al. · 2004 [cited by applicant]
US 6872931B2 · Liess et al. · 2005 [cited by applicant]
US 6885438B2 · Deines · 2005 [cited by applicant]
US 7139446B2 · Slotwinski · 2006 [cited by applicant]
US 7184445B2 · Guenter · 2007 [cited by applicant]
US 7277180B2 · Townley-Smith et al. · 2007 [cited by applicant]
US 7336368B2 · Liao et al. · 2008 [cited by applicant]
US 7366217B2 · Guenter et al. · 2008 [cited by applicant]
US 7388672B2 · Zhou et al. · 2008 [cited by applicant]
US 7509050B2 · Ekkizogloy et al. · 2009 [cited by applicant]
US 7557795B2 · Kong et al. · 2009 [cited by applicant]
US 7589709B2 · Liess et al. · 2009 [cited by applicant]
US 7620332B2 · Nishiyama · 2009 [cited by applicant]
US 7667851B2 · Dubois et al. · 2010 [cited by applicant]
US 7675020B2 · Machida · 2010 [cited by applicant]
US 7684957B2 · Ueno · 2010 [cited by applicant]
US 7995193B2 · Kuwata · 2011 [cited by applicant]
US 8174597B2 · Ogasawara · 2012 [cited by applicant]
US 8208814B2 · Sheth et al. · 2012 [cited by applicant]
US 8248615B2 · Ueno · 2012 [cited by applicant]
US 8378287B2 · Schemmann et al. · 2013 [cited by applicant]
US 8405902B2 · Irie · 2013 [cited by applicant]
US 8416424B2 · Werner et al. · 2013 [cited by applicant]
US 8444331B2 · Kobayashi · 2013 [cited by applicant]
US 8446592B1 · Arissian · 2013 [cited by applicant]
US 8529460B2 · Kawano et al. · 2013 [cited by applicant]
US 8537341B2 · Ueno · 2013 [cited by applicant]
US 8736581B2 · Han et al. · 2014 [cited by applicant]
US 8751091B2 · Moench et al. · 2014 [cited by applicant]
US 8781687B2 · Han et al. · 2014 [cited by applicant]
US 8896745B2 · Takachi · 2014 [cited by applicant]
US 8942069B2 · Tortora · 2015 [cited by applicant]
US 9004698B2 · Kilcher et al. · 2015 [cited by applicant]
US 9068916B2 · Heng · 2015 [cited by applicant]
US 9091573B2 · Van Der Lee et al. · 2015 [cited by applicant]
US 9091747B2 · Pruijmboom · 2015 [cited by applicant]
US 9146304B2 · Land et al. · 2015 [cited by applicant]
US 9160390B2 · Zhou et al. · 2015 [cited by applicant]
US 9170088B2 · Lim et al. · 2015 [cited by applicant]
US 9420155B2 · Brodie · 2016 [cited by applicant]
US 9459352B2 · Becker et al. · 2016 [cited by applicant]
US 9588586B2 · Rihn · 2017 [cited by applicant]
US 9648221B2 · Seo et al. · 2017 [cited by applicant]
US 9658113B2 · Bosch et al. · 2017 [cited by applicant]
US 9677986B1 · Baldwin et al. · 2017 [cited by applicant]
US 9703173B2 · Brodie · 2017 [cited by applicant]
US 9726474B2 · Royo Royo et al. · 2017 [cited by applicant]
US 9772398B2 · Bikumandla et al. · 2017 [cited by applicant]
US 9778037B2 · Bestler · 2017 [cited by applicant]
US 9911890B2 · Renard et al. · 2018 [cited by applicant]
US 9912923B2 · Kilcher et al. · 2018 [cited by applicant]
US 9952245B2 · Ueno · 2018 [cited by applicant]
US 9995877B2 · Nakamura · 2018 [cited by applicant]
US RE46930E · Mimeault · 2018 [cited by applicant]
US 10070799B2 · Ang et al. · 2018 [cited by applicant]
US 10184783B2 · Flanders et al. · 2019 [cited by applicant]
US 10215555B2 · Chen et al. · 2019 [cited by applicant]
US 10222474B1 · Raring et al. · 2019 [cited by applicant]
US 10317651B2 · Furutake et al. · 2019 [cited by applicant]
US 10379028B2 · Spruit et al. · 2019 [cited by applicant]
US 10386554B2 · Hjelmstrom et al. · 2019 [cited by applicant]
US 10492679B2 · Zhou · 2019 [cited by applicant]
US 10503048B2 · Del Bino et al. · 2019 [cited by applicant]
US 10555079B2 · Bakish · 2020 [cited by examiner]
US 10613625B2 · Huang et al. · 2020 [cited by applicant]
US 10614295B2 · Kim et al. · 2020 [cited by applicant]
US 10635800B2 · Bakish · 2020 [cited by applicant]
US 10581474B1 · Fishman et al. · 2020 [cited by applicant]
US 10705211B2 · Jacobs et al. · 2020 [cited by applicant]
US 10718922B2 · Yong et al. · 2020 [cited by applicant]
US 10791283B2 · Bardagjy et al. · 2020 [cited by applicant]
US 10824275B2 · Mutlu et al. · 2020 [cited by applicant]
US 10845873B2 · Huang · 2020 [cited by applicant]
US 10866083B2 · Van Der Lee et al. · 2020 [cited by applicant]
US 10871820B2 · Mutlu et al. · 2020 [cited by applicant]
US 10871836B2 · Dashevsky · 2020 [cited by applicant]
US 10970556B2 · Teich et al. · 2021 [cited by applicant]
US 11022835B2 · Jamali et al. · 2021 [cited by applicant]
US 11036318B2 · Kuboyama et al. · 2021 [cited by applicant]
US 11073615B2 · Chua et al. · 2021 [cited by applicant]
US 11092480B2 · Garrett et al. · 2021 [cited by applicant]
US 11092531B2 · Spruit et al. · 2021 [cited by applicant]
US 11112233B2 · Mutlu et al. · 2021 [cited by applicant]
US 11150332B1 · Chen et al. · 2021 [cited by applicant]
US 11156456B2 · Chen et al. · 2021 [cited by applicant]
US 11157113B2 · Winkler et al. · 2021 [cited by applicant]
US 11175700B1 · Poole · 2021 [cited by applicant]
US 11243068B1 · Mutlu et al. · 2022 [cited by applicant]
US 11243686B2 · McCord · 2022 [cited by applicant]
US 11280714B2 · Momtahan et al. · 2022 [cited by applicant]
US 11327008B2 · Venturini et al. · 2022 [cited by applicant]
US 11360440B2 · Perkins et al. · 2022 [cited by applicant]
US 11422638B2 · Mutlu et al. · 2022 [cited by applicant]
US 11460293B2 · Chen et al. · 2022 [cited by applicant]
US 11494926B1 · Wu · 2022 [cited by applicant]
US 11549799B2 · Tan et al. · 2023 [cited by applicant]
US 11629948B2 · Shou et al. · 2023 [cited by applicant]
US 11692925B2 · Spruit et al. · 2023 [cited by applicant]
US 11740071B2 · Huang et al. · 2023 [cited by applicant]
US 11822095B2 · Park et al. · 2023 [cited by applicant]
US 11846525B2 · Chen et al. · 2023 [cited by applicant]
US 20050156874A1 · Kong · 2005 [cited by applicant]
US 20050157971A1 · Juijve · 2005 [cited by applicant]
US 20060239312A1 · Kewitsch et al. · 2006 [cited by applicant]
US 20080007713A1 · Zijp · 2008 [cited by applicant]
US 20080123106A1 · Zeng et al. · 2008 [cited by applicant]
US 20090002829A1 · Shinohara · 2009 [cited by applicant]
US 20110126617A1 · Bengoechea Apezteguia et al. · 2011 [cited by applicant]
US 20110267467A1 · Kimura et al. · 2011 [cited by applicant]
US 20110301455A1 · Numajiri et al. · 2011 [cited by applicant]
US 20120262722A1 · Lim et al. · 2012 [cited by applicant]
US 20120281221A1 · Studer et al. · 2012 [cited by applicant]
US 20130063718A1 · Bernal et al. · 2013 [cited by applicant]
US 20140293055A1 · Otsuka · 2014 [cited by applicant]
US 20150309568A1 · Miki · 2015 [cited by applicant]
US 20160021285A1 · Nadler et al. · 2016 [cited by applicant]
US 20170192133A1 · Murakami et al. · 2017 [cited by applicant]
US 20170343817A1 · Bietry et al. · 2017 [cited by applicant]
US 20170344812A1 · Kim · 2017 [cited by examiner]
US 20180027339A1 · Blumkin et al. · 2018 [cited by applicant]
US 20180073924A1 · Steinmann et al. · 2018 [cited by applicant]
US 20180081434A1 · Siddiqui et al. · 2018 [cited by applicant]
US 20180232511A1 · Bakish · 2018 [cited by examiner]
US 20190146065A1 · Jutte et al. · 2019 [cited by applicant]
US 20190317454A1 · Holenarsipur et al. · 2019 [cited by applicant]
US 20190319157A1 · Coffy et al. · 2019 [cited by applicant]
US 20200370879A1 · Mutlu et al. · 2020 [cited by applicant]
US 20210015350A1 · Butte et al. · 2021 [cited by applicant]
US 20210104873A1 · Gerlach · 2021 [cited by applicant]
US 20210116355A1 · Spruit et al. · 2021 [cited by applicant]
US 20210294489A1 · Li et al. · 2021 [cited by applicant]
US 20220074844A1 · D'Apuzzo et al. · 2022 [cited by applicant]
US 20220155052A1 · Mutlu et al. · 2022 [cited by applicant]
US 20220202515A1 · Itkowitz et al. · 2022 [cited by applicant]
US 20220404138A1 · Mutlu et al. · 2022 [cited by applicant]
US 20230087691A1 · Chen et al. · 2023 [cited by applicant]
US 20230314185A1 · Chen et al. · 2023 [cited by applicant]
US 20230366672A1 · Huang et al. · 2023 [cited by applicant]
US 20240003671A1 · Jin et al. · 2024 [cited by applicant]
US 20240004034A1 · Chen et al. · 2024 [cited by applicant]
CN 101592762 · 2009 [cited by applicant]
CN 102109650 · 2011 [cited by applicant]
CN 105223579 · 2016 [cited by applicant]
CN 107564924 · 2018 [cited by applicant]
CN 108225543 · 2018 [cited by applicant]
CN 108692663 · 2020 [cited by applicant]
EP 3598591 · 2020 [cited by applicant]
EP 3796140 · 2021 [cited by applicant]
GB 2441557A · 2008 [cited by applicant]
GB 2443662 · 2008 [cited by applicant]
JP 2004504634A · 2004 [cited by applicant]
JP 2005528682 · 2005 [cited by applicant]
JP 2009222573 · 2009 [cited by applicant]
JP 2010511883A · 2010 [cited by applicant]
JP 2010526315 · 2010 [cited by applicant]
JP 2011523700 · 2011 [cited by applicant]
JP 2012521003 · 2012 [cited by applicant]
JP 2013508717 · 2013 [cited by applicant]
JP 2014078823 · 2014 [cited by applicant]
JP 2014534459 · 2014 [cited by applicant]
JP 2015078946 · 2015 [cited by applicant]
JP 2019515258 · 2019 [cited by applicant]
JP 2019121691 · 2019 [cited by applicant]
KR 101792588 · 2012 [cited by applicant]
WO WO05013517 · 2005 [cited by applicant]
WO WO09156937 · 2009 [cited by applicant]
WO WO10139144 · 2010 [cited by applicant]
WO WO17178711 · 2017 [cited by applicant]
WO WO18036685 · 2018 [cited by applicant]
WO WO19015623 · 2019 [cited by applicant]
WO WO19042953 · 2019 [cited by applicant]
Diao et al., “High-speed high-resolution heterodyne interferometer using a laser with low beat frequency,” [cited by applicant]