IP Library Granted Patent US 11,416,075
Granted Patent B1
US 11,416,075 · App. 16/829,209 · Granted Aug 16, 2022

Wearable device and user input system for computing devices and artificial reality environments

Inventors: Jun Gong (Redmond, WA); Aakar Gupta (Redmond, WA); Hrvoje Benko (Seattle, WA)
Assignee: Facebook Technologies, LLC
G06F3/014G01S5/22G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,416,075
App. No.
16/829,209
Filed
Mar 25, 2020
Granted
Aug 16, 2022
Kind
B1
Art Unit
2625
USPC
345/156
Abstract

A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.

Claims (51)

1. A wearable device, comprising:

a wristband having a bottom side configured to be worn proximate to an inner portion of a user's wrist;

two or more vibration sensors coupled to the bottom side of the wristband and positioned to detect when the user's fingers contact a surface, the wearable device being separate and distinct from the surface;

an electronic data storage element containing a set of computer-executable instructions; and

an electronic processor coupled to the electronic data storage element and configured to execute the set of instructions to cause the wearable device to use the two or more vibration sensors coupled to the bottom side of the wristband to:

detect a vibration propagating through a first medium as a result of a contact of a finger of the user with the surface;

detect a vibration propagating through a second medium as a result of the contact of the finger of the user with the surface; and

determine a location where the finger of the user contacted the surface based on a time difference between detecting the vibration propagating through the first medium and detecting the vibration propagating through the second medium.

2. The wearable device of claim 1 , wherein the first medium comprises air and the second medium comprises the surface.

3. The wearable device of claim 2 , wherein the two or more vibration sensors include a first transducer for detecting the vibration propagating through the air and a second transducer for detecting the vibration propagating through the surface.

4. The wearable device of claim 3 , wherein the first transducer is an audio transducer and the second transducer is an accelerometer.

5. The wearable device of claim 1 , further comprising an optical sensor coupled to the bottom side of the wristband, an output of the optical sensor being used in determining the location of where the user contacted the surface.

6. The wearable device of claim 1 , further comprising a transmitting element operable to transmit one or more of data obtained from the two or more vibration sensors or data regarding the determined location to another device that uses the transmitted data to determine a desired action of the user.

7. The wearable device of claim 6 , wherein the other device to which the transmitting element transmits the data is an artificial reality headset.

8. The wearable device of claim 7 , wherein the determined location is used by the headset to alter an experience of the user wearing the headset.

9. The wearable device of claim 1 , wherein:

the two or more vibration sensors include a pair of microphones and a pair of accelerometers; and

the two or more vibration sensors are arranged on the wearable device with each of the accelerometers and each of the microphones placed at the corners of a square.

10. The wearable device of claim 9 , wherein:

the two or more vibration sensors are positioned with a first accelerometer in the lower left corner of the square, a second accelerometer in the upper left corner of the square, a first microphone in the lower right corner of the square, and a second microphone in the upper right corner of the square;

the axis between the two accelerometers or two microphones is defined as the x-axis relative to a user's wrist deviation; and

the axis between a microphone and an accelerometer is defined as the orthogonal y-axis relative to the user's wrist flexion and extension.

11. A system, comprising:

a headset operable to generate an artificial reality experience for a user;

a wearable device comprising:

a wristband having a bottom side configured to be worn proximate to an inner portion of a wrist of the user; and

two or more vibration sensors coupled to the bottom side of the wristband and positioned to detect when the user's fingers contact a surface, the wearable device being separate and distinct from the surface;

an electronic data storage element containing a set of computer-executable instructions;

an electronic processor coupled to the electronic data storage element and configured to execute the set of instructions to cause the system to use the two or more vibration sensors coupled to the bottom side of the wristband to:

detect a vibration propagating through a first medium as a result of a contact of a finger of the user with the surface;

detect a vibration propagating through a second medium as a result of the contact of the finger of the user with the surface; and

determine a location where the finger of the user contacted the surface based on a time difference between detecting the vibration propagating through the first medium and detecting the vibration propagating through the second medium; and

a transmitting element operable to transmit one or more of data obtained from the two or more vibration sensors or data regarding the determined location to the headset.

12. The system of claim 11 , wherein the first medium comprises air and the second medium comprises the surface.

13. The system of claim 12 , wherein the two or more vibration sensors include a first transducer for detecting the vibration propagating through the air and a second transducer for detecting the vibration propagating through the surface.

14. The system of claim 13 , wherein the first transducer is an audio transducer and the second transducer is an accelerometer.

15. The system of claim 11 , further comprising an optical sensor coupled to the bottom side of the wristband, an output of the optical sensor being used in determining the location of where the user contacted the surface.

16. The system of claim 11 , wherein the determined location is used by the headset to alter the experience of a user wearing the headset.

17. The system of claim 11 , wherein:

the two or more vibration sensors are positioned with a first accelerometer in the lower left corner of a square, a second accelerometer in the upper left corner of a square, a first microphone in the lower right corner of a square, and a second microphone in the upper right corner of a square;

the axis between the two accelerometers or two microphones is defined as the x-axis relative to a user's wrist deviation; and

the axis between a microphone and an accelerometer is defined as the orthogonal y-axis relative to the user's wrist flexion and extension.

18. A method, comprising:

using two or more vibration sensors coupled to a bottom side of a wristband to detect when a user's fingers contact a surface that is separate and distinct from the wristband by:

detecting a vibration propagating through a first medium as a result of a contact of a finger of the user with the surface;

detecting a vibration propagating through a second medium as a result of the contact of the finger of the user with the surface; and

determining a location where the finger of the user contacted the surface based on a time difference between detecting the vibration propagating through the first medium and detecting the vibration propagating through the second medium; and

using the determined location to determine the user's intended interaction with a user interface.

19. The method of claim 18 , further comprising:

transmitting data regarding the determined location to a headset operable to generate an artificial reality experience for the user.

20. The method of claim 18 , wherein the first medium is air and the second medium is the surface.

Assignments (2)
CHANGE OF NAME Recorded May 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060203/0228 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2020
From: GONG, JUN; GUPTA, AAKAR; BENKO, HRVOJE
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 053218/0610 →
Cited By (3)
US 12,307,053 US 12,399,600 US 12,663,857