IP Library Granted Patent US 11,287,885
Granted Patent B1
US 11,287,885 · App. 16/254,368 · Granted Mar 29, 2022

Apparatus, system, and method for determining the position of wearables donned by users of artificial reality systems

Inventors: Wolf Kienzle (Seattle, WA); Hrvoje Benko (Seattle, WA); Joseph Davis Greer (Portland, OR); Tristan Thomas Trutna (Portland, OR); Raymond King (Woodinville, WA); Yanjun Ma (Oro Valley, CA)
Assignee: Facebook Technologies, LLC
G06F3/014G01L1/22G02B27/0172G06F3/017G06T19/006G06T19/20H04N5/33G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,287,885
App. No.
16/254,368
Granted
Mar 29, 2022
Kind
B1
Abstract

An apparatus for determining the position of artificial reality wearables may include a wearable dimensioned to be donned by a user of an artificial reality system. The apparatus may also include a sensor incorporated into the wearable. The sensor may detect physical interactions between the wearable and at least one specific body part of the user. The apparatus may further include a processing device communicatively coupled to the sensor. The processing device may determine, based at least in part on one or more physical interactions between the wearable and the specific body part of the user, a change in a position of the wearable relative to the specific body part of the user. Various other apparatuses, systems, and methods are also disclosed.

Claims (60)

1. An apparatus comprising:

a wristband dimensioned to be donned proximate to a wrist of a user of an artificial reality system;

a plurality of components included on the wristband, wherein the components are separated from one another by a certain distance;

at least one light sensor incorporated into the wristband, wherein the at least one light sensor:

identifies a location of an internal structure of the user by scanning an internal region of the user via light;

determines, based at least in part on the internal structure of the user, a first distance between the at least one light sensor and the internal structure of the user at a first point in time; and

determines, based at least in part on the internal structure of the user, a second distance between the at least one light sensor and the internal structure of the user at a second point in time; and

at least one processing device communicatively coupled to the at least one light sensor, wherein the processing device detects, based at least in part on the first distance at the first point in time and the second distance at the second point in time, a change in an alignment of the wristband relative to an outer surface of the wrist of the user due at least in part to the wristband having moved in at least one direction relative to the outer surface of the wrist of the user.

2. The apparatus of claim 1 , wherein:

the at least one light sensor or an additional sensor incorporated into the wristband detects deformations in the wristband due to movement of the wrist of the user.

3. The apparatus of claim 2 , wherein the additional sensor comprises a strain gauge whose electrical resistance is commensurate with an amount of force applied to the strain gauge.

4. The apparatus of claim 2 , wherein the processing device determines the alignment of the wristband in part by deducing a current shape of the wristband based at least in part on the deformations of the wristband detected by the at least one light sensor or the additional sensor.

5. The apparatus of claim 2 , wherein:

the wristband further comprises a plurality of visual tracking aids that enable the artificial reality system to track a location of the wristband within a physical environment surrounding the user; and

the processing device determines the alignment of the wristband in part by detecting a change in a position of a visual tracking aid relative to at least one additional visual tracking aid.

6. The apparatus of claim 5 , wherein the processing device further passes data representative of the position of the visual tracking aid relative to the additional visual tracking aid to the artificial reality system to facilitate tracking the location of the wristband within the physical environment surrounding the user.

7. The apparatus of claim 1 , wherein:

the at least one light sensor comprises an interface of the wristband that is designed to be touched by a finger of the user.

8. The apparatus of claim 7 , wherein the processing device further detects when the finger of the user touches the interface based at least in part on images captured by a camera incorporated into the artificial reality system.

9. The apparatus of claim 1 , wherein the processing device further passes, to the artificial reality system, data representative of the change in the alignment of the wristband to enable the artificial reality system to modify at least one virtual component of the artificial reality system.

10. The apparatus of claim 9 , wherein the artificial reality system modifies the virtual component of the artificial reality system by:

detecting, based at least in part on the alignment of the wristband relative to the outer surface of the wrist of the user, at least one action performed by the user; and

modifying the virtual component to account for the action performed by the user.

11. The apparatus of claim 1 , wherein:

the components comprise a plurality of light-emitting devices that are separated from one another by the certain distance; and

the processing device determines, based at least in part on the change in the certain distance that separates the light-emitting devices incorporated into the wristband, that the wristband is not located in an expected position relative to the outer surface of the wrist of the user.

12. The apparatus of claim 1 , wherein the processing device facilitates modifying at least one component of the artificial reality system to account for the change in the alignment of the wristband relative to the outer surface of the wrist of the user, the component of the artificial reality system comprising at least one of:

an image projected onto a body part of the user via the wristband, wherein the processing device adjusts a location or orientation of the image as projected onto the body part to account for the change in the alignment of the wristband relative to the outer surface of the wrist of the user; or

a haptic device incorporated into the wristband, wherein the processing device directs the haptic device to adjust a location at which haptic feedback is provided to the user to account for the change in the alignment of the wristband relative to the outer surface of the wrist of the user.

13. The apparatus of claim 1 , wherein the processing device passes data representative of the change in the alignment of the wristband to a head-mounted display to enable the head-mounted display to optimize a computer vision tracking algorithm based at least in part on the change.

14. The apparatus of claim 1 , wherein the processing device identifies a specific body part of the user that is interacting with a signal that passes through a body of the user based at least in part on the change in the alignment of the wristband relative to the outer surface of the wrist of the user.

15. A system comprising:

a wristband dimensioned to be donned proximate to a wrist of a user of an artificial reality system;

a plurality of components included on the wristband, wherein the components are separated from one another by a certain distance;

a housing that:

is attached to the wristband; and

facilitates transmission of a plurality of types of communication signals;

at least one light sensor secured within the housing, wherein the at least one light sensor:

identifies a location of an internal structure of the user by scanning an internal region of the user via light;

determines, based at least in part on the internal structure of the user, a first distance between the at least one light sensor and the internal structure of the user at a first point in time; and

determines, based at least in part on the internal structure of the user, a second distance between the at least one light sensor and the internal structure of the user at a second point in time; and

at least one processing device communicatively coupled to the at least one light sensor, wherein the processing device detects, based at least in part on the first distance at the first point in time and the second distance at the second point in time, a change in an alignment of the wristband relative to an outer surface of the wrist of the user due at least in part to the wristband having moved in at least one direction relative to the outer surface of the wrist of the user.

16. The system of claim 15 , wherein:

the artificial reality system tracks a location of the wristband within a physical environment surrounding the user; and

the housing secures a plurality of visual tracking aids that facilitate tracking the location of the wristband.

17. The system of claim 16 , wherein:

the plurality of visual tracking aids comprises one or more light-emitting devices; and

the housing transmits light emitted by the light-emitting devices such that the light is received by a camera incorporated into the artificial reality system.

18. The system of claim 15 , wherein:

the at least one light sensor comprises one or more near-infrared devices; and

the housing transmits near-infrared signals generated by the near-infrared devices.

19. The system of claim 15 , wherein:

the housing secures at least one additional sensor that detects an electrical response generated by an accelerometer incorporated into the wristband; and

the processing device further determines, based at least in part on the electrical response detected by the at least one light sensor, that the user has made a specific gesture with at least one body part.

20. A method comprising:

identifying, by a at least one light sensor incorporated into a wristband dimensioned to be donned proximate to a wrist of a user of an artificial reality system, a location of an internal structure of the user by scanning an internal region of the user via light;

determining, based at least in part on the internal structure of the user, a first distance between the at least one light sensor and the internal structure of the user at a first point in time;

determining, based at least in part on the internal structure of the user, a second distance between the at least one light sensor and the internal structure of the user at a second point in time;

detecting, based at least in part on the first distance at the first point in time and the second distance at the second point time, a change in an alignment of the wristband relative to an outer surface of the wrist of the user due at least in part to the wristband having moved in at least one direction relative to the outer surface of the wrist of the user; and

generating at least one input command for the artificial reality system that accounts for the change in the alignment of the wristband relative to the wrist of the user.

Assignments (4)
CHANGE OF NAME Recorded Jun 7, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060291/0526 →
CHANGE OF NAME Recorded Feb 25, 2022
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 059250/0764 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME "COMMA AFTER THE PERIOD" PREVIOUSLY RECORDED AT REEL: 048917 FRAME: 0479. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Aug 9, 2021
From: KIENZLE, WOLF; BENKO, HRVOJE; GREER, JOSEPH DAVIS; TRUTNA, TRISTAN THOMAS; KING, RAYMOND; MA, YANJUN
To: FACEBOOK, INC.
Reel/Frame 057128/0325 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2019
From: KIENZLE, WOLF; BENKO, HRVOJE; GREER, JOSEPH DAVIS; TRUTNA, TRISTAN THOMAS; KING, RAYMOND; MA, YANJUN
To: FACEBOOK, INC.,
Reel/Frame 048917/0479 →
Cited By (1)
US 12,596,438