SENSORS FOR ACCURATELY THROWING OBJECTS IN AN EXTENDED-REALITY ENVIRONMENT, AND SYSTEMS AND METHODS OF USE THEREOF
The disclosed system for tracking user movements while a user is interacting with a virtual object may include (1) obtaining tracking information by tracking, via a sensor, a position of an arm of the user and (2) in conjunction with tracking the position of the arm, obtaining wrist information by detecting, via a neuromuscular-signal sensor, (i) a movement of a wrist of the arm and (ii) assigning one or more motion characteristics to the virtual object in accordance with the tracking information and the wrist information.
1 . A computing system, comprising:
control circuitry;
memory; and
one or more sets of instructions stored in the memory and configured for execution by the control circuitry, the one or more sets of instructions comprising instructions for:
while a user is interacting with a virtual object:
obtaining tracking information by tracking, via a sensor, a position of an arm of the user; and
in conjunction with tracking the position of the arm, obtaining wrist information by detecting, via a neuromuscular-signal sensor, a movement of a wrist of the arm; and
assigning one or more motion characteristics to the virtual object in accordance with the tracking information and the wrist information.
2 . The computing system of claim 1 , wherein assigning the one or more motion characteristics comprises assigning the one or more motion characteristics to at least one of the arm or wrist of the user.
3 . The computing system of claim 1 , wherein the one or more sets of instructions further comprise instructions for identifying the one or more motion characteristics of the interaction with the virtual object.
4 . The computing system of claim 1 , wherein the one or more sets of instructions further comprise instructions for updating one or more visual characteristics of a virtual environment based on at least one of the wrist information or the tracking information.
5 . The computing system of claim 1 , wherein assigning the one or more motion characteristics to the virtual object comprises assigning a trajectory to the virtual object.
6 . The computing system of claim 1 , wherein the sensor and the neuromuscular-signal sensor are arranged on a wrist-wearable device.
7 . The computing system of claim 5 , wherein:
the neuromuscular-signal sensor is arranged to sense signals for a first motor unit in the arm of the user; and
the wrist-wearable device further includes a second neuromuscular-signal sensor arranged to sense signals for a second motor unit in the arm of the user.
8 . The computing system of claim 1 , wherein the one or more sets of instructions further comprise instructions for, in conjunction with tracking the position of the arm:
obtaining additional tracking information by tracking a position of the other arm of the user; and
obtaining additional wrist information by detecting, via an additional neuromuscular-signal sensor, a movement of a wrist of the other arm, wherein the one or more motion characteristics are based on the additional tracking information and the additional wrist information.
9 . The computing system of claim 1 , wherein:
the virtual object is a virtual ball; and
the user interacting with the virtual object comprises the user striking the virtual ball.
10 . The computing system of claim 1 , wherein the virtual object is displayed to the user via a head-wearable device.
11 . The computing system of claim 1 , wherein feedback information corresponding to the one or more motion characteristics is provided to the user.
12 . The computing system of claim 1 , wherein the sensor is an inertial measurement unit (IMU) sensor.
13 . The computing system of claim 1 , wherein the sensor is an imaging sensor.
14 . The computing system of claim 1 , wherein the sensor is arranged on a controller.
15 . The computing system of claim 1 , wherein:
the user interacting with the virtual object comprises the user throwing the virtual object; and
the one or more motion characteristics are assigned to the virtual object in response to detecting the user perform a release gesture.
16 . The computing system of claim 15 , wherein a rotational velocity of the virtual object is assigned based on the wrist information.
17 . The computing system of claim 15 , wherein the release gesture comprises the user pressing or releasing a button.
18 . The computing system of claim 15 , wherein during a throwing motion the user is performing a pinch gesture, and wherein the release gesture comprises the user releasing the pinch gesture.
19 . A method of tracking user movements, the method comprising:
while a user is interacting with a virtual object:
obtaining tracking information by tracking, via a sensor, a position of an arm of the user; and
in conjunction with tracking the position of the arm, obtaining wrist information by detecting, via a neuromuscular-signal sensor, a movement of a wrist of the arm; and
assigning one or more motion characteristics to the virtual object in accordance with the tracking information and the wrist information.
20 . A non-transitory computer-readable storage medium storing one or more sets of instructions configured for execution by a computing device having control circuitry and memory, the one or more sets of instructions comprising instructions for:
while a user is interacting with a virtual object:
obtaining tracking information by tracking, via a sensor, a position of an arm of the user; and
in conjunction with tracking the position of the arm, obtaining wrist information by detecting, via a neuromuscular-signal sensor, a movement of a wrist of the arm; and
assigning one or more motion characteristics to the virtual object in accordance with the tracking information and the wrist information.