Wearable electronic devices, extended reality systems including neuromuscular sensors, and methods for generating text from speech input and modifying the generated text based on neuromuscular data

1 . A non-transitory, computer-readable storage medium including executable instructions that, when executed by one or more processors, cause the one or more processors to:

while a head-wearable device and a wrist-wearable device are communicatively coupled and worn by a user:

obtain speech data, based on a speech input from the user, at a microphone of the head-wearable device;

determine text based on the speech data;

obtain neuromuscular data, based on a neuromuscular input from the user, at a neuromuscular sensor of the wrist-wearable device;

cause the text to be modified based on the neuromuscular data to produce modified text; and

cause the modified text to be presented to the user.

2 . The non-transitory, computer-readable storage medium of claim 1 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtain additional neuromuscular data, based on an additional neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

cause the text to be modified based on the additional neuromuscular data to produce additional modified text; and

cause the additional modified text to be presented to the user.

3 . The non-transitory, computer-readable storage medium of claim 1 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtain second speech data, based on a second speech input from the user, at the microphone of the head-wearable device;

determine second text based on the second speech data;

obtain second neuromuscular data, based on a second neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

cause the second text to be modified based on the second neuromuscular data to produce second modified text; and

cause the second modified text to be presented to the user.

4 . The non-transitory, computer-readable storage medium of claim 1 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

in response to obtaining fourth neuromuscular data, based on fourth neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device, cause the modified text to be sent to another user.

5 . The non-transitory, computer-readable storage medium of claim 1 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device, the wrist-wearable device, and another wrist-wearable device are communicatively coupled and worn by the user:

obtain other neuromuscular data, based on another neuromuscular input from the user, at a neuromuscular sensor of the other wrist-wearable device;

cause the text to be modified based on the other neuromuscular data to produce other modified text; and

cause the other modified text to be presented to the user, wherein the wrist-wearable device is worn on a first wrist of the user and the other wrist-wearable device is worn on a second wrist of the user.

6 . The non-transitory, computer-readable storage medium of claim 1 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device, the wrist-wearable device, and another wrist-wearable device are communicatively coupled and worn by the user:

in response to determining the text based on the speech data, predict an error in the text, based on one or more trained statistical models; and

present a suggested correction, based on one or more trained statistical models, to the user, wherein:

the neuromuscular data, based on the neuromuscular input from the user, indicates that the user accepts the suggested correction; and

causing the text to be modified based on the neuromuscular data to produce the modified text includes making the suggested correction to the text.

7 . The non-transitory, computer-readable storage medium of claim 1 , wherein:

the speech input from the user is a plurality of words spoken by the user; and

determining the text based on the speech data includes converting the plurality of words spoken by the user to a textual representation of the plurality of words.

8 . The non-transitory, computer-readable storage medium of claim 1 , wherein:

the neuromuscular sensor of the wrist-wearable device is an electromyography (EMG) sensor; and

the neuromuscular data is EMG data.

9 . The non-transitory, computer-readable storage medium of claim 1 , wherein the neuromuscular input from the user is one or more of one or more typing actions, one or more tapping gestures, one or more writing gestures, one or more drawing gestures, one or more finger gestures, and one or more one-handed gestures.

10 . The non-transitory, computer-readable storage medium of claim 1 , wherein causing the text to be modified based on the neuromuscular data includes at least one of adding one or more characters to the text, removing one or more characters from the text, changing one or more characters of the text, and moving one or more characters of the text.

11 . The non-transitory, computer-readable storage medium of claim 1 , wherein causing the text to be presented to the user includes at least one of:

presenting a visual representation of the text at a display of one or more of the head-wearable device, the wrist wearable device, and another device communicatively coupled to the head-wearable device and the wrist-wearable device; and

presenting an audio representation of the text at a speaker of one or more of the head-wearable device, the wrist wearable device, and the other device.

12 . The non-transitory, computer-readable storage medium of claim 1 , wherein:

the head-wearable device is at least one of a pair of smart glasses and an extended-reality (XR) headset; and

the wrist-wearable device is a smart watch.

13 . A method, the method comprising:

while a head-wearable device and a wrist-wearable device are communicatively coupled and worn by a user:

obtaining speech data, based on a speech input from the user, at a microphone of the head-wearable device;

determining text based on the speech data;

obtaining neuromuscular data, based on a neuromuscular input from the user, at a neuromuscular sensor of the wrist-wearable device;

causing the text to be modified based on the neuromuscular data; and

causing the text to be presented to the user.

14 . The method of claim 13 , the method further comprising:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtaining additional neuromuscular data, based on an additional neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

causing the text to be modified based on the additional neuromuscular data to produce additional modified text; and

causing the additional modified text to be presented to the user.

15 . The method of claim 13 , the method further comprising:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtaining second speech data, based on a second speech input from the user, at the microphone of the head-wearable device;

determining second text based on the second speech data;

obtaining second neuromuscular data, based on a second neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

causing the second text to be modified based on the second neuromuscular data to produce second modified text; and

causing the second modified text to be presented to the user.

16 . The method of claim 13 , the method further comprising:

while the head-wearable device, the wrist-wearable device, and another wrist-wearable device are communicatively coupled and worn by the user:

obtaining other neuromuscular data, based on another neuromuscular input from the user, at a neuromuscular sensor of the other wrist-wearable device;

causing the text to be modified based on the other neuromuscular data to produce other modified text; and

causing the other modified text to be presented to the user, wherein the wrist-wearable device is worn on a first wrist of the user and the other wrist-wearable device is worn on a second wrist of the user.

17 . An extended-reality (XR) system including:

a head-wearable device;

a wrist-wearable device communicatively coupled to the head-wearable device;

one or more processors;

one or more memory devices including medium including executable instructions that, when executed by the one or more processors, cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are worn by a user:

obtain speech data, based on a speech input from the user, at a microphone of the head-wearable device;

determine text based on the speech data;

obtain neuromuscular data, based on a neuromuscular input from the user, at a neuromuscular sensor of the wrist-wearable device;

cause the text to be modified based on the neuromuscular data; and

cause the text to be presented to the user.

18 . The XR system of claim 17 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtain additional neuromuscular data, based on an additional neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

cause the text to be modified based on the additional neuromuscular data to produce additional modified text; and

cause the additional modified text to be presented to the user.

19 . The XR system of claim 17 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device and the wrist-wearable device are communicatively coupled and worn by the user:

obtain second speech data, based on a second speech input from the user, at the microphone of the head-wearable device;

determine second text based on the second speech data;

obtain second neuromuscular data, based on a second neuromuscular input from the user, at the neuromuscular sensor of the wrist-wearable device;

cause the second text to be modified based on the second neuromuscular data to produce second modified text; and

cause the second modified text to be presented to the user.

20 . The XR system of claim 17 , wherein the executable instructions further cause the one or more processors to:

while the head-wearable device, the wrist-wearable device, and another wrist-wearable device are communicatively coupled and worn by the user:

obtain other neuromuscular data, based on another neuromuscular input from the user, at a neuromuscular sensor of the other wrist-wearable device;

cause the text to be modified based on the other neuromuscular data to produce other modified text; and

cause the other modified text to be presented to the user, wherein the wrist-wearable device is worn on a first wrist of the user and the other wrist-wearable device is worn on a second wrist of the user.