Granted Patent B2

US 12,321,666 · App. 18/295,137 · Granted Jun 3, 2025

Inventors: Shiraz Akmal (Playa Vista, CA); Brad K. Herman (Culver City, CA); Garrett L. Weinberg (Santa Cruz, CA); St. John W. Colon (Los Angeles, CA); Viraaj M. Marathe (Los Angeles, CA)

Assignee: Apple Inc.

G06F3/167G10L15/22G10L15/26G10L2015/223G10L2015/225

Abstract

Claims (265)

1. A method comprising:

at a computer system in communication with a display generation component and one or more input devices:

displaying, via the display generation component, a representation of a first user other than a user of the computer system;

while displaying the representation of the first user, detecting, via the one or more input devices, a first input that includes:

attention of the user of the computer system; and

speech input from the user while the attention of the user satisfies one or more first criteria;

in response to detecting the first input, in accordance with a determination that one or more second criteria are satisfied, displaying, via the display generation component, a text representation of the speech input in a message entry region associated with transmitting messages to the first user without providing a representation of the speech input to the first user;

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that a first threshold amount of time has elapsed since detecting the end of the speech input; and

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that one or more third criteria are satisfied, including a first criterion that is satisfied when the attention of the user has been directed to the message entry region for a second threshold amount of time after detecting the end of the speech input, initiating transmission of a message including the text representation of the speech input to the first user.

2. The method of claim 1 , further comprising:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that the one or more third criteria are not satisfied, forgoing initiating transmission of the message including the text representation of the speech input to the first user.

3. The method of claim 1 , wherein the one or more second criteria include a criterion that is satisfied when the user of the computer system has recently received an indication of communication from the first user.

4. The method of claim 1 , wherein the one or more second criteria include a criterion that is satisfied when the speech input from the user of the computer system begins with a first word that corresponds to a name of the first user.

5. The method of claim 1 , wherein the one or more second criteria include a criterion that is satisfied when:

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the speech input from the user begins with a first word that corresponds to a name of the first user; or

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the user of the computer system has recently received an indication of communication from the first user.

6. The method of claim 1 , further comprising:

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that one or more fourth criteria are satisfied, including a criterion that is satisfied when the computer system detects a second speech input from the user after detecting the end of the speech input from the user, wherein the second speech input includes a command corresponding to a request to transmit the message to the first user; and

in response to determining that the one or more fourth criteria are satisfied, initiating transmission of the message including the text representation of the speech input to the first user.

7. The method of claim 6 , wherein the one or more fourth criteria include a second criterion that is satisfied when:

the command corresponding to the request to transmit the message to the first user is provided after a third threshold amount of time has elapsed since detecting the end of the speech input; and/or

a fourth threshold amount of time elapses after detecting an end of the command without detecting additional speech input.

8. The method of claim 1 , wherein the one or more third criteria includes a second criterion that is satisfied when the attention of the user is directed to a predefined portion of the message entry region for a duration of the second threshold amount of time, and is not satisfied if the attention of the user is not directed to the predefined portion of the message entry region for the duration of the second threshold amount of time.

9. The method of claim 1 , further comprising:

prior to detecting the first input, in accordance with a determination that the attention of the user of the computer system is directed to the representation of the first user for a third threshold amount of time, displaying, via the display generation component, the message entry region concurrently with the representation of the first user.

10. The method of claim 9 , wherein:

prior to displaying the message entry region, the representation of the first user is displayed concurrently with a representation of a name of the first user; and

prior to detecting the first input, in accordance with the determination that the attention of the user of the computer system is directed to the representation of the first user for the third threshold amount of time, the message entry region replaces display of the representation of the name of the first user.

11. The method of claim 1 , further comprising while detecting the speech input, updating the message entry region to include sequential portions of the text representation of the speech input as corresponding sequential portions of the speech input are detected.

12. The method of claim 1 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, the method further comprising:

after detecting the end of the speech input, concurrently displaying, via the display generation component, a visual indication of an elapsing of the timer with the text representation of the speech input in the message entry region.

13. The method of claim 1 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, the method further comprising:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, the attention of the user directed away from message entry region; and

in response to detecting the attention of the user directed away from the message entry region:

pausing an elapsing of the timer; and

forgoing initiating transmission of the message to the first user.

14. The method of claim 13 , further comprising:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, the attention of the user directed toward the message entry region;

in response to detecting the attention of the user directed toward the message entry region, resuming the elapsing of the timer; and

after resuming the elapsing of the timer and in response to determining that the elapsing of the timer has reached the second threshold amount of time, initiating transmission of the message to the first user.

15. The method of claim 13 , further comprising:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, a second input that includes:

the attention of the user directed toward the message entry region; and

a speech command corresponding to a request to transmit the message to the first user; and

in response to detecting the second input, initiating transmission of the message to the first user.

16. The method of claim 1 , further comprising:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to forgo initiating transmission of the message to the first user; and

in response to detecting the speech command, forgoing initiating transmission of the message to the first user.

17. The method of claim 1 , further comprising:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to initiate transmission of the message to the first user; and

in response to detecting the speech command, initiating transmission of the message to the first user before the second threshold amount of time has elapsed.

18. The method of claim 1 , wherein the representation of the first user is displayed among a plurality of representations of a plurality of users other than the user of the computer system.

19. The method of claim 18 , wherein displaying a respective representation of a respective user of the plurality of representations of the plurality of users includes:

in accordance with a determination that the user has an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user with a visual indication indicating that the user has the unread message from the respective user; and

in accordance with a determination that the user does not have an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user without the visual indication.

20. The method of claim 19 , further comprising:

while displaying the respective representation of the respective user with the visual indication, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, replacing display of the visual indication with a representation of the unread message received from the respective user.

21. The method of claim 18 , wherein the user has an unread message from a respective user of the plurality of users, the method further comprising:

while displaying the plurality of representations of the plurality of users including a respective representation of the respective user, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, presenting the unread message received from the respective user.

22. The method of claim 21 , wherein presenting the unread message received from the respective user includes outputting audio corresponding to the unread message received from the respective user.

23. The method of claim 21 , wherein presenting the unread message received from the respective user includes displaying, via the display generation component, a text representation corresponding to the unread message received from the respective user.

24. The method of claim 18 , further comprising:

while displaying the plurality of representations of the plurality of users including the representation of the first user, receiving, via the one or more input devices, a second input corresponding to selection of a respective representation of a respective user of the plurality of representations of the plurality of users; and

in response to receiving the second input, initiating a process to participate in live-communication with the respective user.

25. The method of claim 18 , further comprising:

while displaying the plurality of representations of the plurality of users including a respective representation of a respective user, detecting, via the one or more input devices, a second input corresponding to a request to transmit a first message to the respective user, wherein the second input includes:

first speech input from the user directed to the respective representation of the respective user, wherein no previous messages have been recently transmitted to the respective user; and

in response to detecting the second input:

in accordance with a determination that the first speech input from the user begins with a first word corresponding to a name of the respective user, initiating transmission of the first message to the respective user; and

in accordance with a determination that the first speech input from the user does not begin with the first word corresponding to the name of the respective user, forgoing initiating transmission of the first message to the respective user.

26. The method of claim 25 , further comprising:

after initiating transmission of the first message to the respective user because the first speech input begins with the first word corresponding to the name of the respective user, detecting, via the one or more input devices, a third input corresponding to a request to initiate transmission of a second message and that includes second speech input from the user;

in response to detecting the second input:

in accordance with a determination that the user has not designated a user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the respective user; and

in accordance with a determination that the user has designated the user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the user other than the respective user.

27. The method of claim 1 , further comprising:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with the determination that the one or more third criteria are satisfied, presenting audio feedback indicating that the message has been sent to the first user.

28. The method of claim 1 , wherein the attention of the user satisfies the one or more first criteria when the attention of the user is directed toward the message entry region.

29. The method of claim 28 , further comprising:

while detecting the speech input, detecting, via the one or more input devices, the attention of the user directed away from the message entry region; and

in response to detecting the attention of the user directed away from the message entry region, forgoing display, in the message entry region, of additional text representation of one or more portions the speech input detected after detecting the attention of the user directed away from the message entry region.

30. A computer system that is in communication with a display generation component and one or more input devices, the computer system comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, a representation of a first user other than a user of the computer system;

while displaying the representation of the first user, detecting, via the one or more input devices, a first input that includes:

attention of the user of the computer system; and

speech input from the user while the attention of the user satisfies one or more first criteria;

in response to detecting the first input, in accordance with a determination that one or more second criteria are satisfied, displaying, via the display generation component, a text representation of the speech input in a message entry region associated with transmitting messages to the first user without providing a representation of the speech input to the first user;

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that a first threshold amount of time has elapsed since detecting the end of the speech input; and

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that one or more third criteria are satisfied, including a first criterion that is satisfied when the attention of the user has been directed to the message entry region for a second threshold amount of time after detecting the end of the speech input, initiating transmission of a message including the text representation of the speech input to the first user.

31. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices, cause the computer system to perform a method comprising:

displaying, via the display generation component, a representation of a first user other than a user of the computer system;

while displaying the representation of the first user, detecting, via the one or more input devices, a first input that includes:

attention of the user of the computer system; and

speech input from the user while the attention of the user satisfies one or more first criteria;

in response to detecting the first input, in accordance with a determination that one or more second criteria are satisfied, displaying, via the display generation component, a text representation of the speech input in a message entry region associated with transmitting messages to the first user without providing a representation of the speech input to the first user;

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that a first threshold amount of time has elapsed since detecting the end of the speech input; and

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that one or more third criteria are satisfied, including a first criterion that is satisfied when the attention of the user has been directed to the message entry region for a second threshold amount of time after detecting the end of the speech input, initiating transmission of a message including the text representation of the speech input to the first user.

32. The computer system of claim 30 , wherein the one or more programs further include instructions for:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that the one or more third criteria are not satisfied, forgoing initiating transmission of the message including the text representation of the speech input to the first user.

33. The computer system of claim 30 , wherein the one or more second criteria include a criterion that is satisfied when the user of the computer system has recently received an indication of communication from the first user.

34. The computer system of claim 30 , wherein the one or more second criteria include a criterion that is satisfied when the speech input from the user of the computer system begins with a first word that corresponds to a name of the first user.

35. The computer system of claim 30 , wherein the one or more second criteria include a criterion that is satisfied when:

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the speech input from the user begins with a first word that corresponds to a name of the first user; or

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the user of the computer system has recently received an indication of communication from the first user.

36. The computer system of claim 30 , wherein the one or more programs further include instructions for:

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that one or more fourth criteria are satisfied, including a criterion that is satisfied when the computer system detects a second speech input from the user after detecting the end of the speech input from the user, wherein the second speech input includes a command corresponding to a request to transmit the message to the first user; and

in response to determining that the one or more fourth criteria are satisfied, initiating transmission of the message including the text representation of the speech input to the first user.

37. The computer system of claim 36 , wherein the one or more fourth criteria include a second criterion that is satisfied when:

the command corresponding to the request to transmit the message to the first user is provided after a third threshold amount of time has elapsed since detecting the end of the speech input; and/or

a fourth threshold amount of time elapses after detecting an end of the command without detecting additional speech input.

38. The computer system of claim 30 , wherein the one or more third criteria includes a second criterion that is satisfied when the attention of the user is directed to a predefined portion of the message entry region for a duration of the second threshold amount of time, and is not satisfied if the attention of the user is not directed to the predefined portion of the message entry region for the duration of the second threshold amount of time.

39. The computer system of claim 30 , wherein the one or more programs further include instructions for:

prior to detecting the first input, in accordance with a determination that the attention of the user of the computer system is directed to the representation of the first user for a third threshold amount of time, displaying, via the display generation component, the message entry region concurrently with the representation of the first user.

40. The computer system of claim 39 , wherein:

prior to displaying the message entry region, the representation of the first user is displayed concurrently with a representation of a name of the first user; and

prior to detecting the first input, in accordance with the determination that the attention of the user of the computer system is directed to the representation of the first user for the third threshold amount of time, the message entry region replaces display of the representation of the name of the first user.

41. The computer system of claim 30 , wherein the one or more programs further include instructions for, while detecting the speech input, updating the message entry region to include sequential portions of the text representation of the speech input as corresponding sequential portions of the speech input are detected.

42. The computer system of claim 30 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, and wherein the one or more programs further include instructions for:

after detecting the end of the speech input, concurrently displaying, via the display generation component, a visual indication of an elapsing of the timer with the text representation of the speech input in the message entry region.

43. The computer system of claim 30 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, and wherein the one or more programs further include instructions for:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, the attention of the user directed away from message entry region; and

in response to detecting the attention of the user directed away from the message entry region:

pausing an elapsing of the timer; and

forgoing initiating transmission of the message to the first user.

44. The computer system of claim 43 , wherein the one or more programs further include instructions for:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, the attention of the user directed toward the message entry region;

in response to detecting the attention of the user directed toward the message entry region, resuming the elapsing of the timer; and

after resuming the elapsing of the timer and in response to determining that the elapsing of the timer has reached the second threshold amount of time, initiating transmission of the message to the first user.

45. The computer system of claim 43 , wherein the one or more programs further include instructions for:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, a second input that includes:

the attention of the user directed toward the message entry region; and

a speech command corresponding to a request to transmit the message to the first user; and

in response to detecting the second input, initiating transmission of the message to the first user.

46. The computer system of claim 30 , wherein the one or more programs further include instructions for:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to forgo initiating transmission of the message to the first user; and

in response to detecting the speech command, forgoing initiating transmission of the message to the first user.

47. The computer system of claim 30 , wherein the one or more programs further include instructions for:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to initiate transmission of the message to the first user; and

in response to detecting the speech command, initiating transmission of the message to the first user before the second threshold amount of time has elapsed.

48. The computer system of claim 30 , wherein the representation of the first user is displayed among a plurality of representations of a plurality of users other than the user of the computer system.

49. The computer system of claim 48 , wherein displaying a respective representation of a respective user of the plurality of representations of the plurality of users includes:

in accordance with a determination that the user has an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user with a visual indication indicating that the user has the unread message from the respective user; and

in accordance with a determination that the user does not have an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user without the visual indication.

50. The computer system of claim 49 , wherein the one or more programs further include instructions for:

while displaying the respective representation of the respective user with the visual indication, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, replacing display of the visual indication with a representation of the unread message received from the respective user.

51. The computer system of claim 48 , wherein the user has an unread message from a respective user of the plurality of users, and wherein the one or more programs further include instructions for:

while displaying the plurality of representations of the plurality of users including a respective representation of the respective user, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, presenting the unread message received from the respective user.

52. The computer system of claim 51 , wherein presenting the unread message received from the respective user includes outputting audio corresponding to the unread message received from the respective user.

53. The computer system of claim 51 , wherein presenting the unread message received from the respective user includes displaying, via the display generation component, a text representation corresponding to the unread message received from the respective user.

54. The computer system of claim 48 , wherein the one or more programs further include instructions for:

while displaying the plurality of representations of the plurality of users including the representation of the first user, receiving, via the one or more input devices, a second input corresponding to selection of a respective representation of a respective user of the plurality of representations of the plurality of users; and

in response to receiving the second input, initiating a process to participate in live-communication with the respective user.

55. The computer system of claim 48 , wherein the one or more programs further include instructions for:

while displaying the plurality of representations of the plurality of users including a respective representation of a respective user, detecting, via the one or more input devices, a second input corresponding to a request to transmit a first message to the respective user, wherein the second input includes:

first speech input from the user directed to the respective representation of the respective user, wherein no previous messages have been recently transmitted to the respective user; and

in response to detecting the second input:

in accordance with a determination that the first speech input from the user begins with a first word corresponding to a name of the respective user, initiating transmission of the first message to the respective user; and

in accordance with a determination that the first speech input from the user does not begin with the first word corresponding to the name of the respective user, forgoing initiating transmission of the first message to the respective user.

56. The computer system of claim 55 , wherein the one or more programs further include instructions for:

after initiating transmission of the first message to the respective user because the first speech input begins with the first word corresponding to the name of the respective user, detecting, via the one or more input devices, a third input corresponding to a request to initiate transmission of a second message and that includes second speech input from the user;

in response to detecting the second input:

in accordance with a determination that the user has not designated a user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the respective user; and

in accordance with a determination that the user has designated the user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the user other than the respective user.

57. The computer system of claim 30 , wherein the one or more programs further include instructions for:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with the determination that the one or more third criteria are satisfied, presenting audio feedback indicating that the message has been sent to the first user.

58. The computer system of claim 30 , wherein the attention of the user satisfies the one or more first criteria when the attention of the user is directed toward the message entry region.

59. The computer system of claim 58 , wherein the one or more programs further include instructions for:

while detecting the speech input, detecting, via the one or more input devices, the attention of the user directed away from the message entry region; and

in response to detecting the attention of the user directed away from the message entry region, forgoing display, in the message entry region, of additional text representation of one or more portions the speech input detected after detecting the attention of the user directed away from the message entry region.

60. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with a determination that the one or more third criteria are not satisfied, forgoing initiating transmission of the message including the text representation of the speech input to the first user.

61. The non-transitory computer readable storage medium of claim 31 , wherein the one or more second criteria include a criterion that is satisfied when the user of the computer system has recently received an indication of communication from the first user.

62. The non-transitory computer readable storage medium of claim 31 , wherein the one or more second criteria include a criterion that is satisfied when the speech input from the user of the computer system begins with a first word that corresponds to a name of the first user.

63. The non-transitory computer readable storage medium of claim 31 , wherein the one or more second criteria include a criterion that is satisfied when:

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the speech input from the user begins with a first word that corresponds to a name of the first user; or

the attention of the user is directed to the representation of the first user when the speech input from the user is received and the user of the computer system has recently received an indication of communication from the first user.

64. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

while displaying the text representation of the speech input in the message entry region and after detecting an end of the speech input, determining that one or more fourth criteria are satisfied, including a criterion that is satisfied when the computer system detects a second speech input from the user after detecting the end of the speech input from the user, wherein the second speech input includes a command corresponding to a request to transmit the message to the first user; and

in response to determining that the one or more fourth criteria are satisfied, initiating transmission of the message including the text representation of the speech input to the first user.

65. The non-transitory computer readable storage medium of claim 64 , wherein the one or more fourth criteria include a second criterion that is satisfied when:

the command corresponding to the request to transmit the message to the first user is provided after a third threshold amount of time has elapsed since detecting the end of the speech input; and/or

a fourth threshold amount of time elapses after detecting an end of the command without detecting additional speech input.

66. The non-transitory computer readable storage medium of claim 31 , wherein the one or more third criteria includes a second criterion that is satisfied when the attention of the user is directed to a predefined portion of the message entry region for a duration of the second threshold amount of time, and is not satisfied if the attention of the user is not directed to the predefined portion of the message entry region for the duration of the second threshold amount of time.

67. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

prior to detecting the first input, in accordance with a determination that the attention of the user of the computer system is directed to the representation of the first user for a third threshold amount of time, displaying, via the display generation component, the message entry region concurrently with the representation of the first user.

68. The non-transitory computer readable storage medium of claim 67 , wherein:

prior to displaying the message entry region, the representation of the first user is displayed concurrently with a representation of a name of the first user; and

prior to detecting the first input, in accordance with the determination that the attention of the user of the computer system is directed to the representation of the first user for the third threshold amount of time, the message entry region replaces display of the representation of the name of the first user.

69. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises while detecting the speech input, updating the message entry region to include sequential portions of the text representation of the speech input as corresponding sequential portions of the speech input are detected.

70. The non-transitory computer readable storage medium of claim 31 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, the method further comprising:

after detecting the end of the speech input, concurrently displaying, via the display generation component, a visual indication of an elapsing of the timer with the text representation of the speech input in the message entry region.

71. The non-transitory computer readable storage medium of claim 31 , wherein the second threshold amount of time during which the attention of the user is directed to the message entry region is associated with a timer for initiating transmission of the message to the first user, the method further comprising:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, the attention of the user directed away from message entry region; and

in response to detecting the attention of the user directed away from the message entry region:

pausing an elapsing of the timer; and

forgoing initiating transmission of the message to the first user.

72. The non-transitory computer readable storage medium of claim 71 , wherein the method further comprises:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, the attention of the user directed toward the message entry region;

in response to detecting the attention of the user directed toward the message entry region, resuming the elapsing of the timer; and

after resuming the elapsing of the timer and in response to determining that the elapsing of the timer has reached the second threshold amount of time, initiating transmission of the message to the first user.

73. The non-transitory computer readable storage medium of claim 71 , wherein the method further comprises:

after detecting the attention of the user directed away from the message entry region, detecting, via the one or more input devices, a second input that includes:

the attention of the user directed toward the message entry region; and

a speech command corresponding to a request to transmit the message to the first user; and

in response to detecting the second input, initiating transmission of the message to the first user.

74. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to forgo initiating transmission of the message to the first user; and

in response to detecting the speech command, forgoing initiating transmission of the message to the first user.

75. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

after detecting the end of the speech input and before the second threshold amount of time has elapsed during which the attention of the user is directed to the message entry region, detecting, via the one or more input devices, a speech command corresponding to a request to initiate transmission of the message to the first user; and

in response to detecting the speech command, initiating transmission of the message to the first user before the second threshold amount of time has elapsed.

76. The non-transitory computer readable storage medium of claim 31 , wherein the representation of the first user is displayed among a plurality of representations of a plurality of users other than the user of the computer system.

77. The non-transitory computer readable storage medium of claim 76 , wherein displaying a respective representation of a respective user of the plurality of representations of the plurality of users includes:

in accordance with a determination that the user has an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user with a visual indication indicating that the user has the unread message from the respective user; and

in accordance with a determination that the user does not have an unread message from the respective user, displaying, via the display generation component, the respective representation of the respective user without the visual indication.

78. The non-transitory computer readable storage medium of claim 77 , wherein the method further comprises:

while displaying the respective representation of the respective user with the visual indication, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, replacing display of the visual indication with a representation of the unread message received from the respective user.

79. The non-transitory computer readable storage medium of claim 76 , wherein the user has an unread message from a respective user of the plurality of users, the method further comprising:

while displaying the plurality of representations of the plurality of users including a respective representation of the respective user, detecting, via the one or more input devices, the attention of the user directed toward the respective representation of the respective user; and

in response to detecting the attention of the user directed toward the respective representation of the respective user, presenting the unread message received from the respective user.

80. The non-transitory computer readable storage medium of claim 79 , wherein presenting the unread message received from the respective user includes outputting audio corresponding to the unread message received from the respective user.

81. The non-transitory computer readable storage medium of claim 79 , wherein presenting the unread message received from the respective user includes displaying, via the display generation component, a text representation corresponding to the unread message received from the respective user.

82. The non-transitory computer readable storage medium of claim 76 , wherein the method further comprises:

while displaying the plurality of representations of the plurality of users including the representation of the first user, receiving, via the one or more input devices, a second input corresponding to selection of a respective representation of a respective user of the plurality of representations of the plurality of users; and

in response to receiving the second input, initiating a process to participate in live-communication with the respective user.

83. The non-transitory computer readable storage medium of claim 76 , wherein the method further comprises:

while displaying the plurality of representations of the plurality of users including a respective representation of a respective user, detecting, via the one or more input devices, a second input corresponding to a request to transmit a first message to the respective user, wherein the second input includes:

first speech input from the user directed to the respective representation of the respective user, wherein no previous messages have been recently transmitted to the respective user; and

in response to detecting the second input:

in accordance with a determination that the first speech input from the user begins with a first word corresponding to a name of the respective user, initiating transmission of the first message to the respective user; and

in accordance with a determination that the first speech input from the user does not begin with the first word corresponding to the name of the respective user, forgoing initiating transmission of the first message to the respective user.

84. The non-transitory computer readable storage medium of claim 83 , wherein the method further comprises:

after initiating transmission of the first message to the respective user because the first speech input begins with the first word corresponding to the name of the respective user, detecting, via the one or more input devices, a third input corresponding to a request to initiate transmission of a second message and that includes second speech input from the user;

in response to detecting the second input:

in accordance with a determination that the user has not designated a user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the respective user; and

in accordance with a determination that the user has designated the user other than the respective user to receive messages after initiating transmission of the first message to the respective user:

initiating transmission of the second message to the user other than the respective user.

85. The non-transitory computer readable storage medium of claim 31 , wherein the method further comprises:

in response to determining that the first threshold amount of time has elapsed since detecting the end of the speech input:

in accordance with the determination that the one or more third criteria are satisfied, presenting audio feedback indicating that the message has been sent to the first user.

86. The non-transitory computer readable storage medium of claim 31 , wherein the attention of the user satisfies the one or more first criteria when the attention of the user is directed toward the message entry region.

87. The non-transitory computer readable storage medium of claim 86 , wherein the method further comprises:

while detecting the speech input, detecting, via the one or more input devices, the attention of the user directed away from the message entry region; and

in response to detecting the attention of the user directed away from the message entry region, forgoing display, in the message entry region, of additional text representation of one or more portions the speech input detected after detecting the attention of the user directed away from the message entry region.

Assignments (1)

Continuity (2)

References Cited (400)