Digital assistant for providing and modifying an output of an electronic document
Systems and processes for providing and modifying an output of an electronic document using a digital assistant of an electronic device are provided. An example method includes, receiving, at a first electronic device, a user input requesting an audible output of an electronic document including text; and in accordance with a determination to provide the audible output of the electronic document: generating a media item based on the text of the electronic document; after generating the media item, outputting, based on a semantic structure of the electronic document, the media item; while outputting the media item, receiving a second user input; and in accordance with a determination that the second user input is associated with an intent to modify the output: modifying, based on the second user input and the semantic structure of the electronic document, the output of the media item.
1. A first electronic device, comprising:
a display;
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors,
the one or more programs including instructions for:
receiving, at the first electronic device, a user input requesting an audible output of an electronic document including text, wherein the user input is the first audio input;
invoking a digital assistant;
determining, based on the digital assistant, to provide the audible output of the electronic document;
in accordance with a determination to provide the audible output of the electronic document:
generating a media item based on the text of the electronic document; and
after generating the media item, audibly outputting the media item, wherein the audible output of the media item is based on a semantic structure of the electronic document;
while audibly outputting the media item, displaying the electronic document and a graphical representation of the media item concurrently;
receiving a second user input, wherein the second user input is an audio input;
in accordance with a determination that the second user input is associated with an intent to modify the audible output of the media item:
modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item;
while audibly outputting the media item, receiving a user input corresponding to a request to cease display of the electronic document; and
in response to receiving the user input corresponding to the request to cease display of the electronic document:
ceasing to display the electronic document while continuing to audibly output the media item; and
continuing to display the graphical representation of the media item.
2. The first electronic device of claim 1 , wherein the semantic structure of the electronic document includes a length of at least one currently outputting semantic object in the electronic document.
3. The first electronic device of claim 1 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item further includes outputting based on a type of semantic object currently being outputted.
4. The first electronic device of claim 1 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes determining that a length of a currently outputting semantic object is greater than a threshold.
5. The first electronic device of claim 4 , wherein the one or more programs further include instructions for:
in accordance with the determination that the length of the currently outputting semantic object is greater than the threshold:
extending a pause after the currently outputting semantic object.
6. The first electronic device of claim 1 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes visually indicating each semantic object that is outputted.
7. The first electronic device of claim 6 , wherein visually indicating each semantic object comprises highlighting all outputted semantic objects.
8. The first electronic device of claim 1 , wherein the electronic document is an article saved on a user's reading list.
9. The first electronic device of claim 1 , wherein the electronic document is displayed on a browser.
10. The first electronic device of claim 1 , wherein the one or more programs further include instructions for:
determining whether the electronic document is readable;
in accordance with a determination that the electronic document is not readable, providing a response indicating the electronic document is not readable; and
in accordance with a determination that the electronic document is readable, determining to provide an output of the electronic document.
11. The first electronic device of claim 1 , wherein the one or more programs further include instructions for:
while audibly outputting the media item, receiving a fourth input associated with an intent to open an application; and
in accordance with a determination that the fourth input is associated with the intent to open the application: opening, while continuing to audibly output the media item, the application.
12. The first electronic device of claim 1 , wherein the audible output of the media item is performed via streaming the electronic document to the media item.
13. The first electronic device of claim 12 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a pitch of the output.
14. The first electronic device of claim 12 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a volume of the output.
15. The first electronic device of claim 12 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a speed of the output.
16. The first electronic device of claim 12 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes recommencing the audible output at a location in the electronic document.
17. The first electronic device of claim 10 , wherein determining whether the electronic document is readable is based on whether the electronic document is compatible with a reader mode of an application.
18. The first electronic device of claim 1 , wherein the user input corresponding to the request to cease display of the electronic document includes a third audio input.
19. The first electronic device of claim 1 , wherein the user input corresponding to the request to cease display of the electronic document includes a gesture input.
20. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device with a display, cause the first electronic device to:
receive, at the first electronic device, a user input requesting an audible output of an electronic document including text, wherein the user input is a first audio input; invoke a digital assistant;
determine, based on the digital assistant, to provide the audible output of the electronic document;
in accordance with a determination to provide the audible output of the electronic document: generate a media item based on the text of the electronic document;
after generating the media item, audibly output the media item, wherein the audible output of the media item is based on a semantic structure of the electronic document;
while audibly outputting the media item, display the electronic document and a graphical representation of the media item concurrently;
receive a second user input, wherein the second user input is a second audio input;
in accordance with a determination that the second user input is associated with an intent to modify the audible output of the media item:
modify, based on the second user input and the semantic structure of the electronic document, the output of the media item;
while audibly outputting the media item, receive a user input corresponding to a request to cease display of the electronic document; and
in response to receiving the user input corresponding to the request to cease display of the electronic document:
cease to display the electronic document while continuing to audibly output the media item; and
continue to display the graphical representation of the media item.
21. The non-transitory computer-readable storage medium of claim 20 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item further includes outputting based on a type of semantic object currently being outputted.
22. The non-transitory computer-readable storage medium of claim 20 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes determining that a length of a currently outputting semantic object is greater than a threshold.
23. The non-transitory computer-readable storage medium of claim 22 , wherein the one or more programs further comprising instructions, which when executed by the one or more processors of the first electronic device, cause the first electronic device to:
in accordance with the determination that the length of the currently outputting semantic object is greater than the threshold:
extend a pause after the currently outputting semantic object.
24. The non-transitory computer-readable storage medium of claim 20 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes visually indicating each semantic object that is outputted.
25. The non-transitory computer-readable storage medium of claim 24 , wherein visually indicating each semantic object comprises highlighting all outputted semantic objects.
26. The non-transitory computer-readable storage medium of claim 20 , wherein the electronic document is an article saved on a user's reading list.
27. The non-transitory computer-readable storage medium of claim 20 , wherein the one or more programs further comprise instructions, which when executed by the one or more programs, cause the first electronic device to:
determine whether the electronic document is readable;
in accordance with a determination that the electronic document is not readable, provide a response indicating the electronic document is not readable; and
in accordance with a determination that the electronic document is readable, determine to provide an output of the electronic document.
28. The non-transitory computer-readable storage medium of claim 27 , wherein determining whether the electronic document is readable is based on whether the electronic document is compatible with a reader mode of an application.
29. The non-transitory computer-readable storage medium of claim 20 , wherein the one or more programs further comprise instructions, which when executed by the one or more programs, cause the first electronic device to:
while audibly outputting the media item, receive a fourth input associated with an intent to open an application; and
in accordance with a determination that the fourth input is associated with the intent to open the application:
open, while continuing to audibly output the media item, the application.
30. The non-transitory computer-readable storage medium of claim 20 , wherein the audible output of the media item is performed via streaming the electronic document to the media item.
31. The non-transitory computer-readable storage medium of claim 30 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a pitch of the output.
32. The non-transitory computer-readable storage medium of claim 30 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a volume of the output.
33. The non-transitory computer-readable storage medium of claim 30 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a speed of the output.
34. The non-transitory computer-readable storage medium of claim 30 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes recommencing the audible output at a location in the electronic document.
35. A method, comprising:
at a first electronic device with a display, one or more processors, and memory:
receiving, at the first electronic device, a user input requesting an audible output of an electronic document including text, wherein the user input is a first audio input;
invoking a digital assistant;
determining, based on the digital assistant, to provide the audible output of the electronic document;
in accordance with a determination to provide the audible output of the electronic document: generating a media item based on the text of the electronic document; and
after generating the media item, audibly outputting the media item, wherein the audible output of the media item is based on a semantic structure of the electronic document;
while audibly outputting the media item, displaying the electronic document and a graphical representation of the media item concurrently;
receiving a second user input, wherein the second user input is a second audio input;
in accordance with a determination that the second user input is associated with an intent to modify the audible output of the media item: modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item;
while audibly outputting the media item, receiving a user input corresponding to a request to cease display of the electronic document; and
in response to receiving the user input corresponding to the request to cease display of the electronic document:
ceasing to display the electronic document while continuing to audibly output the media item; and
continuing to display the graphical representation of the media item.
36. The method of claim 35 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item further includes outputting based on a type of semantic object currently being outputted.
37. The method of claim 35 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes determining that a length of a currently outputting semantic object is greater than a threshold.
38. The method of claim 37 , further comprising:
in accordance with the determination that the length of the currently outputting semantic object is greater than the threshold:
extending a pause after the currently outputting semantic object.
39. The method of claim 35 , wherein audibly outputting, based on the semantic structure of the electronic document, the media item includes visually indicating each semantic object that is outputted.
40. The method of claim 39 , wherein visually indicating each semantic object comprises highlighting all outputted semantic objects.
41. The method of claim 35 , wherein the electronic document is an article saved on a user's reading list.
42. The method of claim 35 , further comprising:
determining whether the electronic document is readable;
in accordance with a determination that the electronic document is not readable, providing a response indicating the electronic document is not readable; and
in accordance with a determination that the electronic document is readable, determining to provide an output of the electronic document.
43. The method of claim 42 , wherein determining whether the electronic document is readable is based on whether the electronic document is compatible with a reader mode of an application.
44. The method of claim 35 , further comprising:
while audibly outputting the media item, receiving a fourth input associated with an intent to open an application; and
in accordance with a determination that the fourth input is associated with the intent to open the application:
opening, while continuing to audibly output the media item, the application.
45. The method of claim 35 , wherein the audible output of the media item is performed via streaming the electronic document to the media item.
46. The method of claim 45 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a pitch of the output.
47. The method of claim 45 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a volume of the output.
48. The method of claim 45 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes modifying a speed of the output.
49. The method of claim 45 , wherein modifying, based on the second user input and the semantic structure of the electronic document, the audible output of the media item includes recommencing the audible output at a location in the electronic document.