Creating a cinematic storytelling experience using network-addressable devices
Systems and methods are provided for creating a cinematic storytelling experience. A user selection of a story is received from a client device. User input to initiate verbal recitation of the selected story is received. Correspondence between the verbal recitation and at least one keyword is detected, and the at least one corresponding action is performed.
1. A computer-implemented method comprising:
receiving, via a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
receiving user input to initiate verbal recitation of the selected story;
detecting at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected based on information identifying keywords of the selected story, data indicating a location of each keyword within the selected story, respective one or more words from the selected story that are being verbally recited, and an indication of a location of the respective one or more words within the selected story; and
performing, by a processing device, at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing audio content with a sound effect corresponding to the at least one keyword in the selected story.
2. The computer-implemented method of claim 1 , wherein the client device is a voice activated home assistant device.
3. The computer-implemented method of claim 1 , further comprising obtaining, from a server, (i) the information identifying the keywords of the selected story and the data indicating the location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein the actions comprise the at least one action.
4. The computer-implemented method of claim 3 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein detecting the at least one keyword further comprises:
sending data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receiving, from the server, correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
5. The computer-implemented method of claim 1 , wherein the detecting comprises using a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
6. The computer-implemented method of claim 1 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from the server in response to the user selection of the story.
7. The computer-implemented method of claim 1 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.
8. The computer-implemented method of claim 1 , wherein the at least one action is performed at a plurality of points in the story, and wherein a sound characteristic of the sound effect provided by the at least one action changes across the plurality of points in the story.
9. A computer system, comprising: a memory; and
a processing device, coupled to the memory, to perform operations comprising:
receiving, via a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
receiving user input to initiate verbal recitation of the selected story;
detecting at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected based on information identifying keywords of the selected story, data indicating a location of each keyword within the selected story, respective one or more words from the selected story that are being verbally recited, and an indication of a location of the respective one or more words within the selected story; and
performing, by a processing device, at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing audio content with a sound effect corresponding to the at least one keyword in the selected story.
10. The system of claim 9 , wherein the client device is a voice activated home assistant device.
11. The system of claim 9 , the operations further comprising obtaining, from a server, (i) the information identifying the keywords of the selected story and the data indicating the location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein the actions comprise the at least one action.
12. The system of claim 11 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein detecting the at least one keyword further comprises:
sending data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receiving from the server correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
13. The system of claim 9 , wherein detecting the at least one keyword comprises:
using a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
14. The system of claim 9 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from the server in response to the user selection of the story.
15. The system of claim 9 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.
16. The system of claim 9 , wherein the at least one action is performed at a plurality of points in the story, and wherein a sound characteristic of the sound effect provided by the at least one action changes across the plurality of points in the story.
17. A non-transitory computer-readable medium storing computer-executable instructions that, in response to execution, cause a processing device to perform operations comprising:
receiving, via a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
receiving user input to initiate verbal recitation of the selected story;
detecting at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected based on information identifying keywords of the selected story, data indicating a location of each keyword within the selected story, respective one or more words from the selected story that are being verbally recited, and an indication of a location of the respective one or more words within the selected story; and
performing, by a processing device, at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing audio content with a sound effect corresponding to the at least one keyword in the selected story.
18. The non-transitory computer-readable medium of claim 17 , wherein the client device is a voice activated home assistant device.
19. The non-transitory computer-readable medium of claim 17 , the operations further comprising obtaining, from a server, (i) the information identifying the keywords of the selected story and the data indicating the location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein the actions comprises the at least one action.
20. The non-transitory computer-readable medium of claim 19 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein detecting the at least one keyword further comprises:
sending data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receiving from the server correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
21. The non-transitory computer-readable medium of claim 17 , wherein the detecting comprises using a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
22. The non-transitory computer-readable medium of claim 17 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from a server in response to the user selection of the story.
23. The non-transitory computer-readable medium of claim 17 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.