Creating a cinematic storytelling experience using network-addressable devices
Systems and methods are provided for creating a cinematic storytelling experience. A user a user selection of a story is received from a client device. User input to initiate verbal recitation of the selected story is received. Correspondence between the verbal recitation and at least one keyword is detected, and the at least one corresponding action is performed.
1. A computer-implemented method comprising:
receiving, via a user interface on a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
obtaining, from a server, (i) information identifying keywords of the selected story and data indicating a location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein at least one action of the identified actions is to play, responsive to the client device detecting at least one keyword of the keywords during a verbal recitation of the selected story, audio content with a sound effect corresponding to the at least one keyword;
receiving user input to initiate verbal recitation of the selected story;
detecting the at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected, based on the information identifying the keywords of the selected story, respective one or more words from the selected story that are being verbally recited and an indication of a location of the respective one or more words within the selected story; and
performing, by a processing device, the at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing the audio content with the sound effect corresponding to the at least one keyword in the selected story.
2. The computer-implemented method of claim 1 , wherein the client device is a voice activated home assistant device.
3. The computer-implemented method of claim 1 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein detecting the at least one keyword further comprises:
sending data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receiving, from the server, correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
4. The computer-implemented method of claim 1 , wherein the detecting comprises using a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
5. The computer-implemented method of claim 1 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from the server in response to the user selection of the story.
6. The computer-implemented method of claim 1 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.
7. The computer-implemented method of claim 1 , wherein the at least one action is performed at a plurality of points in the story, and wherein a sound characteristic of the sound effect provided by the at least one action changes across the plurality of points in the story.
8. A computer system, comprising:
a memory; and
a processing device, coupled to the memory, to:
receive, via a user interface on a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
obtain, from a server, (i) information identifying keywords of the selected story and data indicating a location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein at least one action of the identified actions is to play, responsive to the client device detecting at least one keyword of the keywords during a verbal recitation of the selected story, audio content with a sound effect corresponding to the at least one keyword;
receive user input to initiate verbal recitation of the selected story;
detect the at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected, based on the information identifying the keywords of the selected story, respective one or more words from the selected story that are being verbally recited and an indication of a location of the respective one or more words within the selected story; and
perform the at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing the audio content with the sound effect corresponding to the at least one keyword in the selected story.
9. The system of claim 8 , wherein the client device is a voice activated home assistant device.
10. The system of claim 8 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein to detect the at least one keyword, the processing device is further to:
send data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receive from the server correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
11. The system of claim 8 , wherein to detect the at least one keyword, the processing device is further to:
use a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
12. The system of claim 8 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from the server in response to the user selection of the story.
13. The system of claim 8 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.
14. The system of claim 8 , wherein the at least one action is performed at a plurality of points in the story, and wherein a sound characteristic of the sound effect provided by the at least one action changes across the plurality of points in the story.
15. A non-transitory computer-readable medium storing computer-executable instructions that, in response to execution, cause a processing device to perform operations comprising:
receiving, via a user interface on a client device, a user selection of a story to be recited as a verbal narration of a book with sound effects;
obtaining, from a server, (i) information identifying keywords of the selected story and data indicating a location of each keyword within the selected story, and (ii) information identifying actions associated with the selected story, wherein at least one action of the identified actions is to play, responsive to the client device detecting at least one keyword of the keywords during a verbal recitation of the selected story, audio content with a sound effect corresponding to the at least one keyword;
receiving user input to initiate verbal recitation of the selected story;
detecting the at least one keyword during the verbal recitation of the selected story, wherein each of the at least one keyword is detected, based on the information identifying the keywords of the selected story, respective one or more words from the selected story that are being verbally recited and an indication of a location of the respective one or more words within the selected story; and
performing the at least one action responsive to detecting the at least one keyword during the verbal recitation of the selected story, wherein the at least one action comprises playing the audio content with the sound effect corresponding to the at least one keyword in the selected story.
16. The non-transitory computer-readable medium of claim 15 , wherein the client device is a voice activated home assistant device.
17. The non-transitory computer-readable medium of claim 15 , wherein the information identifying the keywords of the selected story further comprises a total number of words in the selected story, wherein the data indicating the location of each keyword within the selected story is represented by a word count associated with a respective keyword in view of the total number of words, and wherein detecting the at least one keyword further comprises:
sending data defining the verbal recitation of the selected story to the server, the sent data comprising locations of respective verbally recited words within the selected story, wherein each location is represented by a corresponding word count; and
receiving from the server correspondence between the data defining the verbal recitation of the selected story and the at least one keyword.
18. The non-transitory computer-readable medium of claim 15 , wherein the detecting comprises using a matching algorithm to match an audio profile of the at least one keyword with an audio profile of the user input.
19. The non-transitory computer-readable medium of claim 15 , wherein the verbal recitation comprises playback of a recorded narration of the story, the recorded narration received from the server in response to the user selection of the story.
20. The non-transitory computer-readable medium of claim 15 , wherein the verbal recitation is a narration of the selected story by a user of the client device, and wherein the narration of the selected story is received via a microphone of the client device.