IP Library Granted Patent US 10,135,950
Granted Patent B2
US 10,135,950 · App. 15/289,806 · Granted Nov 20, 2018

Creating a cinematic storytelling experience using network-addressable devices

Inventors: Alexander Rothera (Chicago, IL); Scott D. Lange (Birmingham, MI); Jennifer Drop (Brooklyn, NY)
Assignee: Google LLC
H04L67/42H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,135,950
App. No.
15/289,806
Granted
Nov 20, 2018
Kind
B2
Abstract

Systems and methods are provided for creating a cinematic storytelling experience using network-addressable technologies. A user sends a request through a client application to retrieve a story from a story database on a server facility. The client device downloads from the server facility the story, a corresponding lexicon, and a set of coordination instructions. Responsive to the user beginning narration of the selected story, a client or a server application detects and interprets the user input and compares the input to a limited set of keywords contained in the lexicon and associated with a specific coordination instruction. When the application detects recitation of a keyword associated with a coordination instruction, the application directs the corresponding network-addressable device to carry out the instruction.

Claims (54)

1. A computer-implemented method comprising:

sending, from a client device to a server, a user selection of a story;

receiving, from the server, a lexicon associated with the selected story, the lexicon comprising a limited number of keywords;

receiving coordination instructions associated with the selected story, the coordination instructions including instructions for the client device to instruct one or more network-addressable devices to perform at least one action responsive to the client device detecting a keyword;

receiving user input, the user input including verbal recitation of the selected story;

detecting correspondence between the user input and at least one of the keywords; and

directing the one or more network-addressable devices to perform the at least one action responsive to the coordination instructions for the at least one keyword.

2. The computer-implemented method of claim 1 , wherein the detecting is performed by the client device.

3. The computer-implemented method of claim 1 , wherein detecting correspondence between the user input and at least one of the keywords further comprises:

sending the received user input to the server; and

receiving from the server the correspondence between the user input and at least one of the keywords.

4. The computer-implemented method of claim 1 , wherein the detecting comprises using a matching algorithm to match the audio profile of the at least one keyword with the audio profile of the user input.

5. The computer-implemented method of claim 1 , wherein the verbal recitation comprises playback of a recorded narration of the story.

6. The computer-implemented method of claim 1 , further comprising:

detecting network-addressable devices within a specified radius of the client device;

responsive to detecting the one or more network-addressable devices within the specified radius, directing the one or more network-addressable devices to perform the at least one action; and

responsive to failing to detect the one or more network-addressable devices within the specified radius, skipping the at least one action.

7. The computer-implemented method of claim 1 , wherein the coordination instructions for the at least one keyword contain an instruction to perform the at least one action at a plurality of points in the story.

8. A computer system, comprising:

a computer-readable storage medium comprising executable program code for generating an integrated storytelling experience using network-addressable devices, the computer program code:

sending, from a client device to a server, a user selection of a story;

receiving, from the server, a lexicon associated with the selected story, the lexicon comprising a limited number of keywords;

receiving coordination instructions associated with the selected story, the coordination instructions including instructions for the client device to instruct one or more network-addressable devices to perform at least one action responsive to the client device detecting a keyword;

receiving user input, the user input including verbal recitation of the selected story;

detecting correspondence between the user input and at least one of the keywords; and

directing the one or more network-addressable devices to perform the at least one action responsive to the coordination instructions for the at least one keyword.

9. The system of claim 8 , wherein the detecting is performed by the client device.

10. The system of claim 8 , wherein detecting correspondence between the user input and at least one of the keywords further comprises:

sending the received user input to the server; and

receiving from the server the correspondence between the user input and at least one of the keywords.

11. The system of claim 8 , wherein the detecting comprises using a matching algorithm to match the audio profile of the at least one keyword with the audio profile of the user input.

12. The system of claim 8 , wherein the verbal recitation comprises playback of a recorded narration of the story.

13. The system of claim 8 , further comprising computer program code for:

detecting network-addressable devices within a specified radius of the client device;

responsive to detecting the one or more network-addressable devices within the specified radius, directing the one or more network-addressable devices to perform the at least one action; and

responsive to failing to detect the one or more network-addressable devices within the specified radius, skipping the at least one action.

14. The system of claim 8 , wherein the coordination instructions for the at least one keyword contain an instruction to perform the at least one action at a plurality of points in the story.

15. A non-transitory computer-readable medium storing computer-executable instructions that, in response to execution, cause a device comprising a processor to perform operations, comprising:

sending, from a client device to a server, a user selection of a story;

receiving, from the server, a lexicon associated with the selected story, the lexicon comprising a limited number of keywords;

receiving coordination instructions associated with the selected story, the coordination instructions including instructions for the client device to instruct one or more network-addressable devices to perform at least one action responsive to the client device detecting a keyword;

receiving user input, the user input including verbal recitation of the selected story;

detecting correspondence between the user input and at least one of the keywords; and

directing the one or more network-addressable devices to perform the at least one action responsive to the coordination instructions for the at least one keyword.

16. The computer-readable medium of claim 15 , wherein the detecting is performed by the client device.

17. The computer-readable medium of claim 15 , wherein detecting correspondence between the user input and at least one of the keywords further comprises:

sending the received user input to the server; and

receiving from the server the correspondence between the user input and at least one of the keywords.

18. The computer-readable medium of claim 15 , wherein the detecting comprises using a matching algorithm to match the audio profile of the at least one keyword with the audio profile of the user input.

19. The computer-readable medium of claim 15 , wherein the verbal recitation comprises playback of a recorded narration of the story.

20. The computer-readable medium of claim 14 , wherein the instructions further comprise instructions for:

detecting network-addressable devices within a specified radius of the client device;

responsive to detecting the one or more network-addressable devices within the specified radius, directing the one or more network-addressable devices to perform the at least one action; and

responsive to failing to detect the one or more network-addressable devices within the specified radius, skipping the at least one action.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2016
From: ROTHERA, ALEXANDER; LANGE, SCOTT D.; DROP, JENNIFER
To: GOOGLE INC.
Reel/Frame 040284/0023 →
Continuity (1)
Related Publication 20180103122A1 · Apr 12, 2018
Cited By (1)
US 12,278,859