Granted Patent B2

US 12,596,349 · App. 18/078,562 · Granted Apr 7, 2026

Inventor: Vivek Pai (Walpole, MA)

G05B19/4155G05B2219/45007

Abstract

Claims (64)

1 . A method performed by a computing device, the computing device including at least one computer processor executing computer program instructions stored on at least one non-transitory computer-readable medium, the method comprising:

(A) generating, for a first line in a plurality of lines, based on the first line, a first cue signal corresponding to the first line, wherein generating the first cue signal comprises using natural language processing (NLP) to identify verb/noun/object pairs based on the first line, and wherein the first cue signal comprises an action verb identified based on the first line;

(B) identifying a first character associated with the first line, wherein identifying the first character comprises using NLP to extract entities from the first line;

(C) identifying a first electronic actor associated with the first character, wherein the first electronic actor comprises at least one of a first robot or a first toy, and wherein the computing device is physically distinct from the first electronic actor;

(D) after (A), sending the first cue signal from the computing device to the first electronic actor wirelessly;

(E) after (D), generating, for a second line in the plurality of lines, based on the second line, a second cue signal corresponding to the second line;

(F) identifying a second character associated with the second line;

(G) identifying a second electronic actor associated with the second character, wherein the second electronic actor comprises at least one of a second robot or a second toy, wherein the computing device is physically distinct from the second electronic actor, and wherein the second electronic actor is physically distinct from the first electronic actor;

(H) after (E), sending the second cue signal from the computing device to the second electronic actor wirelessly;

(I) after (H), generating, for the first line in the plurality of lines, based on the first line, a third cue signal corresponding to the first line, wherein the third cue signal differs from the first cue signal; and

(J) sending the third cue signal from the computing device to the first electronic actor wirelessly;

(K) at the first electronic actor, interpreting the first cue signal to identify a first action to perform; and

(L) at the first electronic actor, performing the first action.

2 . The method of claim 1 , further comprising, before (A):

(K) receiving a story, the story comprising at least one of text data, audio data, image data, and video data;

(L) generating, based on the story, a script representing the plurality of lines and a plurality of characters, wherein at least some of the plurality of lines are associated with at least some of the plurality of characters.

3 . The method of claim 2 , wherein the story comprises audio data.

4 . The method of claim 2 , wherein the story comprises video data.

5 . The method of claim 1 , wherein the first electronic actor comprises a robot.

6 . The method of claim 1 , wherein (K) comprises interpreting the first cue signal to identify the first action to perform based on at least one capability of the first electronic actor.

7 . The method of claim 1 , wherein (K) comprises interpreting the first cue signal to identify the first action to perform based on input received from at least one sensor in an environment of the first electronic actor.

8 . The method of claim 1 , wherein performing the first action comprises moving the first electronic actor based on the first cue signal.

9 . The method of claim 1 , wherein the method further comprises: (M) at the first electronic actor, providing a feedback signal to the computing device.

10 . The method of claim 9 , wherein the method further comprises:

(N) before (M), at the first electronic actor, obtaining input from a user via an input device; and

wherein (M) comprises providing the input to the computing device.

11 . The method of claim 1 , further comprising:

(K) at the first electronic actor, interpreting the first cue signal to identify a first action to perform;

(L) at the first electronic actor, performing the first action;

(M) at the second electronic actor, interpreting the second cue signal to identify a second action to perform; and

(N) at the second electronic actor, performing the second action;

wherein the first action differs from the second action.

12 . The method of claim 1 , further comprising:

(K) at the first electronic actor, receiving the first cue signal;

(L) at the first electronic actor, associating the first cue signal with the first electronic actor; and

(M) at the first electronic actor, interpreting the first cue signal to identify a first action to perform; and

(N) at the first electronic actor, performing the first action.

13 . The method of claim 1 :

wherein the first cue signal is addressed to the first electronic actor;

and wherein the method further comprises:

(K) at the second electronic actor, interpreting the first cue signal to identify a first action to perform; and

(L) at the second electronic actor, performing the first action.

14 . The method of claim 1 , further comprising:

(K) at the first electronic actor, sending the first cue signal to the second electronic actor wirelessly.

15 . The method of claim 1 , further comprising:

(K) wherein the first cue signal and the third cue signal are generated using different interpretation algorithms applied to identical content of the first line.

16 . A system comprising:

a script comprising a plurality of lines;

a computing device comprising an electronic actor coordinate module;

a first electronic actor that is physically distinct from the computing device, wherein the first electronic actor comprises at least one of a first robot or a first toy; and

a second electronic actor that is physically distinct from the computing device and the first electronic actor, wherein the second electronic actor comprises at least one of a second robot or a second toy;

wherein the electronic actor coordination module comprises computer program instructions for performing a method comprising:

(A) generating, for a first line in a plurality of lines, based on the first line, a first cue signal corresponding to the first line, wherein generating the first cue signal comprises using natural language processing (NLP) to identify verb/noun/object pairs based on the first line, and wherein the first cue signal comprises an action verb identified based on the first line;

(B) identifying a first character associated with the first line, wherein identifying the first character comprises using NLP to extract entities from the first line;

(C) identifying a first electronic actor associated with the first character, wherein the first electronic actor comprises at least one of a first robot or a first toy, and wherein the computing device is physically distinct from the first electronic actor;

(D) after (A), sending the first cue signal from the computing device to the first electronic actor wirelessly;

(E) after (D), generating, for a second line in the plurality of lines, based on the second line, a second cue signal corresponding to the second line;

(F) identifying a second character associated with the second line;

(G) identifying a second electronic actor associated with the second character, wherein the second electronic actor comprises at least one of a second robot or a second toy, wherein the computing device is physically distinct from the second electronic actor, and wherein the second electronic actor is physically distinct from the first electronic actor;

(H) after (E), sending the second cue signal from the computing device to the second electronic actor wirelessly;

(I) after (H), generating, for the first line in the plurality of lines, based on the first line, a third cue signal corresponding to the first line, wherein the third cue signal differs from the first cue signal; and

(J) sending the third cue signal from the computing device to the first electronic actor wirelessly;

(K) at the first electronic actor, interpreting the first cue signal to identify a first action to perform; and

(L) at the first electronic actor, performing the first action.

Continuity (2)

References Cited (37)