IP Library › Granted Patent US 12,041,289
Granted Patent B2
US 12,041,289 · App. 18/116,216 · Granted Jul 16, 2024

Guided interaction between a companion device and a user

Inventors: Keith Comito (Seaford, NY); Dirk Van Dall (Shelter Island, NY); James Bowers (Durham, NC); Anthony Waters (Prospect, CT); Thomas Engel (Haarlem, NL)
Assignee: Disney Enterprises, Inc.
H04N21/4302G11B27/10H04N21/4104H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,041,289
App. No.
18/116,216
Granted
Jul 16, 2024
Kind
B2
Abstract

According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.

Claims (44)

1. A method comprising:

obtaining behavioral manifest data configured to guide interactions between a system and a user during playout of media content, the behavioral manifest data including a plurality of alternative interaction schema versions, wherein each of the plurality of alternative interaction schema versions includes a respective script of the interactions between the system and the user, the plurality of alternative interaction schema versions being conditioned upon a play head state and a playout timecode state of the media content;

obtaining the play head state and the playout timecode state of the media content; and

identifying, based on the obtained play head state, the obtained playout timecode state and the behavioral manifest data including the plurality of alternative interaction schema versions, a user interaction behavior for performance by the system.

2. The method of claim 1 , further comprising:

performing the identified user interaction behavior by the system.

3. The method of claim 1 , further comprising:

performing the identified user interaction behavior in real-time with respect to the obtaining of the play head state and the playout timecode state of the media content.

4. The method of claim 1 , further comprising:

transmitting a control signal for performing the identified user interaction behavior in real-time with respect to the obtaining of the play head state and the playout timecode state of the media content.

5. The method of claim 1 , wherein the user is one of a plurality of users, and wherein the plurality of alternative interaction schema versions include a first interaction schema instruction for guiding the interactions between the system and the plurality of users individually, and the plurality of alternative interaction schema versions further include a second interaction schema instruction for guiding the interactions between the system and the plurality of users as a whole.

6. The method of claim 1 , wherein the system includes a plurality of companion modules, and wherein the plurality of alternative interaction schema versions include an interaction schema instruction for coordinating the user interaction behavior of each of the plurality of companion modules.

7. The method of claim 1 , further comprising:

detecting an action by the user;

wherein identifying the user interaction behavior is further based on the detected action.

8. The method of claim 1 , wherein the play head state and the playout timecode state are part of a playout status that includes:

first one or more bytes, embedded in a data frame, identifying the media content;

second one or more bytes, embedded in the data frame, identifying the play head state of the system; and

third one or more bytes, embedded in the data frame, identifying the playout timecode state of the media content.

9. The method of claim 8 , wherein the second one or more bytes further identify at least one of: a playout speed of the system, whether the system includes a display screen, whether the system is in a muted mode, or whether the system is in a parental control mode.

10. The method of claim 8 , wherein the media playout status is formatted for transmission via Bluetooth Low Energy, and wherein the data frame comprises not more than twenty bytes.

11. A system comprising:

a software code stored in the memory;

a hardware processor configured to execute the software code to:

obtain behavioral manifest data configured to guide interactions between the system and a user during playout of media content, the behavioral manifest data including a plurality of alternative interaction schema versions, wherein each of the plurality of alternative interaction schema versions includes a respective script of the interactions between the system and the user, the plurality of alternative interaction schema versions being conditioned upon a play head state and a playout timecode state of the media content;

obtain the play head state and the playout timecode state of the media content; and

identify, based on the obtained play head state, the obtained playout timecode state and the behavioral manifest data including the plurality of alternative interaction schema versions, a user interaction behavior for performance by the system.

12. The system of claim 11 , wherein the hardware processor is further configured to execute the software code to:

perform the identified user interaction behavior by the system.

13. The system of claim 11 , wherein the hardware processor is further configured to execute the software code to:

perform the identified user interaction behavior in real-time with respect to the obtaining of the play head state and the playout timecode state of the media content.

14. The system of claim 11 , wherein the hardware processor is further configured to execute the software code to:

transmit a control signal for performing the identified user interaction behavior in real-time with respect to the obtaining of the play head state and the playout timecode state of the media content.

15. The system of claim 11 , wherein the user is one of a plurality of users, and wherein the plurality of alternative interaction schema versions include a first interaction schema instruction for guiding the interactions between the system and the plurality of users individually, and the plurality of alternative interaction schema versions further include a second interaction schema instruction for guiding the interactions between the system and the plurality of users as a whole.

16. The system of claim 11 , wherein the system includes a plurality of companion modules, and wherein the plurality of alternative interaction schema versions include an interaction schema instruction for coordinating the user interaction behavior of each of the plurality of companion modules.

17. The system of claim 11 , wherein the hardware processor is further configured to execute the software code to:

detect an action by the user;

wherein identifying the user interaction behavior is further based on the detected action.

18. The system of claim 11 , wherein the play head state and the playout timecode state are part of a playout status that includes:

first one or more bytes, embedded in a data frame, identifying the media content;

second one or more bytes, embedded in the data frame, identifying the play head state of the system; and

third one or more bytes, embedded in the data frame, identifying the playout timecode state of the media content.

19. The system of claim 18 , wherein the second one or more bytes further identify at least one of: a playout speed of the system, whether the system includes a display screen, whether the system is in a muted mode, or whether the system is in a parental control mode.

20. The system of claim 18 , wherein the media playout status is formatted for transmission via Bluetooth Low Energy, and wherein the data frame comprises not more than twenty bytes.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2026
From: COMITO, KEITH; DALL, DIRK VAN; BOWERS, JAMES; WATERS, ANTHONY; ENGEL, THOMAS
To: DISNEY ENTERPRISES, INC.
Reel/Frame 074995/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2026
From: DISNEY ENTERPRISES, INC.
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 075201/0892 →
Continuity (2)
Continuation 17064235 · Oct 6, 2020
Related Publication 20230209123A1 · Jun 29, 2023