System and method for multi-user digital interactive experience
Described herein are systems for providing a digital interactive experience. This includes a host server, a publisher receiving an application stream and a plurality of media streams corresponding to a first plurality of users in a publishing group, each of the media streams comprising at least one selected from the group of an audio stream and a video stream, the publisher sending the plurality of media streams to a subscriber, and the subscriber composing the application stream and at least two of the plurality of media streams into a composite stream and sending the composite stream to the first plurality of users in the publishing group, wherein the composite stream is sent simultaneously as the plurality of media streams is received.
1 . A system for providing a digital interactive synchronized experience, the system comprising:
a host server comprising an interaction system configured to:
receive, from a first participant, a request to join a synchronized media experience;
establish a connection between the first participant and a video synchronization component;
receive, from a plurality of users in a publishing group, respective media streams comprising at least one of an audio stream and a video stream;
compose, at a mixer, a composite media stream comprising an application stream, at least two of the media streams from the publishing group, and an interaction stream comprising user input from a distribution group;
transmit the composite media stream to a content delivery network (CDN) for distribution to the distribution group;
wherein the video synchronization component is configured to:
receive playback control signals from at least one participant,
propagate synchronization signals configured to provide synchronized playback at the publishing group and the distribution group, and
identify a set of participants experiencing unstable network conditions and suppress transmission of buffer-related synchronization signals from the set of participants.
2 . The system of claim 1 wherein the subscriber sends the composite stream comprising an interaction stream from each user in the plurality of users to a distributor comprising a content delivery network, a second plurality of users in a distributor group receiving the composite stream from the content delivery network.
3 . The system of claim 2 wherein the composite stream instead comprises:
the interaction stream from each user in the plurality of users and each user in the second plurality of users.
4 . The system of claim 3 further comprising:
a playback action comprising a user identifier, a playback event, and an action message, and
wherein the plurality of users and the second plurality of users receive the playback action and change a playback of the application stream.
5 . The system of claim 4 wherein the application stream comprises providing a set of instructions to a user application running locally to the user.
6 . The system of claim 1 further comprising:
a publisher receiving an application stream and the plurality of respective media streams corresponding to a plurality of users in the publishing group;
the publisher sending the plurality of respective media streams to a subscriber, and
the subscriber composing the application stream and at least two of the plurality of respective media streams into a composite stream and sending the composite stream to the plurality of users in the publishing group, wherein the composite stream is sent simultaneously as the plurality of respective media streams is received.
7 . The system of claim 1 wherein the video synchronization component is configured to initiate a query-response protocol, and wherein a participant's device, associated to at least one of the set of participants, is configured to:
transmit a playback time inquiry to the video synchronization component;
receive a current playback position in response; and
adjust playback of a respective media content on the participant's device to match with the received playback position.
8 . A method for providing a digital interactive synchronized experience, the method comprising:
providing, at a host server, an interaction system configured to:
receiving, from a first participant, a request to join a synchronized media experience;
establishing a connection between the first participant and a video synchronization component;
receiving, from a plurality of users in a publishing group, respective media streams comprising at least one of an audio stream and a video stream;
composing, at a mixer, a composite media stream comprising an application stream, at least two of the media streams from the publishing group, and an interaction stream comprising user input from a distribution group;
transmitting the composite media stream to a content delivery network (CDN) for distribution to the distribution group;
wherein the video synchronization component is configured to:
receiving playback control signals from at least one participant,
propagating synchronization signals configured to provide synchronized playback at the publishing group and the distribution group, and
identifying a set of participants experiencing unstable network conditions and suppress transmission of buffer-related synchronization signals from the set of participants.
9 . The method of claim 8 , further comprising:
receiving, by a publisher, an application stream and the plurality of respective media streams corresponding to a plurality of users in the publishing group;
sending, by the publisher, the plurality of respective media streams to a subscriber, and
composing, by the subscriber, the application stream and at least two of the plurality of respective media streams into a composite stream and sending the composite stream to the plurality of users in the publishing group, wherein the composite stream is sent simultaneously as the plurality of respective media streams is received.
10 . The method of claim 9 , wherein the subscriber sends the composite stream comprising an interaction stream from each user in the plurality of users to a distributor comprising a content delivery network, a second plurality of users in a distributor group receiving the composite stream from the content delivery network.
11 . The method of claim 10 , wherein the composite stream comprises:
the interaction stream from each user in the plurality of users and each user in the second plurality of users.
12 . The method of claim 11 wherein the application stream comprises providing a set of instructions to a user application running locally to the user.
13 . The method of claim 8 , wherein the video synchronization component is configured to initiating a query-response protocol wherein a participant's device, associated to at least one of the set of participants, is configured to:
transmitting a playback time inquiry to the video synchronization component;
receiving a current playback position in response; and
adjusting playback of a respective media content on the participant's device to match with the received playback position.