System and method for multi-user digital interactive experience
Described herein is a methods and systems for providing a digital interactive experience. Interactive experiences include, but not limited to, synchronized video playback, video and text chat between two or more participants, and interactive live event participation combining synchronized video, text and video chatting. The system comprises persistent and non-persistent components to which a plurality of participants in the interactive experience may connect.
1. A method of providing synchronized interactive media to a publishing group and a distribution group participating in a shared synchronized interactive experience, the method comprising:
providing, by an application server, an application stream to a mixer,
receiving, by the mixer, a plurality of publisher streams corresponding to a first plurality of user devices in the publishing group, the first plurality of user devices associated with a first plurality of users, each publisher stream comprising at least one selected from the group of an audio and a video stream,
receiving, by the mixer, an interaction stream comprising user input from a second plurality of user devices in the distribution group, the second plurality of user devices associated with a second plurality of users, the interaction stream defining interactions with the shared synchronized interactive experience,
composing, at the mixer, a composite media stream comprising the application stream, two or more of the plurality of publisher streams corresponding to the first plurality of user devices in the publishing group, and the interaction stream,
sending, by the mixer, the composite media stream to a distributor,
sending, by the distributor, the composite media stream to the second plurality of user devices in the distribution group, and
wherein the composite media stream, the plurality of publisher streams corresponding to the first plurality of user devices in the publishing group, and the interaction stream are synchronous.
2. The method of claim 1 wherein the sending the composite media stream to a plurality of user devices in the distribution group comprises sending the composite media stream to a content delivery network, the content delivery network in communication with the plurality of user devices in the distribution group.
3. The method of claim 2 wherein
the first plurality of user devices in the publishing group receive a first composite media stream comprising the application stream, the plurality of publisher streams corresponding to the first plurality of user devices in the publishing group, and the interaction stream, and
the second plurality of user devices in the distribution group receive a second composite media stream comprising the application stream and the interaction stream.
4. The method of claim 3 wherein a synchronization component sends a synchronization action to the first plurality of user devices and the second plurality of user devices comprising a synchronization event and a synchronization message wherein each of the first plurality of user devices and a playback of the application stream changes for each of users in the second plurality of user devices.
5. The method of claim 4 wherein each user in the first plurality of user devices and each user in the second plurality of user devices receive a playback action comprising a user identifier, a playback event, and an action message, and
wherein the first plurality of user devices and the second plurality of user devices receive the playback action and change the playback of the application stream.
6. The method of claim 5 wherein the receiving the interaction stream comprises:
receiving a plurality of user input from at least one of the first plurality of user devices;
processing the user input into the interaction stream;
sending the playback action to each of the first plurality of user devices and each of the second plurality of user devices corresponding to the user input;
wherein the first plurality of user devices and the second plurality of user devices receive the playback action and change the playback of the application stream.
7. The method of claim 5 further comprising:
receiving a plurality of user input from at least one of the first plurality of user devices and the second plurality of user devices;
processing the user input into the interaction stream;
sending the playback action to each of the first plurality of user devices and each of the second plurality of user devices corresponding to the user input; and
wherein the first plurality of user devices and the second plurality of user devices receive the playback action and change the playback of the application stream.
8. A system for providing synchronized interactive media playback to a publisher group and a distribution group participating in a shared synchronized interactive experience, the system comprising:
an application server transmitting an application stream to a mixer,
a plurality of publishers in a publisher group corresponding to a first plurality of user devices associated with a first plurality of users,
the plurality of publishers transmitting a plurality of publisher streams to a mixer, each publisher stream comprising at least one selected from the group of an audio stream and a video stream,
a plurality of recipients in a distribution group corresponding to a second plurality of user devices associated with a second plurality of users in network communication with a distributor,
the plurality of recipients transmitting a plurality of interaction streams to the mixer, each of the plurality of interaction streams defining interactions with the shared synchronized interactive experience,
the mixer composing a composite media stream comprising two or more of the plurality of publisher streams, the plurality of interaction streams, and the application stream,
wherein:
the application stream, the composite media stream, the plurality of publisher streams, and the plurality of interaction streams are synchronous;
the distributor receiving the composite media stream from the mixer, and
the distributor sending the composite media stream to the second plurality of user devices.
9. The system of claim 8 wherein the sending the composite media stream to the second plurality of user devices in the distribution group comprises sending the composite media stream to a content delivery network, the content delivery network in communication with the second plurality of user devices in the distribution group.
10. The system of claim 9 wherein:
the first plurality of user devices in the publishing group receive a first composite media stream comprising the application stream, the plurality of publisher streams corresponding to the first plurality of user devices in the publishing group, and the plurality of interaction streams, and
the second plurality of user devices in the distribution group receive a second composite media stream comprising the application stream and the plurality of interaction streams.
11. The system of claim 8 , further comprising:
a media synchronization component transmitting a synchronization event comprising a synchronization time reference and a synchronization message;
wherein the first plurality of user devices and the second plurality of user devices receive the synchronization event from the media synchronization component; and
each of the second plurality of user devices and each of the first plurality of user devices changes a playback of the application stream based on the synchronization event.
12. The system of claim 11 , wherein the first plurality of user devices and the second plurality of user devices receive a playback action comprising a user identifier, and an action message; and
based on the playback action, the plurality of publishers and the plurality of recipients change the playback of the application stream.
13. The system of claim 12 wherein the mixer is configured to:
receive a plurality of user input from at least one of the first plurality of user devices;
process the user input into the corresponding interaction stream;
send the playback action to each of the first plurality of user devices and each of the second plurality of user devices corresponding to the user input;
wherein the first plurality of user devices and the second plurality of user devices receive the playback action and change the playback of the application stream.
14. The system of claim 12 wherein a user device in the second plurality of user devices is configured to:
receiving a plurality of user input from at least one of the first plurality of user devices and the second plurality of user devices;
processing the user input in the corresponding interaction stream;
sending the playback action to each of the first plurality of user devices and each of the second plurality of user devices corresponding to the user input; and
wherein the first plurality of user devices and the second plurality of user devices receive the playback action and change the playback of the application stream.