System and method for combining multiple game or application views into a single media stream
A system and method are described for combining multiple views of a video game or application into a single video stream (or set of video streams). For example, a system according to one embodiment comprises: a plurality of application/video game instances executed for a particular multi-player video game or application on a hosting service, the application/video game instances being executed in response to control signals received from a plurality of clients; compositing logic executed at the hosting service to combine video streams generated by each of the application/video game instances into a single video stream for a first one of the clients; and compression logic to compress the single video stream with low latency such that the user of the first one of the clients has the perception that the video game or application is being executed locally.
1. A system for video gaming, comprising:
a plurality of servers configured for instantiating a plurality of application/video game instances for a particular multi-player video game or application, the plurality of application/video game instances being executed in response to control signals received from a plurality of remote clients during a multi-player gaming session, each of the plurality of application/video game instances generating a corresponding video stream in association with a corresponding remote client of the plurality of remote clients;
at least one server including compositing logic configured to receive video streams that are generated and uncompressed from the plurality of application/video game instances and combine the video streams that are generated and uncompressed from the plurality of application/video game instances into a composited video stream for a first remote client of the plurality of remote clients, the composited video stream being a multiple-view representation including each video stream that is combined, the first remote client being provided with an option to view a selected video stream of a corresponding application/video game instance being played or watched or to view the composited video stream;
the at least one server configured for determining one or more compression parameters defining processing capabilities of the first remote client; and
a compression resource including compression logic to compress the composited video stream or the selected video stream for the first remote client based on the one or more compression parameters,
wherein the compression resource is configured to compress the composited video stream for delivery to each of the plurality of remote clients.
2. The system as in claim 1 wherein the compositing logic generates a separate composited video stream for each remote client, each corresponding separate composited video stream having a primary view generated from a perspective of a user of the corresponding remote client and a plurality of secondary views generated from perspectives of other users participating in the particular multi-player video game or application.
3. The system as in claim 2 wherein the first remote client receives the selected video stream and a second remote client receives a first corresponding separate composited video stream.
4. The system as in claim 1 wherein the compression logic compresses the composited video stream in response to feedback received indicating a current state of a communication channel.
5. The system as in claim 2 wherein the video streams combined by the compositing logic are generated by each of the plurality of application/video game instances for perspective views of a plurality of users participating in the particular multi-player video game or application.
6. The system as in claim 2 wherein the plurality of remote clients have different processing capabilities.
7. The system as in claim 6 wherein at least one of the plurality of remote clients is a touch-screen tablet.
8. The system as in claim 6 wherein at least one of the plurality of remote clients is a smartphone.
9. A method executed by a hosting service with a plurality of servers for video gaming, comprising:
executing, by at least one server of the hosting service, a plurality of application/video game instances for a particular multi-player video game or application on the hosting service, the plurality of application/video game instances being executed in response to control signals received from a plurality of remote clients during a multi-player gaming session, each of the plurality of application/video game instances generating a corresponding video stream in association with a corresponding remote client of the plurality of remote clients;
receiving video streams that are generated and uncompressed from the plurality of application/video game instances by the at least one server including compositing logic of the hosting service;
combining, by the at least one server of the hosting service, the video streams that are uncompressed generated by the plurality of application/video game instances into a composited video stream for a first remote client of the plurality of remote clients, the composited video stream being a multiple-view representation including each video stream that is combined, the first remote client being provided with an option to view a selected video stream of a corresponding application/video game instance being played or watched or to view the composited video stream;
determining one or more compression parameters defining processing capabilities of the first remote client; and
compressing, by a compression resource of the hosting service, the composited video stream or the selected video stream for the first remote client based on the one or more compression parameters,
wherein the compression resource is configured to compress the composited video stream for delivery to each of the plurality of remote clients.
10. The method as in claim 9 further comprising generating a separate composited video stream for each of the plurality of remote clients, each corresponding separate composited video stream having a primary view generated from a perspective of a user of the corresponding remote client and a plurality of secondary views generated from perspectives of other users participating in the particular multi-player video game or application.
11. The method as in claim 10 wherein the first remote client receives the selected video stream and a second remote client receives a first corresponding separate composited video stream.
12. The method as in claim 9 wherein the compression resource compresses the composited video stream in response to feedback received indicating a current state of a communication channel.
13. The method as in claim 10 wherein the video streams combined by the compositing logic are generated by each of the plurality of application/video game instances for perspective views of a plurality of users participating in the particular multi-player video game or application.
14. The method as in claim 10 wherein the plurality of remote clients have different processing capabilities.
15. The method as in claim 14 wherein at least one of the plurality of remote clients is a touch-screen tablet.
16. The method as in claim 14 wherein at least one of the plurality of remote clients is a smartphone.
17. A system including a gaming service for video gaming, comprising:
a plurality of servers configured for instantiating a plurality of video game instances for a multi-player video game on the gaming service, the plurality of video game instances being executed in response to control signals received from a plurality of remote clients during a multi-player gaming session, each of the plurality of video game instances generating a corresponding video stream in association with a corresponding remote client, the corresponding remote client receiving the corresponding video stream to be presented on a screen associated with the corresponding remote client of the plurality of remote clients;
at least one server including compositing logic executed at the gaming service to receive video streams that are generated and uncompressed from the plurality of video game instances and combine the video streams that are uncompressed and generated by the plurality of video game instances into a composited video stream for a first remote client of the plurality of remote clients, the composited video stream being a multiple-view representation including each video stream that is combined, the first remote client being provided with an option to view a selected video stream for a selected video game instance or to view the composited video stream;
the at least one server configured for determining one or more compression parameters defining processing capabilities of the first remote client; and
a compression resource including compression logic to compress the composited video stream or the selected video stream for the first remote client based on the one or more compression parameters,
wherein the compression resource is configured to compress the composited video stream for delivery to each of the plurality of remote clients.
18. The system of claim 17 , wherein the compression logic compresses the composited video stream in response to feedback received indicating a current state of a communication channel between the gaming service and the first remote client.
19. The system of claim 17 , wherein the composited video stream combining the video streams that are uncompressed and generated by the plurality of video game instances for the multi-player video game includes a primary view generated from a perspective of a first user of the first remote client and a plurality of secondary views generated from perspectives of other users participating in the multi-player gaming session.