System and method for social immersive content rendering
Aspects of the subject disclosure may include, for example, a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving immersive media content; creating foreground information for rendering foreground video content of the immersive media content; receiving a first point-of-view (PoV) of a first viewer operating a first display device; generating a background video content from the immersive media content; sending the foreground information to the first display device; and sending a first portion of the background video content to the first display device, wherein the first portion is based on the first PoV. Other embodiments are disclosed.
1. A system, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
receiving immersive media content;
creating foreground information for rendering foreground video content from the immersive media content;
receiving a first point-of-view (PoV) of a first viewer operating a first display device and a second PoV of a second viewer operating a second display device;
determining an aggregated PoV from a first predicted PoV of the first viewer and a second predicted PoV of the second viewer;
separating a background video content in the immersive media content from the foreground video content based on a virtual distance of the aggregated PoV from the foreground video content;
sending the foreground information to the first display device and the second display device;
creating a first portion of the background video content based on the aggregated PoV;
displaying the first portion of the background video content on surfaces of a room comprising the first viewer;
augmenting a view of the first viewer with the foreground information by the first display device, wherein the first display device is an augmented reality head-mounted display; and
sending the first portion of the background video content to the second display device.
2. The system of claim 1 , wherein the first display device and the second display device render the foreground information and the background video content in a synchronous manner.
3. The system of claim 2 , wherein rendering of the foreground information and the background video content is synchronous to an audio signal.
4. The system of claim 3 , wherein the first display device and the second display device are head-mounted displays.
5. The system of claim 4 , wherein the first display device and the second display device are at different locations.
6. The system of claim 5 , wherein the operations further comprise facilitating an exchange of first audio from the first viewer and second audio from the second viewer.
7. The system of claim 6 , wherein the processing system comprises a plurality of processors operating in a distributed computing environment.
8. The system of claim 7 , wherein the background video content is computed based on the virtual distance.
9. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
receiving immersive media content;
creating foreground information from the immersive media content for rendering foreground video content of the immersive media content;
receiving a first point-of-view (PoV) of a first viewer operating a first display device and a second PoV of a second viewer operating a second display device;
determining an aggregated PoV from a first predicted PoV of the first viewer and a second predicted PoV of the second viewer;
separating a background video content in the immersive media content from the foreground video content based on a virtual distance of the aggregated PoV from the foreground video content;
sending the foreground information to the first display device and the second display device;
creating and sending a first portion of the background video content to the first display device, wherein the first portion is based on the aggregated PoV; and
sending the first portion of the background video content to the second display device.
10. The non-transitory, machine-readable medium of claim 9 , wherein the processing system comprises a plurality of processors operating in a distributed computing environment.
11. The non-transitory, machine-readable medium of claim 9 , wherein the operations further comprise sending the first portion of the background video content to the second display device.
12. The non-transitory, machine-readable medium of claim 9 , wherein the operations further comprise displaying the first portion of the background video content on a surface of a room comprising the first viewer and augmenting a view of the first viewer with the foreground information by the first display device, wherein the first display device is an augmented reality head-mounted display.
13. The non-transitory, machine-readable medium of claim 12 , wherein the first display device and the second display device render the foreground information and the background video content in a synchronous manner.
14. The non-transitory, machine-readable medium of claim 13 , wherein rendering of the foreground information and the background video content is synchronous to an audio signal.
15. The non-transitory, machine-readable medium of claim 14 , wherein the first display device and the second display device are head-mounted displays.
16. The non-transitory, machine-readable medium of claim 15 , wherein the first display device and the second display device are at different locations.
17. The non-transitory, machine-readable medium of claim 16 , wherein the operations further comprise facilitating an exchange of first audio from the first viewer and second audio from the second viewer.
18. A method, comprising:
receiving, by a processing system including a processor, immersive media content;
creating, by the processing system, foreground information for rendering foreground video content of the immersive media content;
receiving, by the processing system, a first point-of-view (PoV) of a first viewer of the immersive media content and a second PoV of a second viewer operating a second display device;
determining, by the processing system, an aggregated PoV from a first predicted PoV of the first viewer and a second predicted PoV of the second viewer;
separating, by the processing system, a background video content in the immersive media content from the foreground video content based on a virtual distance of the aggregated PoV from the foreground video content;
sending, by the processing system, the foreground information to a first display device viewed by the first viewer and the second display device viewed by the second viewer;
creating and sending a first portion of the background video content to the first display device, wherein the first portion is based on the aggregated PoV; and
sending the first portion of the background video content to the second display device.
19. The method of claim 18 , further comprising: displaying, by the processing system, the first portion of the background video content on a surface of a room comprising the first viewer and augmenting a view of the first viewer with the foreground information by the first display device, wherein the first display device is an augmented reality head-mounted display.
20. The method of claim 19 , wherein the first display device and the second display device are at different locations.