Video communications platform virtual environment streaming
Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for casting from a virtual environment to a video communications platform. The system may provide a video conference session in a video conference application. A connection may be established between the video conference application and a VR or AR device. The video conference application may receive 2D video content from the VR or AR device. The 2D video content may comprise a view of a virtual environment. The video conference application may stream the 2D video content in the video conference session.
1. A method comprising:
notifying one or more video conference participants of a video conference session in a video conference application that at least one unauthenticated participant is present in the video conference session;
establishing a connection between the video conference application and a virtual reality (VR) device that does not have casting functionality;
providing, for display via the VR device, video of the one or more video conference participants;
selecting a three-dimensional (3D) user view in a virtual environment;
encoding frames of the selected 3D user view to frames of two-dimensional (2D) video content; and
casting the 2D video content to the video conference session.
2. The method of claim 1 , wherein the virtual environment comprises a VR environment including 3D objects.
3. The method of claim 1 , wherein the virtual environment comprises an augmented reality (AR) environment comprising one or more AR holograms.
4. The method of claim 1 , further comprising:
applying a 3D spherical transformation to the selected 3D user view of the virtual environment to generate the 2D video content.
5. The method of claim 1 , further comprising:
applying a transformation simulating an effect of one or more lenses of the VR device to the selected 3D user view of the virtual environment to generate the 2D video content.
6. The method of claim 1 , further comprising:
capturing the 2D video content and transmitting the 2D video content to the video conference application under control of a system-level module of the VR device that is external to a VR application.
7. The method of claim 1 , wherein the 2D video content comprises real-world video combined with an overlay of one or more augmented reality (AR) objects.
8. A non-transitory computer readable medium comprising stored executable program instructions, that when executed by one or more processors, cause the one or more processors to perform operations comprising:
notifying one or more video conference participants of a video conference session in a video conference application that at least one unauthenticated participant is present in the video conference session;
establishing a connection between the video conference application and a virtual reality (VR) device that does not have casting functionality;
providing, for display via the VR device, video of the one or more video conference participants;
selecting a three-dimensional (3D) user view in a virtual environment;
encoding frames of the selected 3D user view to frames of two-dimensional (2D) video content; and
casting the 2D video content to the video conference session.
9. The non-transitory computer readable medium of claim 8 , wherein the virtual environment comprises a VR environment of a conference room.
10. The non-transitory computer readable medium of claim 8 , wherein the virtual environment comprises an augmented reality (AR) environment comprising one or more AR holograms.
11. The non-transitory computer readable medium of claim 8 , wherein the operations further comprise:
applying a 3D spherical transformation to the selected 3D user view of the virtual environment to generate the 2D video content.
12. The non-transitory computer readable medium of claim 8 , wherein the operations further comprise:
applying a transformation simulating an effect of one or more lenses of the VR device to the selected 3D user view of the virtual environment to generate the 2D video content.
13. The non-transitory computer readable medium of claim 8 , wherein the operations further comprise:
capturing the 2D video content and transmitting the 2D video content to the video conference application under control of a system-level module of the VR device that is external to a VR application.
14. The non-transitory computer readable medium of claim 8 , wherein the 2D video content comprises real-world video combined with an overlay of one or more augmented reality (AR) objects.
15. A system comprising:
one or more processors configured to:
notify one or more video conference participants of a video conference session in a video conference application that at least one unauthenticated participant is present in the video conference session;
establish a connection between the video conference application and a virtual reality (VR) device that does not have casting functionality;
provide, for display via the VR device, video of the one or more video conference participants;
select a three-dimensional (3D) user view in a virtual environment;
encode frames of the selected 3D user view to frames of two-dimensional (2D) video content; and
cast the 2D video content to the video conference session.
16. The system of claim 15 , wherein the virtual environment comprises a VR environment of an outdoor area.
17. The system of claim 15 , wherein the virtual environment comprises an augmented reality (AR) environment.
18. The system of claim 15 , wherein the one or more processors are further configured to:
apply a 3D spherical transformation to the selected 3D user view of the virtual environment to generate the 2D video content.
19. The system of claim 15 , wherein the one or more processors are further configured to:
apply a transformation simulating an effect of one or more lenses of the VR device to the selected 3D user view of the virtual environment to generate the 2D video content.
20. The system of claim 15 , wherein the one or more processors is further configured to:
transmit the 2D video content to the video conference application under control of a system-level module of the VR device that is external to a VR application.