Parameters for overlay handling for immersive teleconferencing and telepresence for remote terminals
A method, computer program, and computer system for video conferencing is provided. Video data associated with an immersive teleconferencing session is received. A parameter associated with the video data is identified, whereby the parameter specifies overlay data associated with the immersive teleconferencing session. The video data is displayed with one or more overlays based on the identified parameter.
1. A method for video conferencing, executable by a processor, comprising:
receiving video data associated with an immersive teleconferencing session, wherein the video data comprises a 360-degree video stream and one or more overlay media streams;
identifying a first parameter associated with the video data, wherein the first parameter indicates an overlay rendering type with a first value indicating a viewport relative type and a second value indicating a sphere relative type;
when the first parameter has the first value, identifying a second parameter, wherein the second parameter indicates overlay media streams to be prioritized during decoding; and
displaying the video data with the 360-degree video stream and the one or more overlay media streams using the first parameter and the second parameter.
2. The method of claim 1 , wherein the first parameter and the second parameter are set during a Session Description Protocol (SDP) negotiation between a sender and a receiver.
3. The method of claim 1 , wherein the first parameter and the second parameter are negotiated during an initial SDP negotiation.
4. The method of claim 1 , wherein the method further comprises:
when the first parameter has the first value, identifying a third parameter, wherein the third parameter indicates an opacity for the one or more overlay media streams; and
the displaying the video data with the 360-degree video stream and the one or more overlay media streams comprises using the first parameter, the second parameter, and the third parameter.
5. The method of claim 1 , wherein the method comprises identifying a fourth parameter that defines a list of overlay ids associated with the one or more overlay media streams.
6. The method of claim 5 , wherein the method further comprises identifying a fifth parameter that defines the list of overlay ids shared by a sender and supported by a receiver at a given time instance.
7. The method of claim 6 , wherein a value of the fifth parameter is based on the second parameter.
8. The method of claim 1 , wherein the method further comprises a sixth parameter that defines a list of allowed senders from whom a receiver may receive and use overlays.
9. A computer system for video conferencing, the computer system comprising:
one or more computer-readable non-transitory storage media configured to store computer program code; and
one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
first receiving code configured to cause the one or more computer processors to receive video data associated with an immersive teleconferencing session, wherein the video data comprises a 360-degree video stream and one or more overlay media streams;
first identifying code configured to cause the one or more computer processors to identify a first parameter associated with the video data, wherein the first parameter indicates an overlay rendering type with a first value indicating a viewport relative type and a second value indicating a sphere relative type;
second identifying code configured to cause the one or more computer processors to identify, when the first parameter has the first value, a second parameter, wherein the second parameter indicates overlay media streams to be prioritized during decoding; and
displaying code configured to cause the one or more computer processors to, display the video data with the 360-degree video stream and the one or more overlay media streams using the first parameter and the second parameter.
10. The computer system of claim 9 , wherein the first parameter and the second parameter are set during a Session Description Protocol (SDP) negotiation between a sender and a receiver.
11. The computer system of claim 9 , wherein the first parameter and the second parameter are negotiated during an initial offer-answer SDP negotiation.
12. The computer system of claim 9 , wherein the computer program code further comprises:
third identifying code configured to cause the one or more computer processors to identify, when the first parameter has the first value, a third parameter, wherein the third parameter indicates an opacity for the one or more overlay media streams; and
the displaying code is further configured to cause the one or more computer processors to display the video data with the 360-degree video stream and the one or more overlay media streams comprises using the first parameter, the second parameter, and the third parameter.
13. The computer system of claim 9 , wherein the computer program code further comprises:
fourth identifying code configured to cause the one or more computer processors to identify a fourth parameter that defines a list of overlay ids associated with the one or more overlay media streams.
14. The computer system of claim 13 , wherein the computer program code further comprises:
fifth identifying code configured to cause the one or more computer processors to identify a fifth parameter that defines the list of overlay ids shared by a sender and supported by a receiver at a given time instance.
15. The computer system of claim 14 , wherein a value of the fifth parameter is based on the second parameter.
16. The computer system of claim 9 , wherein the computer program code further comprises:
sixth identifying code configured to cause the one or more computer processors to identify a sixth parameter that defines a list of allowed senders from whom a receiver may receive and use overlays.
17. A non-transitory computer readable medium having stored thereon a computer program for video conferencing, the computer program configured to cause one or more computer processors to:
receive video data associated with an immersive teleconferencing session, wherein the video data comprises a 360-degree video stream and one or more overlay media streams;
identify a first parameter associated with the video data, wherein the first parameter indicates an overlay rendering type with a first value indicating a viewport relative type and a second value indicating a sphere relative type;
when the first parameter has the first value, identifying a second parameter, wherein the second parameter indicates overlay media streams to be prioritized during decoding; and
display the video data with the 360-degree video stream and the one or more overlay media streams using the first parameter and the second parameter.
18. The non-transitory computer readable medium of claim 17 , wherein the first parameter and the second parameter are set during a Session Description Protocol (SDP) negotiation between a sender and a receiver.
19. The non-transitory computer readable medium of claim 17 , wherein the first parameter and the second parameter are negotiated during an initial offer-answer SDP negotiation.
20. The non-transitory computer readable medium of claim 17 , wherein the computer program is further configured to cause one or more computer processors to identify, when the first parameter has the first value, a third parameter, wherein the third parameter indicates an opacity for the one or more overlay media streams; and
the displaying the video data with the 360-degree video stream and the one or more overlay media streams comprises using the first parameter, the second parameter, and the third parameter.