Signaling of the RTCP viewport feedback for immersive teleconferencing and telepresence for remote terminals

1. A method for video signaling, the method performed by at least one processor and comprising:

setting at least one of a timer and an event-based threshold with respect to a video conference call;

determining whether the at least one of the timer and the event-based threshold has been triggered; and

adjusting a real-time transport control protocol (RTCP) of the video conference call to a viewport based on determining whether the at least one of the timer and the event-based threshold has been triggered.

2. The method for video signaling according to claim 1 ,

wherein the event-based threshold comprises at least a degree of change in a spatial orientation of the viewport.

3. The method for video signaling according to claim 2 ,

wherein determining whether the at least one of the timer and the event-based threshold have been triggered comprises determining whether the spatial orientation of the viewport has been changed by more than the degree of change of the event-based threshold before the timer has been triggered by the elapsed time.

4. The method for video signaling according to claim 3 ,

wherein further controlling the delivery of the video conference call to the viewport comprises delivering at least an additional margin of the video conference call to the viewport in a case in which it is determined that the spatial orientation of the viewport has been changed by more than the degree of change of the event-based threshold before the timer has been triggered by the elapsed time.

5. The method for video signaling according to claim 1 ,

wherein further controlling the delivery of the video conference call to the viewport comprises processing different length packets depending on whether the timer has been triggered or whether the event-based threshold has been triggered.

6. The method for video signaling according to claim 5 ,

wherein of the different length packets, a first packet that the timer has been triggered is longer than a second packet that the event-based threshold has been triggered.

7. The method for video signaling according to claim 1 , further comprising:

determining whether a frequency at which the event triggers the event-based threshold exceeds a frequency threshold.

8. The method for video signaling according to claim 7 , further comprising:

updating the elapsed time to a second elapsed time in response to determining that the frequency at which the event triggers the event-based threshold exceeds the frequency threshold,

wherein the second elapsed time is longer than the elapsed time.

9. The method for video signaling according to claim 1 ,

wherein the viewport is a display of at least one of a headset and a handheld mobile device (HMD).

10. The method for video signaling according to claim 1 ,

wherein the video conference call comprises a 360° video data of an omnidirectional camera.

11. An apparatus for video signaling, the apparatus comprising:

at least one memory configured to store computer program code;

at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:

setting code configured to cause the at least one processor to set at least one of a timer and an event-based threshold with respect to the video conference call;

determining code configured to cause the at least one processor to determine whether the at least one of the timer and the event-based threshold has been triggered; and

controlling code configured to cause the at least one processor to further adjust a real-time transport control protocol (RTCP) of the video conference call to a viewport based on determining whether the at least one of the timer and the event-based threshold has been triggered.

12. The apparatus for video signaling according to claim 11 ,

wherein the event-based threshold comprises at least a degree of change in a spatial orientation of the viewport.

13. The apparatus for video signaling according to claim 12 ,

wherein determining whether the at least one of the timer and the event-based threshold have been triggered comprises determining whether the spatial orientation of the viewport has been changed by more than the degree of change of the event-based threshold before the timer has been triggered by the elapsed time.

14. The apparatus for video signaling according to claim 13 ,

wherein further controlling the delivery of the video conference call to the viewport comprises delivering at least an additional margin of the video conference call to the viewport in a case in which it is determined that the spatial orientation of the viewport has been changed by more than the degree of change of the event-based threshold before the timer has been triggered by the elapsed time.

15. The apparatus for video signaling according to claim 11 ,

wherein further controlling the delivery of the video conference call to the viewport comprises processing different length packets depending on whether the timer has been triggered or whether the event-based threshold has been triggered.

16. The apparatus for video signaling according to claim 15 ,

wherein of the different length packets, a first packet that the timer has been triggered is longer than a second packet that the event-based threshold has been triggered.

17. The apparatus for video signaling according to claim 11 , further comprising:

further determining code configured to cause the at least one processor to determine whether a frequency at which the event triggers the event-based threshold exceeds a frequency threshold.

18. The apparatus for video signaling according to claim 17 , further comprising:

updating code configured to cause the at least one processor to update the elapsed time to a second elapsed time in response to determining that the frequency at which the event triggers the event-based threshold exceeds the frequency threshold,

wherein the second elapsed time is longer than the elapsed time.

19. The apparatus for video signaling according to claim 11 ,

wherein the viewport is a display of at least one of a headset and a handheld mobile device (HMD).

20. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:

setting at least one of a timer and an event-based threshold with respect to a video conference call;

determining whether the at least one of the timer and the event-based threshold have been triggered; and

adjusting a real-time transport control protocol (RTCP) of the video conference call to a viewport based on determining whether the at least one of the timer and the event-based threshold has been triggered.