MTSI based UE configurable for video region-of-interest (ROI) signaling
View Patent ↗In a video conferencing application, a user viewing a scene can performing zooming by selecting an area in the scene, then dynamically switching a video feed of the scene to the selected area of the scene. The hardware and software of the video conferencing application can limit the video transmitted to the user to include only the selected area of the scene. Transmitting only the selected area of the scene, and excluding the non-selected area of the scene from transmission, can more efficiently use the available bandwidth of the video conferencing application.
1. An apparatus of a multimedia telephony services over an IP multimedia subsystem (MTSI) based user equipment (UE) configurable for video Region-of-Interest (ROI) signaling and operation as an MTSI sender, the apparatus comprising:
memory; and
processing circuitry configured to:
signal, to an MTSI receiver, video Region-of-Interest (ROI) information for a first ROI of the MTSI receiver in real-time protocol (RIP) packets, the RIP packets to include at least a zoom command to capture the first ROI, the first ROI being a requested ROI of the MTSI receiver;
decode received RTP payload packets from the MTSI receiver, the RIP payload packets comprising video corresponding to the first ROI;
receive signaling in RTCP feedback reports from the MTSI receiver requesting a second ROI, the second ROI provided during a Session Description Protocol (SDP) capability negotiation, the second ROI being a predefined ROI of the MTSI, sender; and
encode video corresponding to the second ROI in RTP payload packets for transmission to the MTSI receiver.
2. The apparatus of claim 1 wherein the processing circuitry is configured to encode a region of a captured frame corresponding to the second ROI and refrain from encoding outside the second ROI of the captured frame, the encoded video comprising the encoded region of the captured frame.
3. The apparatus of claim 1 wherein the processing circuitry is configured to signal the video ROI information for the first ROI of the MTSI receiver in RIP packets when operating in a remote camera control mode, the RIP packets to include at least the zoom command to capture the requested region of interest.
4. The apparatus of claim 1 wherein the processing circuitry is configured to signal the video ROI information for the first ROI of the MTSI receiver in RIP packets when operating in a remote camera control mode, the RTP packets to include at least the zoom command to capture the requested region of interest without changing a field-of-view (FOV) of the MTSI receiver.
5. The apparatus of claim 1 wherein the processing circuitry is configured to encode video corresponding to the second ROI in RIP payload packets for transmission to the MIST receiver without changing a field-of-view (FOV) of the MTSI sender.
6. The apparatus of claim 1 wherein e processing circuitry is further configured to:
perform the SDP capability negotiation with the MTSI receiver;
obtain a set of second ROIs from the MTSI receiver during the SDP capability negotiation; and
signal one of the second ROIs in RTCP feedback reports to the MTSI receiver when operating in a second ROI mode.
7. The apparatus of claim 1 wherein the processing circuitry is further configured to:
perform the SDP capability negotiation with the MTSI receiver;
provide a set of second ROIs to the MTSI receiver during the SDP capability negotiation, the set of second ROIs comprising a ROI region smaller than a size of a captured frame; and
receive signaling for one of the second ROIs in RTCP feedback reports from the MTSI receiver when the MTSI receiver is operating in a second ROT mode.
8. The apparatus of claim 7 wherein to signal the video ROI information to the MTSI receiver, the processing circuitry is configured to encode the video ROI information in RIP packets for transmission to the MTSI receiver.
9. The apparatus of claim 8 further comprising a camera to capture video corresponding to the second ROI.
10. The apparatus of claim 9 further comprising a display to display the decoded received RTP payload packets received from the MTSI receiver.
11. The apparatus of claim 1 wherein the processing circuitry is configured to:
perform the SDP capability negotiation with the MTSI receiver, the SDP capability negotiation comprising a resolution of the second ROT; and
encode a region corresponding to the second ROT of a captured frame with the negotiated resolution, the encoded video comprises the encoded region of the captured frame.
12. The apparatus of claim 11 wherein only the region corresponding to the second ROI of the captured frame is encoded with the negotiated resolution.
13. A non-transitory computer-readable storage medium that stores instructions for execution by processing circuitry of a multimedia telephony services over an IP multimedia subsystem (MTSI) based user equipment (UE) configurable for video Region-of-Interest (ROI) signaling and operation as an MTSI sender, the instructions to configure the UE to:
perform a Session Description Protocol (SDP) capability negotiation with an MTSI receiver;
encode video Region-of-Interest (ROI) information to signal a first ROI in real-time protocol (RTP) packets, the RTP packets to include at least a zoom command to capture the first ROI, the first ROI being a requested ROI of the MTSI receiver;
decode received RTP payload packets from the MTSI receiver, the RIP payload packets comprising video corresponding to the first ROI;
receive signaling in RTCP feedback reports from the MTSI receiver requesting a second ROI, the second ROI provided during the SDP capability negotiation, the second ROI being a predefined ROI of the MTSI sender; and
encode video corresponding to the second ROI in RTP payload packets for transmission to the MTSI receiver.
14. The non-transitory computer-readable storage medium of claim 13 wherein the processing circuitry is configured to encode a region of a captured frame corresponding to the second ROI and refrain from encoding outside the second ROI of the captured frame, the encoded video comprising the encoded region of the captured frame.
15. The non-transitory computer-readable storage medium of claim 13 wherein the processing circuitry is configured to signal the video ROI information for the first ROI of the MTSI receiver in RTP packets when operating in the remote camera control mode, the RTP packets to include at least the zoom command to capture the requested region of interest.
16. The non-transitory computer-readable storage medium of claim 13 wherein the processing circuitry is configured to signal the video ROI information for the first ROI of the MTSI receiver in RTP packets when operating in the remote camera control mode, the RIP packets to include at least the zoom command to capture the requested region of interest without changing a field-of-view (FOV) of the MTSI receiver.
17. The non-transitory computer-readable storage medium of claim 13 wherein the processing circuitry is configured to encode video corresponding to the second ROI in RTP payload packets for transmission to the MTSI receiver without changing a field-of-view (FOV) of the MTSI sender.
18. An apparatus of a multimedia telephony services over an IP multimedia subsystem (MTSI) based user equipment (UE) configurable for video Region-of-Interest (ROI) signaling and operation as an MTSI receiver, the apparatus comprising:
memory; and
processing circuitry configured to:
perform a Session Description Protocol (SDP) capability negotiation with an MTSI sender;
obtain a set of second ROIs from the MTSI sender during the SDP capability negotiation, the second ROIs being predefined ROIs of the MTSI sender, the set of second ROIs comprising a ROI region smaller than a size of a captured frame;
encode information to signal a first ROI in real-time protocol (RIP) packets; the RTP packets to include at least a zoom command to capture the first ROI when operating in a remote camera control mode, the first ROI being a requested ROI of the MTSI receiver;
encode information to signal one of the second ROIs in RTCP feedback reports when operating in a predefined ROI mode;
encode video corresponding to the first ROI in RTP payload packets for transmission to the MTSI sender; and
decode received RTP payload packets from the MTSI sender, the RTP payload packets comprising video corresponding to the second ROI.
19. The apparatus of claim 18 further comprising: a display to display the decoded received RIP payload packets received from the MTSI sender.
20. The apparatus of claim 19 further comprising two or more antennas to receive the RIP packets from an enhanced node B (eNB).