Interactive zooming in video conferencing
View Patent ↗In a video conferencing application, a user viewing a scene can performing zooming by selecting an area in the scene, then dynamically switching a video feed of the scene to the selected area of the scene. The hardware and software of the video conferencing application can limit the video transmitted to the user to include only the selected area of the scene. Transmitting only the selected area of the scene, and excluding the non-selected area of the scene from transmission, can more efficiently use the available bandwidth of the video conferencing application.
1. A method performed by a local user equipment (local UE) for zooming within a video conferencing application that provides two-way video communication between the local UE and a remote user equipment (remote UE), the method comprising:
defining, at the local UE, a user-defined region of interest (ROI) within a field of view at the remote UE, without changing the field of view of the remote UE;
directing the remote UE to capture video within the ROI, without changing the field of view of the remote UE;
receiving, at the local UE, the captured video from the remote UE, the received video including regions within the ROI and excluding regions outside the ROI; and
displaying, at the local UE, the received video.
2. The method of claim 1 , wherein directing the remote UE to capture video within the ROI comprises:
indicating the ROI in RTCP feedback reports; and
sending the RTCP feedback reports to the remote UE.
3. The method of claim 1 , wherein directing the remote UE to capture video within the ROI comprises:
capturing local video at the local UE;
embedding the ROI in at least one RTP header extension in the captured local video; and
sending the captured local video, with the embedded at least one RTP header extension, to the remote UE.
4. The method of claim 3 , wherein the at least one RTP header extension includes a position and a size, the position and the size defining the ROI.
5. The method of claim 4 , wherein the position comprises two position values indicative of a corner position of the ROI within the field of view at the remote UE.
6. The method of claim 5 , wherein the two position values are normalized to indicate relative position in two dimensions.
7. The method of claim 4 , wherein the size comprises two size values indicative of a size of the ROI within the field of view at the remote UE.
8. The method of claim 7 , wherein the two size values are normalized to indicate relative size in two dimensions.
9. The method of claim 1 ,
wherein the ROI includes a variable number of pixels; and
wherein the received video has a variable refresh rate that is inversely proportional to the number of pixels in the ROI.
10. The method of claim 1 ,
wherein the ROI includes a fixed number of pixels; and
wherein the received video has a constant refresh rate.
11. A user equipment (UE), comprising:
circuitry configured to perform two-way video conferencing between the UE and a remote user equipment (remote UE), the circuitry arranged to:
define, at the UE, a user-defined region of interest (ROI) within a field of view at the remote UE, without changing the field of view of the remote UE;
direct the remote UE to capture video within the ROI, without changing the field of view of the remote UE;
receive, at the UE, the captured video from the remote UE, the received video including regions within the ROI and excluding regions outside the ROI; and
display, at the UE, the received video.
12. The UE of claim 11 , wherein directing the remote UE to capture video within the ROI comprises:
indicating the ROI in RTCP feedback reports; and
sending the RTCP feedback reports to the remote UE.
13. The UE of claim 11 , wherein directing the remote UE to capture video within the ROI comprises:
capturing local video at the local UE;
embedding the ROI in at least one RTP header extension in the captured local video; and
sending the captured local video, with the embedded at least one RTP header extension, to the remote UE.
14. The UE of claim 13 , wherein the at least one RTP header extension includes a position and a size, the position and the size defining the ROI.
15. The UE of claim 14 , wherein the position comprises two position values indicative of a corner position of the ROI within the field of view at the remote UE.
16. The UE of claim 15 , wherein the two position values are normalized to indicate relative position in two dimensions.
17. The UE of claim 14 , wherein the size comprises two size values indicative of a size of the ROI within the field of view at the remote UE.
18. The UE of claim 17 , wherein the two size values are normalized to indicate relative size in two dimensions.
19. The UE of claim 11 ,
wherein the ROI includes a variable number of pixels; and
wherein the received video has a variable refresh rate that is inversely proportional to the number of pixels in the ROI.
20. The UE of claim 11 ,
wherein the ROI includes a fixed number of pixels; and
wherein the received video has a constant refresh rate.
21. A method performed by a local user equipment (local UE) for zooming within a video conferencing application that provides two-way video communication between the local UE and a remote user equipment (remote UE), the method comprising:
defining, at the local UE, a user-defined region of interest (ROI) within a field of view at the remote UE;
capturing local video at the local UE;
embedding the ROI in at least one RTP header extension in the captured local video; and
sending the captured local video, with the embedded at least one RTP header extension, to the remote UE, the at least one RTP header extension including a position and a size, the position and the size defining the ROI, the position including two position values indicative of a corner position of the ROI within the field of view at the remote UE, the size including two size values indicative of a size of the ROI within the field of view at the remote UE;
directing the remote UE to capture video within the ROI;
receiving, at the local UE, the captured video from the remote UE, the received video including regions within the ROI and excluding regions outside the ROI; and
displaying, at the local UE, the received video.