Integrated media gateway processing and control to reduce latency for 2-way video conference applications
View Patent ↗In a media gateway (MG) that enables communication with a plurality of client devices, at least a portion of video conferencing (VC) processing during a VC call between at least one of said plurality of client devices and at least one other VC client may be handled by the media gateway. The portion of the VC processing handled by said media is offloaded from a centralized VC multipoint control unit (MCU). The MG may handle one or more VC MCU functions, which may comprise video conferencing call control and/or management and/or audio/video (A/V) transcoding. The MG may adaptively control and/or configure latency associated with handling and/or communication of data by the media gateway's client device during the video conference call. The adaptive latency control and/or configuration may be based on determination of end-to-end latency associated with exchange of data during the video conference call.
1. A method for use with a media gateway configured to allow communication between a plurality of client devices, the method comprising:
handling, by the media gateway, at least a portion of video conferencing processing during a video conference call between at least one first client device and at least one second client device of the plurality of client devices, wherein the portion of the video conferencing processing handled by the media gateway is offloaded from a centralized video conferencing multipoint control unit; and
adaptively controlling, by the media gateway, latencies associated with at least one of handling or communication of data by the at least one first client device during the video conference call.
2. The method according to claim 1 , wherein the portion of video conferencing processing handled by the media gateway comprises at least one of video conferencing-related control or video conferencing-related management.
3. The method according to claim 2 , wherein handling the at least one of the video conferencing-related control or video conferencing-related management comprises establishing routing paths for exchange of data during the video conference call.
4. The method according to claim 1 , wherein handling the portion of video conferencing processing comprises performing at least a portion of one or more audio/video transcoding operations associated with audio/video content exchanged during the video conference call.
5. The method according to claim 1 , adaptively controlling the latencies comprising determining an end-to-end latency associated with exchange of data between the at least one first client device and the at least one second client device during the video conference call, the latencies controlled based on the end-to-end latency.
6. The method according to claim 5 , the end-to-end latency determined based on control information received via one or more control channels.
7. The method according to claim 1 , adaptively controlling the latencies comprising adjusting processing of the media gateway associated with at least one of a content capture, a content encoding, a content segmentation, or a content communication.
8. The method according to claim 7 , adjusting processing of the media gateway associated with the at least one of the content capture, content encoding, content segmentation, or content communication comprises modifying at least one of a corresponding handling priority or a resource allocation.
9. The method according to claim 7 , adjusting processing of the media gateway associated with the at least one of the content capture, content encoding, content segmentation, or content communication comprises adjusting processing of the media gateway associated with the content encoding and content segmentation by utilizing an encoding profile selected from a set of different encoding profiles, wherein the different encoding profiles comprise at least one of audio and video resolutions, CODEC types, or sizes of audio and video segments.
10. A system, comprising:
one or more circuits for use in a media gateway configured to allow communication between a plurality of client devices, the one or more circuits being configured to:
handle at least a portion of video conferencing processing during a video conference call between at least one first client device and at least one second client device of the plurality of client devices, wherein the a portion of the video conferencing processing handled by the one or more circuits is offloaded from a centralized video conferencing multipoint control unit; and
adaptively control latencies associated with at least one of handling or communication of data by the at least one first client device during the video conference call.
11. The system according to claim 10 , wherein the portion of video conferencing processing handled by the one or more circuits comprises at least one of video conferencing-related control or video conferencing-related management.
12. The system according to claim 11 , wherein the one or more circuits are configured to establish routing paths for exchange of data during the video conference call.
13. The system according to claim 10 , wherein the one or more circuits are configured to perform at least a portion of one or more audio/video transcoding operations associated with audio/video content exchanged during the video conference call.
14. The system according to claim 10 , wherein the one or more circuits are configured to determine an end-to-end latency associated with exchange of data between the at least one first client device and the at least one second client device during said video conference call.
15. The system according to claim 14 , wherein the one or more circuits are configured to determine the end-to-end latency based on control information received via one or more control channels.
16. The system according to claim 10 , wherein the one or more circuits are configured to adjust processing of the media gateway associated with at least one of a content capture, a content encoding, a content segmentation, or a content communication.
17. The system according to claim 16 , wherein the one or more circuits are configured to adjust processing of the media gateway associated with the at least one of the content capture, content encoding, content segmentation, or content communication by modifying at least one of a corresponding handling priority or a resource allocation.
18. The system according to claim 16 , wherein the one or more circuits are configured to adjust the processing of the media gateway associated with the content encoding and content segmentation by utilizing an encoding profile selected from a set of different encoding profiles, wherein the different encoding profiles comprise at least one of audio and video resolutions, CODEC types, or sizes of audio and video segments.
19. One or more computer-readable storage media having instructions stored thereon that, when executed by one or more processors of a media gateway configured to allow communication between a plurality of client devices, cause the one or more processors to perform operations comprising:
handling, by the media gateway, at least a portion of video conferencing processing during a video conference call between at least one first client device and at least one second client device of the plurality of client devices, wherein the portion of the video conferencing processing handled by the media gateway is offloaded from a centralized video conferencing multipoint control unit; and
adaptively controlling, by the media gateway, latencies associated with at least one of handling or communication of data by the at least one first client device during the video conference call.