Video throttling based on individual client delay
View Patent ↗A communication interface is configured to send video frames of a video sequence for delivery to a plurality of clients, wherein the video frames include key frames, and to receive feedback from a delayed client of the plurality of clients indicating that the delayed client requires a slower transmission rate for the video frames. A processing system is configured to, in response to the feedback from the delayed client, direct the communication interface to send subsequent video frames to the plurality of clients except to the delayed client, determine whether the delayed client can receive a next full key frame, and if the delayed client can receive the next full key frame, direct the communication interface to resume transmission of the video sequence to the delayed client starting with the next full key frame in the subsequent video frames that are presently being sent to the other clients.
1. A method of throttling a video sequence, the method comprising:
sending video frames of the video sequence for delivery to a plurality of clients, wherein the video frames include key frames;
receiving feedback from a delayed client of the plurality of clients indicating that the delayed client requires a slower transmission rate for the video frames;
in response to the feedback from the delayed client, sending subsequent video frames including at least one key frame to the plurality of clients except to the delayed client;
determining whether the delayed client can receive a next full key frame; and
if the delayed client can receive the next full key frame, resuming transmission of the video sequence to the delayed client starting with the next full key frame in the subsequent video frames that are presently being sent to the other clients.
2. The method of claim 1 wherein sending the video frames of the video sequence for delivery to the plurality of clients comprises sending the video frames of the video sequence simultaneously for delivery to the plurality of clients.
3. The method of claim 1 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that a receive buffer in the delayed client has exceeded a capacity threshold.
4. The method of claim 1 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that the delayed client cannot process the video frames at a current transmission rate.
5. The method of claim 1 wherein sending the subsequent video frames to the plurality of clients except to the delayed client comprises skipping transmission of the subsequent video frames of the video sequence to the delayed client while continuing transmission of the subsequent video frames to the other clients.
6. The method of claim 1 wherein the feedback from the delayed client is derived from protocol information.
7. The method of claim 6 wherein the protocol information comprises messages received from the delayed client in a transmission control protocol.
8. A non-transitory computer-readable medium having program instructions stored thereon for throttling a video sequence, wherein the program instructions, when executed by a video source system, direct the video source system to:
send video frames of the video sequence for delivery to a plurality of clients, wherein the video frames include key frames;
receive feedback from a delayed client of the plurality of clients indicating that the delayed client requires a slower transmission rate for the video frames;
in response to the feedback from the delayed client, send subsequent video frames including at least one key frame to the plurality of clients except to the delayed client;
determine whether the delayed client can receive a next full key frame; and
if the delayed client can receive the next full key frame, resume transmission of the video sequence to the delayed client starting with the next full key frame in the subsequent video frames that are presently being sent to the other clients.
9. The computer-readable medium of claim 8 wherein the program instructions, to direct the video source system to send the video frames of the video sequence for delivery to the plurality of clients, instruct the video source system to send the video frames of the video sequence simultaneously for delivery to the plurality of clients.
10. The computer-readable medium of claim 8 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that a receive buffer in the delayed client has exceeded a capacity threshold.
11. The computer-readable medium of claim 8 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that the delayed client cannot process the video frames at a current transmission rate.
12. The computer-readable medium of claim 8 wherein the program instructions, to direct the video source system to send the subsequent video frames to the plurality of clients except to the delayed client, instruct the video source system to skip transmission of the subsequent video frames of the video sequence to the delayed client while continuing transmission of the subsequent video frames to the other clients.
13. The computer-readable medium of claim 8 wherein the feedback from the delayed client is derived from protocol information.
14. The computer-readable medium of claim 13 wherein the protocol information comprises messages received from the delayed client in a transmission control protocol.
15. A video source system comprising:
a communication interface configured to send video frames of the video sequence for delivery to a plurality of clients, wherein the video frames include key frames, and to receive feedback from a delayed client of the plurality of clients indicating that the delayed client requires a slower transmission rate for the video frames; and
a processing system configured to, in response to the feedback from the delayed client, direct the communication interface to send subsequent video frames including at least one key frame, to the plurality of clients except to the delayed client;
the processing system further configured to determine whether the delayed client can receive a next full key frame, and if the delayed client can receive the next full key frame, direct the communication interface to resume transmission of the video sequence to the delayed client starting with the next full key frame in the subsequent video frames that are presently being sent to the other clients.
16. The video source system of claim 15 wherein the communication interface configured to send the video frames of the video sequence for delivery to the plurality of clients comprises the communication interface configured to send the video frames of the video sequence simultaneously for delivery to the plurality of clients.
17. The video source system of claim 15 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that a receive buffer in the delayed client has exceeded a capacity threshold.
18. The video source system of claim 15 wherein the feedback from the delayed client indicating that the delayed client requires the slower transmission rate for the video frames comprises an indication that the delayed client cannot process the video frames at a current transmission rate.
19. The video source system of claim 15 wherein the processing system configured to direct the communication interface to send the subsequent video frames to the plurality of clients except to the delayed client comprises the processing system configured to direct the communication interface to skip transmission of the subsequent video frames of the video sequence to the delayed client while continuing transmission of the subsequent video frames to the other clients.
20. The video source system of claim 15 wherein the feedback from the delayed client is derived from protocol information.