Receiving compressed video frames in a video conference
One disclosed example method includes receiving, by a video conference provider, video frames from a plurality of existing participants in a video conference; receiving, by the video conference provider, a request from a new user to join the video conference, and in response: generating, by the video conference provider, an instantaneous decoder refresh (IDR) frame; determining, by the video conference provider, one or more prior video frames previously acknowledged by each existing participant of the plurality of existing participants; generating, by the video conference provider, a benchmark frame for each of the plurality of existing participants based on at least one of the determined one or more prior video frames and the IDR frame; transmitting, by the video conference provider, the IDR frame to the new user; and transmitting, by the video conference provider, a message comprising the benchmark frame to each of the plurality of existing participants.
1. A method comprising:
joining a video conference hosted by a video conferences provider, the video conference having a plurality of participants;
receiving video streams from a subset of participants of the plurality of participants, wherein receiving the video streams comprises, for each of one or more of the video streams, receiving a full video frame and establishing the full video frame as an instantaneous decoder refresh (“IDR”) video frame for generating video frames to be displayed, and receiving one or more differential video frames, each differential video frame based on the IDR video frame and zero or more intervening differential video frames;
generating and displaying video frames based on the IDR video frame or the IDR video frame and corresponding differential video frames;
in response to a new participant joining the video conference, receiving, for each video stream from the subset of the participants, a benchmark video frame;
generating, for each received benchmark video frame, a new full video frame based on the received benchmark video frame; and
establishing, for each new full video frame, a new IDR video frame using the respective new full video frame.
2. The method of claim 1 , further comprising receiving instructions to generate the new IDR video frame.
3. The method of claim 1 , further comprising acknowledging receipt of one or more of the received differential video frames.
4. The method of claim 1 , wherein the benchmark video frame comprises video information indicating differences between one or more acknowledged differential video frames and the IDR video frame.
5. The method of claim 1 , wherein generating the new full video frame is based on locally-stored data and the benchmark video frame.
6. The method of claim 1 , wherein the benchmark video frame is encoded in an IDR format.
7. The method of claim 1 , wherein the benchmark video frame is configured to be synthesized locally as a P-frame.
8. A system comprising:
a non-transitory computer-readable medium; and
a processor in communication with the non-transitory computer-readable medium, the processor configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:
join a video conference hosted by a video conferences provider, the video conference having a plurality of participants;
receive video streams from a subset of participants of the plurality of participants, and for each of one or more of the video streams, receive a full video frame and establish the full video frame as an instantaneous decoder refresh (“IDR”) video frame for generating video frames to be displayed, and receive one or more differential video frames, each differential video frame based on the IDR video frame and zero or more intervening differential video frames;
generate and displaying video frames based on the IDR video frame or the IDR video frame and corresponding differential video frames;
in response to a new participant joining the video conference, receive, for each video stream from the subset of the participants, a benchmark video frame;
generate, for each received benchmark video frame, a new full video frame based on the received benchmark video frame; and
establish, for each new full video frame, a new IDR video frame using the respective new full video frame.
9. The system of claim 8 , wherein the benchmark video frame comprises video information indicating differences between one or more acknowledged differential video frames and the IDR video frame.
10. The system of claim 8 , wherein the processor is configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to receive instructions to generate the new IDR video frame.
11. The system of claim 10 , wherein the instructions to generate the new IDR video frame include one or more of a characteristic of the benchmark video frame or information encoded in the benchmark video frame.
12. The system of claim 8 , wherein the processor is configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to acknowledge receipt of one or more of the received differential video frames.
13. The system of claim 12 , wherein the benchmark video frame is encoded in an IDR format, and wherein the benchmark video frame is configured to be synthesized locally as a P-frame.
14. The system of claim 12 , wherein generating the new full video frame is based on locally-stored data and the benchmark video frame.
15. A non-transitory computer-readable medium comprising processor-executable instructions configured to cause a processor to:
join a video conference hosted by a video conferences provider, the video conference having a plurality of participants;
receive video streams from a subset of participants of the plurality of participants, and for each of one or more of the video streams, receive a full video frame and establish the full video frame as an instantaneous decoder refresh (“IDR”) video frame for generating video frames to be displayed, and receive one or more differential video frames, each differential video frame based on the IDR video frame and zero or more intervening differential video frames;
generate and displaying video frames based on the IDR video frame or the IDR video frame and corresponding differential video frames;
in response to a new participant joining the video conference, receive, for each video stream from the subset of the participants, a benchmark video frame;
generate, for each received benchmark video frame, a new full video frame based on the received benchmark video frame; and
establish, for each new full video frame, a new IDR video frame using the respective new full video frame.
16. The non-transitory computer-readable medium of claim 15 , wherein the benchmark video frame comprises video information indicating differences between one or more acknowledged differential video frames and the IDR video frame.
17. The non-transitory computer-readable medium of claim 15 , further comprising processor-executable instructions configured to cause a processor to receive instructions to generate the new IDR video frame.
18. The non-transitory computer-readable medium of claim 17 , wherein the instructions to generate the new IDR video frame include one or more of a characteristic of the benchmark video frame or information encoded in the benchmark video frame.
19. The non-transitory computer-readable medium of claim 15 , wherein the benchmark video frame is encoded in an IDR format, and wherein the benchmark video frame is configured to be synthesized locally as a P-frame.
20. The non-transitory computer-readable medium of claim 19 , wherein generating the new full video frame is based on locally-stored data and the benchmark video frame.