DYNAMICALLY MODIFYING LIVE VIDEO STREAMS FOR PARTICIPANT DEVICES IN DIGITAL VIDEO ROOMS
This disclosure describes a video room system that can efficiently and flexibly generate and facilitate video rooms for video chatting between participant devices by prioritizing video streams to provide to participant devices based on performance parameters. For example, the video room system can provide different video room streams to different participant devices based on the performance parameters of the participant devices. In addition, the video room system can customize or tailor video room streams based on identifying dominant speaker devices, determining connections between participant devices as indicated by a social graph of a social networking system, and/or based on join methods utilized by participant devices to join a video room.
1 - 20 . (canceled)
21 . A method comprising:
providing, for display on a first participant device from among a plurality of participant devices participating in a video room, a first video room stream comprising a first subset of live video streams from participant devices of the plurality of participant devices;
providing, for display on a second participant device from among the plurality of participant devices participating in the video room, a second video room stream comprising a second subset of live video streams from participant devices of the plurality of participant devices;
determining a dominant speaker device from among the plurality of participant devices participating in the video room; and
based on determining the dominant speaker device, modifying the first subset of live video streams to provide for the first video room stream and modifying the second subset of live video streams to provide for the second video room stream.
22 . The method of claim 21 , wherein modifying the first subset of live video streams and the second subset of live video streams comprises causing the first participant device and the second participant device to display a live video stream received from the dominant speaker device.
23 . The method of claim 21 , wherein determining the dominant speaker device comprises:
comparing volume amplitudes associated with audio data received from the plurality of participant devices participating in the video room; and
identifying, as the dominant speaker device, a participant device with a highest average volume amplitude over a threshold period of time.
24 . The method of claim 21 , wherein determining the dominant speaker device comprises:
receiving audio data captured by the plurality of participant devices participating in the video room;
determining voice audio and non-voice audio from the audio data captured by the plurality of participant devices; and
identifying a participant device capturing voice audio as the dominant speaker device.
25 . The method of claim 24 , wherein determining the voice audio and the non-voice audio comprises analyzing video data captured by the plurality of participant devices participating in the video room together with the audio data captured by the plurality of participant devices participating in the video room to identify mouth movement that corresponds to the audio data.
26 . The method of claim 21 , wherein determining the dominant speaker device comprises:
receiving audio data captured by the plurality of participant devices participating in the video room; and
identifying, as the dominant speaker device, a participant device with a volume amplitude that satisfies a threshold volume amplitude.
27 . The method of claim 21 , further comprising:
determining voice audio and non-voice audio from audio data captured by the dominant speaker device; and
filtering out the non-voice audio from the audio data captured by the dominant speaker device for providing to the plurality of participant devices participating in the video room.
28 . A non-transitory computer readable medium comprising instructions that, when executed by at least one processor, cause a computing device to:
provide, for display on a first participant device from among a plurality of participant devices participating in a video room, a first video room stream comprising a first subset of live video streams from participant devices of the plurality of participant devices;
provide, for display on a second participant device from among the plurality of participant devices participating in the video room, a second video room stream comprising a second subset of live video streams from participant devices of the plurality of participant devices;
determine a dominant speaker device from among the plurality of participant devices participating in the video room; and
based on determining the dominant speaker device, modify the first subset of live video streams to provide for the first video room stream and modifying the second subset of live video streams to provide for the second video room stream.
29 . The non-transitory computer readable medium of claim 28 , further comprising instructions that, when executed by the at least one processor, cause the computing device to modify the first subset of live video streams and the second subset of live video streams by causing the first participant device and the second participant device to display a live video stream received from the dominant speaker device.
30 . The non-transitory computer readable medium of claim 28 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the dominant speaker device by:
comparing volume amplitudes associated with audio data received from the plurality of participant devices participating in the video room; and
identifying, as the dominant speaker device, a participant device with a highest average volume amplitude over a threshold period of time.
31 . The non-transitory computer readable medium of claim 28 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the dominant speaker device by:
receiving audio data captured by the plurality of participant devices participating in the video room;
determining voice audio and non-voice audio from the audio data captured by the plurality of participant devices; and
identifying a participant device capturing voice audio as the dominant speaker device.
32 . The non-transitory computer readable medium of claim 31 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the voice audio and the non-voice audio by analyzing video data captured by the plurality of participant devices participating in the video room together with the audio data captured by the plurality of participant devices participating in the video room to identify mouth movement that corresponds to the audio data.
33 . The non-transitory computer readable medium of claim 28 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the dominant speaker device by:
receiving audio data captured by the plurality of participant devices participating in the video room; and
identifying, as the dominant speaker device, a participant device with a volume amplitude that satisfies a threshold volume amplitude.
34 . The non-transitory computer readable medium of claim 28 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
determine voice audio and non-voice audio from audio data captured by the dominant speaker device; and
filter out the non-voice audio from the audio data captured by the dominant speaker device for providing to the plurality of participant devices participating in the video room.
35 . A system comprising:
at least one processor; and
a non-transitory computer readable medium comprising instructions that, when executed by the at least one processor, cause the system to:
provide, for display on a first participant device from among a plurality of participant devices participating in a video room, a first video room stream comprising a first subset of live video streams from participant devices of the plurality of participant devices;
provide, for display on a second participant device from among the plurality of participant devices participating in the video room, a second video room stream comprising a second subset of live video streams from participant devices of the plurality of participant devices;
determine a dominant speaker device from among the plurality of participant devices participating in the video room; and
based on determining the dominant speaker device, modify the first subset of live video streams to provide for the first video room stream and modifying the second subset of live video streams to provide for the second video room stream.
36 . The system of claim 35 , further comprising instructions that, when executed by the at least one processor, cause the system to modify the first subset of live video streams and the second subset of live video streams by causing the first participant device and the second participant device to display a live video stream received from the dominant speaker device.
37 . The system of claim 35 , further comprising instructions that, when executed by the at least one processor, cause the system to determine the dominant speaker device by:
comparing volume amplitudes associated with audio data received from the plurality of participant devices participating in the video room; and
identifying, as the dominant speaker device, a participant device with a highest average volume amplitude over a threshold period of time.
38 . The system of claim 35 , further comprising instructions that, when executed by the at least one processor, cause the system to determine the dominant speaker device by:
receiving audio data captured by the plurality of participant devices participating in the video room;
determining voice audio and non-voice audio from the audio data captured by the plurality of participant devices; and
identifying a participant device capturing voice audio as the dominant speaker device.
39 . The system of claim 38 , further comprising instructions that, when executed by the at least one processor, cause the system to determine the voice audio and the non-voice audio by analyzing video data captured by the plurality of participant devices participating in the video room together with the audio data captured by the plurality of participant devices participating in the video room to identify mouth movement that corresponds to the audio data.
40 . The system of claim 35 , further comprising instructions that, when executed by the at least one processor, cause the system to:
determine voice audio and non-voice audio from audio data captured by the dominant speaker device; and
filter out the non-voice audio from the audio data captured by the dominant speaker device for providing to the plurality of participant devices participating in the video room.