Automatic video switching for multimedia conferencing
View Patent ↗After a video conference is established, a video conferencing system receives a video stream from the participants of the video conference. One of the received video streams is transmitted to the conference participants (e.g. the video stream of the person currently speaking). The video conferencing system monitors a second one (or typically all) of the received video streams to determine if a designated video event (e.g. someone raising his hand) has occurred. If the designated video event has occurred, the video conferencing system switches or supplements the currently transmitted video stream to or with the second one of the received video streams that contains the designated video event. The second video stream is then transmitted to participants in the video conference. The switching of the video stream and the switching of the audio stream may be independent.
1. A system for changing transmission of a video stream comprising:
a stream monitor configured to receive a plurality of video streams that comprise a video conference including a first and a second video stream, and monitor the second video stream to determine whether a designated video event has occurred in the second video stream; and
a stream transmitter configured to transmit the first video stream, and to transmit the second video stream in response to a determination that the designated video event has occurred in the second video stream, wherein the second video stream is transmitted in place of or simultaneously with the first video stream; and wherein the video stream is dynamically selected for transmission, the plurality of video streams each further comprises an audio stream, and wherein the stream monitor is further configured to monitor each audio stream of the plurality of video streams for a designated audio event, and dynamically select the first video stream for transmission based on detection of the designated audio event.
2. The system of claim 1 , wherein the stream monitor is further configured to determine if a dynamically selected video stream is the second video stream, monitor the second video stream to determine if the second video stream's designated video event is no longer important, and responsive to a determination that the dynamically selected video stream is not the second video stream and that the second video stream's designated video event is no longer important, select the first video stream for transmission.
3. The system of claim 1 , wherein the stream monitor is further configured to monitor the second video stream to determine if the second video stream's designated video event is no longer important, and the stream transmitter transmits the first video stream in response to a determination that the second video stream's designated video event is no longer important.
4. The system of claim 3 , wherein the stream monitor is further configured to use hysteresis to determine if the second video stream's designated event is no longer important.
5. The system of claim 1 wherein a communication device is configured to receive the transmission of the first video stream, receive the transmission of the second video stream, display the received first video stream, and display the received second video stream.
6. The system of claim 1 , wherein at least one of the display of the first video stream and the display of the second video stream is a window within a screen displaying the video conference.
7. The system of claim 1 , wherein the video event is based on at least one gesture selected from the group comprising: a raising of a hand, a shaking of a head, a shaking motion, a smile, a frown, a sign in a sign language, and a nodding motion.
8. The system of claim 1 , wherein at least one of the plurality of video streams is an item selected from the group comprising: an analog video signal, a digital video signal, a packet stream, and a non-packet stream.
9. The system of claim 1 , wherein the stream monitor is further configured to buffer the second video stream to capture the video event.
10. The system of claim 1 , wherein a communication device is further configured to determine if the video event has occurred, send the video event in one of the plurality of video streams to the stream monitor in response to determining that the video event has occurred, and not send the one of the plurality of video streams in response to determining that the video event has not occurred.
11. The system of claim 1 , wherein the stream monitor is further configured to switch the transmission of the first video stream to the transmission of the second stream in response to the determination that the dynamically selected video stream is not the second video stream.
12. A method for changing transmission of a video stream comprising:
receiving, at a stream monitor, a plurality of video streams that comprise a video conference;
transmitting, from a stream transmitter, a first video stream of the plurality of video streams;
monitoring a second video stream of the plurality of video streams to determine if a designated video event has occurred in the second video stream; and
responsive to determining that the designated video event has occurred in the second video stream, transmitting from the stream transmitter, the second video stream, wherein the second video stream is transmitted in place of or simultaneously with the first video stream; and wherein the first video stream is dynamically selected, and wherein the plurality of video streams each further comprise an audio stream, and further comprising the steps of:
monitoring each audio stream of the plurality of video streams for a designated audio event; and
dynamically selecting the first video stream based on an occurrence of the designated audio event.
13. The method of claim 12 , further comprising the steps of:
monitoring the second video stream to determine if the second video stream's designated video event is no longer important; and
responsive to the second video stream's designated video event no longer being important, selecting the first video stream for transmission.
14. The method of claim 13 , wherein determining if the second video stream's designated event is no longer important is based on hysteresis.
15. The method of claim 12 , further comprising the steps of:
receiving the transmission of the first video stream and the transmission of the second video stream; and
displaying the received first video stream and the received second video stream.
16. The method of claim 12 , wherein the display of the first video stream or the display of the second video stream is a window within a screen displaying the video conference.
17. The method of claim 12 , wherein the video event is based on at least one gesture selected from the group comprising: a raising of a hand, a shaking of a head, a shaking motion, a smile, a frown, a sign in a sign language, and a nodding motion.
18. The method of claim 12 , wherein at least one of the plurality of video streams is an item selected from the group comprising: an analog video signal, a digital video signal, a packet stream, and a non-packet stream.
19. The method of claim 12 , further comprising the step of: buffering the second video stream to capture the video event.
20. The method of claim 12 , further comprising the steps of:
determining in a communication device if the video event has occurred;
responsive to determining that the video event has occurred, sending the video event in a video stream; and
responsive to determining that the video event has not occurred, not sending the video stream.
21. The method of claim 12 , further comprising the step of:
switching the transmission of the first video stream to the transmission of the second stream in response to the determination that the dynamically selected video stream is not the second video stream.
22. A means for changing transmission of a video stream comprising:
means for receiving a plurality of video streams that comprise a video conference;
means for transmitting a first video stream of the plurality of video streams;
means for monitoring a second video stream of the plurality of video streams to determine if a designated video event has occurred in the second video stream; and
means responsive to determining that the designated video event has occurred in the second video stream, for transmitting the second video stream, wherein the second video stream is transmitted in place of or simultaneously with the first video stream; and wherein the first video stream is dynamically selected, and wherein the plurality of video streams each further comprise an audio stream, and further comprising the steps of:
monitoring each audio stream of the plurality of video streams for a designated audio event; and
dynamically selecting the first video stream based on an occurrence of the designated audio event.