Multi-mode video conferencing system
The present disclosure is directed to a video-enabled communication system that comprises a control unit, coupled with a camera, the camera acquiring an image of a local participant to provide to a remote participant during a video communication session. A microprocessor in the control unit executes an audio controller that causes the microprocessor to control, based on audio information collected by the control unit, movement and/or pan and/or tilt of a camera at a remote endpoint of the remote participant to capture a selected image of the remote participant for display to the local participant. The control unit can operate in multiple operating modes depending on the context of the video conference.
1. A video-enabled communication system, comprising:
a microprocessor, coupled with camera, to receive an image of an object of interest during a video communication session; and
a computer readable medium comprising instructions that program the microprocessor: (a) in a first operating mode, use a first set of instructions to perform a first video communication operation or function and (b) in a second operating mode, use a different set of instructions to perform the first video communication operation or function; and
an imaging controller that causes the microprocessor to move the camera from a first spatial location to a second spatial location relative to a selected point of reference to enable the camera to capture different images of a local participant for display, by a remote display device, to a remote participant to the video communication session; and
wherein the camera is a pan, tilt, and zoom camera, wherein, as a result of the movement, the pan rotational axis moves from the first spatial location to the second spatial location, and wherein the camera movement moves the camera linearly or curvilinearly from the first to the second spatial locations; and
a guide track assembly comprising at least one track along which the camera moves via a carriage movably engaging the at least one track, wherein the guide track assembly comprises:
a carriage displacement unit to cause camera movement along the at least one track; and
a displacement measuring system to determine a position and/or displacement of the camera, relative to the selected point of reference, along the at least one track, wherein the microprocessor determines the second spatial location of the camera based on a sensed location of the local participant, wherein the guide track assembly further comprises a support arm engaging a local display device and a housing, engaging the support arm, and enclosing, at least partially, the at least one track, carriage, and camera, and wherein the housing comprises a substantially transparent front surface to enable the camera to capture images of the local participant.
2. The system of claim 1 , wherein the first video communication operation or function is one or more of collect local video or audio information during the video communication session, process the collected local video or audio information for output to a remote endpoint, or display remote video or audio information received from the remote endpoint.
3. The system of claim 1 , wherein, in the first operating mode, the camera at a first location is controlled by the microprocessor and, in the second operating mode, the camera at the first location is controlled at least partially by a different microprocessor at a remote endpoint.
4. The system of claim 1 , wherein the microprocessor, in the first operating mode, causes a set of speakers at a first location to provide stereophonic sound playback of audio information captured during the video communication session by a remote endpoint and, in the second operating mode, causes the set of speakers at the first location to provide monophonic sound playback of the audio information captured during the video communication session by the remote endpoint.
5. The system of claim 1 , wherein the microprocessor provides a display to a participant at a first location and wherein, in the first operating mode, the display has a first layout, the first layout comprising one or more images captured, during the video communication session, by a camera at a remote endpoint and, in the second operating mode, the display has a second layout, the second layout comprising one or more images captured, during the video communication session, by the camera at the remote endpoint, wherein the first and second layout differ by having different numbers or different types of displayed images.
6. The system of claim 1 , wherein the microprocessor selects the first or second operating modes based on a sensed context of the video communication session, wherein the sensed context is defined by one or more of a number of session participants at each endpoint location, a number of endpoint locations participating in the session, a purpose of the session, and video conferencing preferences of one or more of participants to the session.
7. The video-enabled communication system of claim 1 , further comprising a microphone.
8. The video-enabled communication system of claim 7 , wherein the microphone comprises a microphone array.
9. The video-enabled communication system of claim 1 , further comprising a microphone providing the location of the sensed participant.
10. The video-enabled communication system of claim 1 , wherein the microphone monitors participants within a monitored communication session.
11. A video-enabled communication system, comprising:
a control unit, coupled with a camera, the camera acquiring an image of a local participant to provide to a remote participant during a video communication session, wherein the control unit comprises:
a microprocessor; and
a computer readable medium comprising an audio controller that causes the microprocessor to control, based on audio information collected by the control unit, movement and/or pan and/or tilt of a camera at a remote endpoint of the remote participant to capture a selected image of the remote participant for display to the local participant; and
wherein the computer readable medium comprises an imaging controller that causes the microprocessor to move the camera from a first spatial location to a second spatial location relative to a selected point of reference to enable the camera to capture different images of the local participant for display, by a remote display device, to the remote participant to the video communication session; and
wherein the camera is a pan, tilt, and zoom camera, wherein, as a result of the movement, the pan rotational axis moves from the first spatial location to the second spatial location, and wherein the camera movement moves the camera linearly or curvilinearly from the first to the second spatial locations; and
a guide track assembly comprising at least one track along which the camera moves via a carriage movably engaging the at least one track, wherein the guide track assembly comprises:
a carriage displacement unit to cause camera movement along the at least one track; and
a displacement measuring system to determine a position and/or displacement of the camera, relative to the selected point of reference, along the at least one track, wherein the microprocessor determines the second spatial location of the camera based on a sensed location of the local participant, wherein the guide track assembly further comprises a support arm engaging a local display device and a housing, engaging the support arm, and enclosing, at least partially, the at least one track, carriage, and camera, and wherein the housing comprises a substantially transparent front surface to enable the camera to capture images of the local participant.
12. The system of claim 11 , wherein the microprocessor's control of the movement and/or pan and/or tilt of the camera at the remote location is based on sound localization by the microprocessor at a location comprising the local participant.
13. The system of claim 11 , further comprising:
an audio capturing device to capture speech of the local participant, wherein
the audio controller provides the captured speech to first and second sound speakers at the remote location for stereophonic playback of the speech by the first and second sound speakers, to the remote participant, the stereophonic playback being based on the sensed location of the local participant relative to the selected point of reference.
14. The system of claim 11 , wherein the computer readable medium comprises instructions that program the microprocessor: (a) in a first operating mode, use a first set of instructions to perform a first video communication operation or function and (b) in a second operating mode, use a different set of instructions to perform the first video communication operation or function.
15. The system of claim 14 , wherein the first video communication operation or function is one or more of collect local video or audio information during the video communication session, process the collected local video or audio information for output to a remote endpoint, or display remote video or audio information received from the remote endpoint.
16. A method, comprising:
determining, by a microprocessor at a first endpoint to a video communication session, a location of an active speaker in proximity to the first endpoint; and
controlling, by the microprocessor and based on the determined location of the active speaker, movement and/or pan and/or tilt of a camera at a remote location to the video communication session to capture a selected image of a remote participant for display at the first endpoint;
wherein the camera is a pan, tilt, and zoom camera and wherein, as a result of the movement, moving, by the microprocessor, the pan rotational axis from the first spatial location to the second spatial location, and moving, by the microprocessor, the camera linearly or curvilinearly from the first to the second spatial locations;
wherein camera movement is via a guide track assembly comprising at least one track along which the camera moves via a carriage movably engaging the at least one track; and
wherein the guide track assembly comprises a carriage displacement unit to cause camera movement along the at least one track, a displacement measuring system to determine a position and/or displacement of the camera, relative to the selected point of reference, along the at least one track, wherein the microprocessor determines the second spatial location of the camera based on a sensed location of the local participant, wherein the guide track assembly further comprises a support arm engaging a local display device and a housing, engaging the support arm, and enclosing, at least partially, the at least one track, carriage, and camera, and wherein the housing comprises a substantially transparent front surface to enable the camera to capture images of the local participant.
17. The method of claim 16 , wherein the microprocessor's control of the movement and/or pan and/or tilt of the camera at the remote location is based on sound localization by the microprocessor at a location comprising the local participant.
18. The method of claim 16 , wherein the microprocessor moves the camera from a first spatial location to a second spatial location relative to a selected point of reference to enable the camera to capture different images of the local participant for display, by a remote display device, to a remote participant to the video communication session.
19. The method of claim 16 , further comprising:
capturing, by an audio capturing device, speech of the local participant; and
providing, by the audio controller, the captured speech to first and second sound speakers at the remote location for stereophonic playback of the speech by the first and second sound speakers to the remote participant, wherein the stereophonic playback is based on the sensed location of the local participant relative to the selected point of reference.