Methods and system for simulated 3D videoconferencing
View Patent ↗A system and method for manipulating images in a videoconferencing session provides users with a 3-D-like view of one or more presented sites, without the need for 3-D equipment. A plurality of cameras may record a room at a transmitting endpoint, and the receiving endpoint may select one of the received video streams based upon a point of view of a conferee at the receiving endpoint. The conferee at the receiving endpoint will thus experience a 3-D-like view of the presented site.
1. A continuous presence videoconferencing apparatus, comprising:
a conferee point-of-view detector that determines a gaze of a first conferee relative to a video display associated with the first conferee; and
a video editor, communicatively coupled to the conferee point-of-view detector, that builds a continuous presence video image from a video stream selected from a plurality of video streams responsive to the gaze of the first conferee.
2. The continuous presence videoconferencing apparatus of claim 1 , further comprising:
a video camera positioned with the video display, coupled to the conferee point-of-view detector, configured to image the first conferee,
wherein the conferee point-of-view detector is configured to
obtain a video image of the first conferee from the video camera; and
determine the gaze of the first conferee relative to the obtained video image.
3. The continuous presence videoconferencing apparatus of claim 1 , further comprising:
a control module coupled to the conferee point-of-view detector, configured to design a continuous presence videoconferencing layout, and to provide information to the conferee point-of-view detector on each segment of the continuous presence videoconferencing layout.
4. The continuous presence videoconferencing apparatus of claim 1 , wherein the conferee point-of-view detector is configured to
detect the gaze of the first conferee on a continuous presence video image that is presented on the video display;
determine a segment of the continuous presence video image at which the first conferee is looking; and
select a video stream from a plurality of video streams corresponding to the segment.
5. The continuous presence videoconferencing apparatus of claim 4 , wherein the plurality of video streams were obtained from three cameras corresponding to the segment.
6. The continuous presence videoconferencing apparatus of claim 1 , wherein the conferee point-of-view detector determines a gaze of the first conferee as an angle relative to a perpendicular orientation to the video display.
7. The continuous presence videoconferencing apparatus of claim 1 , wherein the conferee point-of-view detector determines a gaze of the first conferee as a two-dimensional pixel count relative to a predetermined position on the continuous presence video image.
8. The continuous presence videoconferencing apparatus of claim 1 , wherein the conferee point-of-view detector is contained in an input module of a multipoint control unit.
9. The continuous presence videoconferencing apparatus of claim 1 , wherein the conferee point-of-view detector is contained in a video module of a multipoint control unit.
10. A method of building a continuous presence video image, comprising:
determining a gaze of a first conferee relative to a video display associated with the first conferee;
receiving a plurality of video streams;
selecting a video stream of the plurality of video streams responsive to the gaze of the first conferee; and
building a continuous presence video image from the selected video stream.
11. The method of claim 10 , wherein the act of determining a gaze of a first conferee relative to a video display associated with the first conferee comprises:
receiving a video image from a video camera positioned with the video display; and
determining the gaze of the first conferee relative to the video image.
12. The method of claim 10 , wherein the act of determining a gaze of a first conferee relative to a video display associated with the first conferee comprises:
determining which of a plurality of segments of a continuous presence layout is looked at by the first conferee; and
determining which camera of an endpoint corresponding to the segment of the plurality of segments looked at by the first conferee corresponds to a direction of the first conferee's gaze.
13. The method of claim 10 , further comprising:
detecting a change in the gaze of the first conferee;
selecting a different video stream of the plurality of video streams responsive to the change in the gaze of the first conferee; and
building a continuous presence video image using the different video stream.
14. The method of claim 13 , wherein the act of detecting a change in the gaze of the first conferee is performed periodically.
15. The method of claim 13 , wherein the act of selecting a different video stream of the plurality of video streams responsive to the change in the gaze of the first conferee comprises:
determining whether the change in gaze of the first conferee meets a predetermined criteria; and
not selecting a different video stream if the change in gaze of the first conferee does not meet the predetermined criteria.
16. The method of claim 13 , wherein the act of building a continuous presence video stream using the different video stream comprises:
smoothing a transition between a first continuous presence video image and a second continuous presence video image.
17. The method of claim 10 , wherein the act of determining a gaze of a first conferee relative to a video display associated with the first conferee comprises:
learning a topology of a first site corresponding to the first conferee.
18. The method of claim 17 , wherein the act of learning a topology of a first site corresponding to the first conferee comprises:
prompting the first conferee to look at a plurality of locations on a video display associated with the first site; and
identifying the gaze of the first conferee at each of the plurality of locations.
19. A continuous presence videoconferencing system, comprising:
a conferee point-of-view detector, configured to determine a gaze of a conferee and to generate a gaze information;
a camera selector controller, configured to
receive the gaze information; and
select a video stream of a plurality of video streams received from a transmitting endpoint responsive to the gaze information.
20. The continuous presence videoconferencing system of claim 19 ,
wherein the conferee point-of-view detector is contained in an endpoint, and
wherein the camera selector controller is contained in a multipoint control unit communicatively coupled to the endpoint.
21. The continuous presence videoconferencing system of claim 19 , wherein the conferee point-of-view detector and the camera selector controller are contained in an endpoint.
22. The continuous presence videoconferencing system of claim 19 , further comprising:
a video editor, configured to update a video image in a segment of a continuous presence layout responsive to selection of a video stream by the camera selector controller.
23. The continuous presence videoconferencing system of claim 19 , further comprising:
a plurality of video editors, each configured to update a video image in a segment of a continuous presence layout responsive to a selection of a video stream by the camera selector controller.
24. The continuous presence videoconferencing system of claim 19 , further comprising:
a plurality of camera selector controllers, each configured to receive the gaze information for a conferee at an endpoint of a plurality of endpoints; and
a plurality of video editors, each coupled to one of the plurality of camera selector controllers and configured to update a video image in a segment of a continuous presence layout responsive to a selection of a video stream by the corresponding camera selector controller.