Dynamic layout of participants in a multi-party video conference
View Patent ↗The present invention provides a video conference system that is capable of adjusting image window sizes based on the number of video conference participants included in an image window. In particular, face recognition technology is applied to determine the number of persons included within an image associated with a video call. The information regarding the number of participants in the video call is used as a factor in determining the area of a video output device in which the image from the video call is presented at another video endpoint. The sizing of individual image windows may also be determined based on the total number of participants in a video conference.
1. A method for dynamically determining a layout of a video output, comprising:
obtaining a first image from a first location;
determining a number of faces included within said first image;
obtaining a second image from a second location;
determining a number of faces included within said second image;
determining a size of a first area within at least a first display device in which said first image from said first location is to be reproduced, wherein said size of said area is determined with reference to at least said number of faces included within said first image, wherein said first image includes a first determined number of faces, and wherein a first area size is selected for said first image;
determining a size of a second area within said at least a first display device in which said second image from said second location is to be reproduced, wherein said size of said second area is determined with reference to at least said number of faces included within said second image, wherein said second image includes a second determined number of faces, wherein a second area size is selected for said second image, and wherein said first determined number of faces is greater than said second determined number of faces; and
displaying said first image and said second image on said first display device, wherein said first area size in which said first image is included is larger than said second area size in which said second image is included.
2. The method of claim 1 , further comprising:
determining a total number of faces to be reproduced by said first display device, wherein said size of said second area is reproduced by said at least one display device is determined with additional reference to said determined total number of faces to be reproduced by said first display device.
3. The method of claim 1 , further comprising:
determining a total number of images to be reproduced by said first display device, wherein said size of said first area and a size of said second area are determined with reference to said determined total number of images to be reproduced by said first display device.
4. The method of claim 3 , wherein said total number of images corresponds to a total number of locations from which an image is to be reproduced by first display device.
5. The method of claim 1 , wherein said first image comprises a series of images.
6. The method of claim 5 , wherein said series of images is associated with a frame rate, wherein said determining a number of faces included in said first image is performed for each frame of said series of images.
7. The method of claim 5 , wherein said determining a number of faces included in said first image is performed periodically.
8. The method of claim 1 , further comprising:
displaying at least said first image at said second location and displaying at least said second image at said first location.
9. The method of claim 1 , further comprising:
obtaining a third image from a third location;
determining a number of faces included within said third image;
determining a size of a third area within at least one of said first display device, a second display device, and a third display device in which said third image from said third location is to be displayed, wherein said size of said third area is determined with reference to said determined total number of faces to be reproduced by said at least one display device;
displaying said first image from said first location at said second and third locations, wherein said determining a size of an area within a display device in which said first image is to be displayed is for at least said second location additionally determined with reference to at least one of a total number of images to be displayed at said second location and a determined total number of faces to be displayed at said second location;
displaying said second image from said second location at said first and third locations; and
displaying said third image from said third location at said first and second locations.
10. The method of claim 1 , wherein said first and second locations comprise first and second video conference locations respectively, and wherein said first image and said second image are displayed in at least said first display device associated with a third video conference location.
11. The method of claim 10 , wherein said first image is obtained as part of a video conference arrangement, wherein said size of said first area s i is determined by the expression
s
i
=
n
i
N
S
,
where is the total available display area, n i is the number of participants detected in call (i), N is the total number of video conference participants that are displayed by said first display, and i is equal to one to correspond to said first image.
12. The method of claim 10 , wherein said size of said first area s i is determined by the expression
s
i
=
a
i
n
i
N
S
,
where a i is the weight to be applied to call i, S is the total available display area, n i is the number of participants detected in call (i), N is the total number of video conference participants that are displayed by said first display, and i is equal to one to correspond to said first image.
13. The method of claim 1 , wherein said size of said area within said first display device is adjusted by applying a weighting factor.
14. A video communication system, comprising:
a multipoint control unit;
a first video conference endpoint, including:
a display;
a second video conference endpoint, including:
a camera;
a third video conference endpoint, including:
a camera;
a communication network interconnecting at least said multipoint control unit to said first video conference endpoint, to said second video conference endpoint, and to said third video conference endpoint, wherein a size of a first area of said display of said first video conference endpoint containing an image from said second video conference endpoint is determined with reference to a number of faces included in said image from said second video conference endpoint and a size of a second area of said display of said first video conference endpoint, containing an image from said third video conference endpoint is determined with reference to a number of faces, included in said image from said third video conference endpoint, wherein said image from said second video conference endpoint is determined to contain a first number of faces, wherein said image from said third video conference endpoint is determined to contain a second number of said faces, wherein said first number of faces is greater than said second number of faces, and wherein said size of said first area of said display of said first video conference endpoint containing an image from said second video conference endpoint is greater than a size of said second area of said display of said first video conference endpoint containing an image from said third video conference endpoint.
15. The system of claim 14 , wherein said size of said first area of said display of said first video conference endpoint containing said image from said second video conference endpoint and said size of said second area of said display of said first video conference endpoint containing said image from said third video conference endpoint are determined with reference to a total number of faces included in said image from said second video conference endpoint and said image from said third video conference endpoint.
16. The system of claim 14 , wherein said determination of a size of said first area and a size of said second area is made in connection with instructions running on said multipoint control unit.
17. The system of claim 16 , wherein said multipoint control unit is integrated with said first video conference endpoint.
18. The system of claim 14 , wherein said first video conference endpoint further includes a camera, and wherein each of said second and third video conference endpoints further include a display, wherein an image from said first and third video conference endpoints is displayed by said display included in said second video conference endpoint, and wherein an image from said first and second video conference endpoints is displayed by said display included in said third video conference endpoint.
19. A video conference system, comprising:
means for transferring video communication data;
at a first video conference location, first video conference endpoint means, including:
means for collecting image information from said first video conference location;
means for displaying received image information to persons at said first video conference location;
means for interfacing said first video conference endpoint means to said means for transferring video communication data, wherein video communication data obtained by said means for collecting image information is delivered to said means for transferring video communication data, and wherein video communication data for display by said means for displaying is received from said means for transferring video communication data;
at a second video conference location, second video conference endpoint means, including:
means for collecting image information from said second video conference location;
means for displaying received image information to persons at said second video conference location;
means for interfacing said second video conference endpoint means to said means for transferring video communication data, wherein video communication data obtained by said means for collecting image information is delivered to said means for transferring video communication data, and wherein video communication data for display by said means for displaying is received from said means for transferring video communication data;
at a third video conference location, third video conference endpoint means, including:
means for displaying received image information to persons at said third video conference location;
means for interfacing said third video conference endpoint means to said means for transferring video communication data, wherein video communication data for display by said means for displaying is received from said means for transferring video communication data;
means for formatting video images in communication with said first video endpoint means, including:
means for determining a number of faces included in image information collected by said means for collecting image information of at least said first video conference endpoint means and said second video conference endpoint means; and
means for allocating a first area of a means for displaying received image information collected by at least said first video conference endpoint means and a second area of said means for displaying received image information collected by at least said second video conference endpoint means, wherein said first area and said second area is determined based at least in part on said determined number of faces included in said collected image information.
20. The system of claim 19 , wherein said means for formatting video images is integrated with said first video conference endpoint means.
21. The system of claim 19 , wherein said means for formatting video images further includes means for interfacing to said means for transferring video communication data, wherein said image information is received from said means for transferring video communication data, and wherein information related to an allocated area is provided to at least said second video conference endpoint means.