Method and apparatus maintaining eye contact in video delivery systems using view morphing
View Patent ↗A view morphing algorithm is applied to synchronous collections of video images from at least two video imaging devices, and interpolating between the images, creates a composite image view of the local participant. This composite image approximates what might be seen from a point between the video imaging devices, presenting the image to other video session participants.
1. An apparatus that conveys eye contact with a conference participant, comprising:
means for generating a composite image of said participant receiving at least two images of said participant;
wherein each image is comprised of a two-dimensional array of pixels;
wherein said means for generating said composite image is comprised of:
means for calculating at least one dense correspondence to determine a displacement in at least a first dimension for each of said pixels in at least one first of said images;
means for generating an interpolated image based upon said at least one dense correspondence for each of said at least two images; and
means for combining at least two of said interpolated images by using an averaging scheme to create said composite image.
2. The apparatus of claim 1 , wherein said means for generating said interpolated image further comprises:
means for displacing each of said pixels in said image pixel arrays by a partial displacement in at least a first dimension.
3. The apparatus of claim 1 , wherein said means for combining said interpolated images, is further comprised of:
means for combining corresponding pixels in said at least a second dimension to create said composite image pixel;
wherein a sum of said partial displacements of said images is approximately equal to said displacement.
4. The apparatus of claim 1 , further comprising:
means for applying a rectifying transformation to said image.
5. The apparatus of claim 1 , further comprising:
means for warping said image by said partial displacement to modify said image.