Granted Patent B1

US 9,936,163 · App. 15/286,356 · Granted Apr 3, 2018

Inventors: Eyal Lubelsky (Kiryat Ono, IL); Yoel Popovich (Hadera, IL); Ami Sanado (Kibutz Hahotrim, IL); Ilan Dayan (Gadera, IL); Azaria Cohen (Maale Levona, IL); Tamar Barzuza (Tel Aviv, IL)

Assignee: Avaya Inc.

H04N7/147G06T5/50H04N5/23238H04N5/23296H04N5/265H04N5/2628H04N7/142H04N7/15G06T2207/10012H04N5/23219

Abstract

Claims (30)

1. A video-enabled communication system, comprising:

a control unit, coupled with a camera, the camera acquiring an image of an object of interest during a video communication session, wherein the control unit comprises:

a processor; and

a computer readable medium comprising a mirror selector that causes the processor to select, from among multiple possible images in multiple mirrors that can be or have been captured by the camera, a reflected image of the object of interest for provision to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in at least one of the multiple mirrors having a line-of-sight to the camera.

2. The system of claim 1 , wherein the at least one of the multiple mirrors is positioned transverse to an optical axis of the camera, wherein the processor bases the reflected image selection on information describing a local participant and/or context of the video communication session and wherein the processor, at a first time, selects a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint and, at a second time, selects the reflected image of the object of interest to provide to the remote endpoint.

3. The system of claim 2 , wherein the object of interest is a local participant, wherein, at the first time, the local participant is facing the camera and, at the second time, the local participant is facing the at least one of the multiple mirrors.

4. The system of claim 1 , wherein the processor, at a first time, selects a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint and, at a second time, selects the reflected image of the object of interest to provide to the remote endpoint, wherein the camera is a wide angle and high resolution digital camera, and wherein the non-reflected image and reflected image are extracted, at different times, from image information captured by a field of view of the camera at common pan, tilt, and zoom settings.

5. The system of claim 1 , wherein the processor controls a pan, tilt, or zoom of the camera based on an electronic mirror map for the multiple mirrors comprising one or more of a mirror location defined by set of spatial coordinates, a mirror type, mirror size, and angle of a mirror relative to an optical axis of the camera and wherein the object of interest is a presentation on a presentation surface.

6. The system of claim 4 , wherein the processor, at the first time, substitutes a selected image for the reflected image in the image information captured by the field of view of the camera.

7. The system of claim 1 , wherein the processor upscales and/or enlarges the reflected image of the object of interest to resemble a size of the object of interest in a non-reflected image captured by the camera, wherein the object of interest is an item on a table or desk, and wherein the at least one of the multiple mirrors is positioned on a horizontal surface of the table or desk to reflect, for capture by the camera, the reflected of the item.

8. A method for controlling a camera during a video communication session, comprising:

selecting, by a processor, from among multiple possible images that can be or have been captured by the camera, a reflected image of an object of interest for provision to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in a mirror having a line-of-sight to the camera;

selecting, by the processor, at a first time, a non-reflected image of the object of interest captured by the camera for provision to the remote endpoint;

selecting, by the processor, at a second time, the reflected image of the object of interest to provide to the remote endpoint, wherein the camera is a wide angle and high resolution digital camera and wherein the non-reflected image and reflected image are extracted, at different times, from image information captured by a field of view of the camera at common pan, tilt, and zoom settings; and

providing, by the processor during the video communication session, the reflected image to the remote endpoint.

9. The method of claim 8 , wherein the mirror is positioned transverse to an optical axis of the camera, wherein the processor bases the reflected image selection on information describing a local participant and/or context of the video communication session.

10. The method of claim 9 , wherein the object of interest is a local participant, and wherein, at the first time, the local participant is facing the camera and, at the second time, the local participant is facing the mirror.

11. The method of claim 8 , further comprising:

controlling, by the processor, a pan, tilt, or zoom of the camera based on an electronic mirror map comprising one or more of a mirror location defined by set of spatial coordinates, a mirror type, mirror size, and angle of the mirror relative to an optical axis of the camera and wherein the object of interest is a presentation on a presentation surface.

12. The method of claim 8 , wherein the processor, at the first time, substitutes a selected image for the reflected image in the image information captured by the field of view of the camera.

13. The method of claim 8 , wherein the processor upscales and/or enlarges the reflected image of the object of interest to resemble a size of the object of interest in a non-reflected image captured by the camera, wherein the object of interest is an item on a table or desk, and wherein the mirror is positioned on a horizontal surface of the table or desk to reflect, for capture by the camera, the reflected image of the object.

14. A video-enabled communication system, comprising:

a processor, coupled with a camera, the camera acquiring an image of an object of interest during a video communication session; and

a computer readable medium, coupled with the processor, comprising instructions that cause the processor to select a reflected image of the object of interest for use in providing image information to a remote endpoint for display to another participant, wherein the reflected image is a reflection of the object of interest in a mirror having a line-of-sight to the camera and wherein the processor extracts the reflected image from a common image captured by the camera, the common image including a non-reflected image of an object other than the object of interest.

15. The system of claim 14 , wherein the reflected image is used as an input to generate a three-dimensional image of the object of interest and wherein the image information comprises the three-dimensional image.

16. The system of claim 15 , wherein the processor superimposes, on the reflected image, a second image of the object of interest to generate the three-dimensional image and wherein the reflected image and second image of the object of interest are captured at a same time by the camera.

17. The system of claim 14 , wherein the processor uses the reflected image to correct image distortion in the image information.

18. The system of claim 14 , wherein the object of interest is a participant and wherein the processor uses face detection and motion detection analysis of the reflected image to determine that the object of interest is an active speaker.

19. The system of claim 14 , wherein the image information comprises the reflected image.

20. The system of claim 1 , wherein the processor uses the reflected image to correct image distortion in the image information.

Assignments (17)