IP Library › Granted Patent US 8,896,655
Granted Patent B2
US 8,896,655 · App. 12/873,100 · Granted Nov 25, 2014

System and method for providing depth adaptive video conferencing

Inventors: J. William Mauchly (Berwyn, PA); Madhav V. Marathe (Cupertino, CA); Henry Fuchs (Chapel Hill, NC); Jan-Michael Frahm (Chapel Hill, NC)
Assignees: Cisco Technology, Inc.; University of North Carolina at Chapel Hill
H04N7/15H04N5/247H04N5/23238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,896,655
App. No.
12/873,100
Granted
Nov 25, 2014
Kind
B2
Abstract

A method is provided in one example and includes capturing panoramic image data through a first camera in a camera cluster, and capturing close-up image data through a second camera included as part of a spaced array of cameras. The presence of a user in a field of view of the second camera can be detected. The close-up image data and the panoramic image data can be combined to form a combined image. In more specific embodiments, the detecting includes evaluating a distance between the user and the second camera. The combined image can reflect a removal of a portion of panoramic image data associated with the user in a video conferencing environment.

Claims (40)

1. A method, comprising:

capturing panoramic image data through a first camera in a camera cluster, wherein the camera cluster includes the first camera and a plurality of close-up cameras, wherein the panoramic image data includes background imagery, wherein the camera cluster is located on a display wall that includes a plurality of display panels, wherein a close-up region is associated with each display panel in the plurality of display panels, wherein each display panel includes at least one close-up camera from the plurality of close-up cameras to capture close-up image data of the close-up region associated with the display panel when a presence of a user is detected in the close-up region;

capturing close-up image data through a second camera associated with a first display panel when the presence of the user is detected in a close-up region associated with the first display panel, wherein the background imagery is removed from the close-up image data, wherein the second camera is included in the plurality of close-up cameras;

scaling the close-up image data based on a distance between the user and the second camera; and

combining the close-up image data and the panoramic image data to form a combined image.

2. The method of claim 1 , wherein the user is detected in the close-up region by at least evaluating a distance between the user and the second camera.

3. The method of claim 1 , wherein the combined image reflects a matting of the close-up image data onto the panoramic image data.

4. The method of claim 1 , further comprising:

communicating the combined image over a network connection to a remote location, wherein the remote location receives and displays the combined image.

5. The method of claim 1 , further comprising:

adjusting a field of view of the second camera based on a detected distance of the user from the second camera.

6. The method of claim 5 , wherein the field of view of the second camera is adjusted by adjusting a zoom of the second camera.

7. Logic encoded in one or more non-transitory tangible media that includes code for execution and when executed by a processor operable to perform operations comprising:

capturing panoramic image data through a first camera in a camera cluster, wherein the camera cluster includes the first camera and a plurality of close-up cameras, wherein the panoramic image data includes background imagery, wherein the camera cluster is located on a display wall that includes a plurality of display panels, wherein a close-up region is associated with each display panel in the plurality of display panels, wherein each display panel includes at least one close-up camera from the plurality of close-up cameras to capture close-up image data of the close-up region associated with the display panel when a presence of a user is detected in the close-up region;

capturing close-up image data through a second camera associated with a first display panel when the presence of the user is detected in a close-up region associated with the first display panel, wherein the background imagery is removed from the close-up image data, wherein the second camera is included in the plurality of close-up cameras;

scaling the close-up image data based on a distance between the user and the second camera; and

combining the close-up image data and the panoramic image data to form a combined image.

8. The logic of claim 7 , wherein the user is detected in the close-up region by at least evaluating a distance between the user and the second camera.

9. The logic of claim 7 , wherein the combined image reflects a matting of the close-up image data onto the panoramic image data.

10. The logic of claim 7 , the operations further comprising:

communicating the combined image over a network connection to a remote location, wherein the remote location receives and displays the combined image.

11. The logic of claim 7 , the operations further comprising:

adjusting a field of view of the second camera based on a detected distance of the user from the second camera.

12. An apparatus, comprising:

a memory element configured to store data,

a processor operable to execute instructions associated with the data, and

a view synthesis module, the apparatus being configured to:

capture panoramic image data through a first camera in a camera cluster, wherein the camera cluster includes the first camera and a plurality of close-up cameras, wherein the panoramic image data includes background imagery, wherein the camera cluster is located on a display wall that includes a plurality of display panels, wherein a close-up region is associated with each display panel in the plurality of display panels, wherein each display panel includes at least one close-up camera from the plurality of close-up cameras to capture close-up image data of the close-up region associated with the display panel when a presence of a user is detected in the close-up region;

capture close-up image data through a second camera associated with a first display panel when the presence of the user is detected in a close-up region associated with the first display panel, wherein the background imagery is removed from the close-up image data, wherein the second camera is included in the plurality of close-up cameras;

scale the close-up image data based on a distance between the user and the second camera; and

combine the close-up image data and the panoramic image data to form a combined image.

13. The apparatus of claim 12 , wherein the user is detected in the close-up region by at least evaluating a distance between the user and the second camera.

14. The apparatus of claim 12 , wherein the combined image reflects a matting of the close-up image data onto the panoramic image data.

15. The apparatus of claim 12 , the apparatus being further configured to:

communicate the combined image over a network connection to a remote location, wherein the remote location receives and displays the combined image.

16. The method of claim 1 , where a field of view of each camera in the camera cluster does not overlap with another field of view of another camera in the camera cluster.

17. The method of claim 1 , wherein the close-up image data captures a standing image of the user.

18. The method of claim 1 , wherein the combined image includes a consistent perspective view of a room that includes the plurality of display panels.

19. The method of claim 1 , wherein the plurality of display panels includes the first display panel and a second display panel and the method further comprises:

capturing close-up image data through a third camera associated with the second display panel when the presence of a second user is detected in a close-up region associated with the second display panel, wherein the background imagery is removed from the close-up image data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2010
From: MAUCHLY, J. WILLIAM; MARATHE, MADHAV V.
To: CISCO TECHNOLOGY, INC.
Reel/Frame 024920/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2010
From: FUCHS, HENRY; FRAHM, JAN-MICHAEL
To: UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL
Reel/Frame 024920/0563 →
Continuity (1)
Related Publication 20120050458A1 · Mar 1, 2012