IP Library Granted Patent US 7,825,948
Granted Patent B2
US 7,825,948 · App. 10/216,412 · Granted Nov 2, 2010

3D video conferencing

Assignee: Koninklijke Philips Electronics N.V.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,825,948
App. No.
10/216,412
Granted
Nov 2, 2010
Kind
B2
Abstract

A 3D video conferencing station includes a video camera for capturing video signals and a depth map calculator for creating a depth map of a user of the 3D video conferencing station. The video signals together with the depth map are transmitted as 3D video data. A stereoscopic display device displays stereo images, which are calculated on the basis of received 3D video data. The depth map which is generated by the depth map calculator is also used for estimating the position of the user in order to control the calculation of the stereo images.

Claims (27)

1. A 3D video conferencing station comprising:

a video camera for capturing video signals;

depth means for creating a depth map of a user of the 3D video conferencing station;

a transmitter for transmitting 3D video data which is based on the video signals and the depth map depth-image-based rendering;

a processor for comparing depth values of the depth map with a model for detecting a position of at least a part of the user; and

a stereoscopic display device for displaying stereo images, which are calculated on the basis of the detected position, the depth map and received video signals, wherein the depth means are arranged to receive a signal from a depth sensor which is registered with the camera.

2. The 3D video conferencing station as claimed in claim 1 , wherein the depth means are designed to create the depth map on the basis of the video signals.

3. The 3D video conferencing station as claimed in claim 1 , wherein the processor detects the position of the part of the user, the part being a nose of the user.

4. The 3D video conferencing station as claimed in claim 3 , wherein the processor is designed to detect the position of the nose of the user of the 3D video conferencing station by searching for a maximum or a minimum depth value of the depth map.

5. The 3D video conferencing station as claimed in claim 3 , wherein the processor is designed to detect the position of the nose of the user of the 3D video conferencing station by comparing depth values of the depth map with the model of a human face.

6. The 3D video conferencing station as claimed in claim 3 , wherein the processor is designed to detect a first position of a left eye and a second position of a right eye based on the position of the nose of the user of the 3D video conferencing station.

7. The 3D video conferencing station as claimed in claim 6 , wherein the processor is designed to detect the first position of the left eye and the second position of the right eye based on the video signals.

8. The 3D video conferencing station as claimed in claim 1 , wherein the part of the user is a head, the processor being operative to detect an orientation of the head of the user by calculating an average derivative of depth values of a region of the depth map that corresponds with a part of a face of the user to detect an orientation of a head of the user by calculating an average derivative of depth values of a region of the depth map that corresponds with a part of a face of the user.

9. A 3D video conferencing method comprising:

capturing video signals;

creating a depth map of a user of the 3D video conferencing station;

transmitting 3D video data which is based on the video signals and the depth map;

comparing depth values of the depth map with a model to detect a position of at least a part of the user; and

displaying stereo images, which are calculated on the basis of the detected position of at least the part of the user and received video signals, wherein depth means are arranged to receive a signal from a depth sensor which is registered with a camera.

10. A video conferencing system comprising:

a camera configured to image a local user and output video signals representing said local user;

a depth calculator configured to calculate a depth map of said local user based on said video signals;

a transmitter configured to transmit three dimensional video data of said local user, said three dimensional video data being obtained from said video signals and said depth map;

a processor configured to track a position of said local user based on said depth map;

a receiver configured to receive video information of a remote user;

a stereo image generator configured to form a stereo image signal of said remote user from said video information of the remote user and in dependence of said position of said local user, said position being determined based on said depth map; and

a display configured to display a three dimensional image of said remote user in response to said stereo image signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2002
From: VAN GEEST, BARTOLOMEUS WILHELMUS DAMIANUS; OP DE BEECK, MARC JOSEPH RITA
To: KONINKLIJKE PHILIPS ELECTRONICS N.V.
Reel/Frame 013358/0066 →
Priority Claims (1)
EP 01203108 · Aug 15, 2001 · regional
Continuity (1)
Related Publication 20030035001A1 · Feb 20, 2003