IMMERSIVE DISPLAY SYSTEM FOR INTERACTING WITH THREE-DIMENSIONAL CONTENT
A system for displaying three-dimensional (3-D) content and enabling a user to interact with the content in an immersive, realistic environment is described. The system has a display component that is non-planar and provides the user with an extended field-of-view (FOV), one factor in the creating the immersive user environment. The system also has a tracking sensor component for tracking a user face. The tracking sensor may include one or more 3-D and 2-D cameras. In addition to tracking the face or head, it may also track other body parts, such as hands and arms. An image perspective adjustment module processes data from the face tracking and enables the user to perceive the 3-D content with motion parallax. The hand and other body part output data is used by gesture detection modules to detect collisions between the user's hand and 3-D content. When a collision is detected, there may be tactile feedback to the user to indicate that there has been contact with a 3-D object. All these components contribute towards creating an immersive and realistic environment for viewing and interacting with 3-D content.
1 . A system for displaying three-dimensional (3-D) content, the system comprising:
a non-planar display component;
a tracking sensor component for tracking a user face and outputting face tracking output data; and
an image perspective adjustment module for processing face tracking output data, thereby enabling a user to perceive the 3-D content with motion parallax.
2 . A system as recited in claim 1 wherein the tracking sensor component further comprises at least one 3-D camera.
3 . A system as recited in claim 1 wherein the tracking sensor component further comprises at least one two-dimensional (2-D) camera.
4 . A system as recited in claim 1 wherein the tracking sensor component further comprises at least one 3-D camera and at least one 2-D camera.
5 . A system as recited in claim 1 wherein the non-planar display component further comprises two or more planar display monitors in a non-planar arrangement.
6 . A system as recited in claim 5 wherein a planar display monitor is a self-emitting display monitor.
7 . A system as recited in claim 1 wherein the non-planar display component further comprises one or more non-planar display monitors.
8 . A system as recited in claim 7 wherein the non-planar display monitor is a projection display monitor.
9 . A system as recited in claim 1 further comprising:
a display space calibration module for coordinating two or more images displayed on the non-planar display component.
10 . A system as recited in claim 9 wherein the display space calibration module processes non-planar display angle data relating to two or more non-planar display monitors.
11 . A system as recited in claim 1 wherein the non-planar display component provides a curved display space.
12 . A system as recited in claim 1 wherein the image perspective adjustment module enables adjustment of 3-D content images displayed on the non-planar display component, wherein said image adjustment depends on a user head position.
13 . A system as recited in claim 1 further comprising:
a tactile feedback controller in communication with at least one vibro-tactile actuator, the actuator providing tactile feedback to the user when a collision between the user hand and the 3-D content is detected.
14 . A system as recited in claim 13 wherein the at least one vibro-tactile actuator is a wrist bracelet.
15 . A system as recited in claim 1 further comprising a multi-display controller.
16 . A system as recited in claim 1 wherein the tracking sensor component tracks a user body part and outputs body part tracking output data.
17 . A system as recited in claim 16 further comprising a gesture detection module for processing the body part tracking output data.
18 . A system as recited in claim 17 further comprising a body part collision module for processing the body part tracking output data.
19 . A system as recited in claim 16 wherein the body part tracking output data includes user body part location data with reference to displayed 3-D content and is transmitted to the tactile feedback controller.
20 . A system as recited in claim 16 wherein the tracking sensor component determines a position and an orientation of the user body part in a 3-D space by detecting a plurality of features of the user body part.
21 . A method of providing an immersive user environment for interacting with 3-D content, the method comprising:
displaying the 3-D content on a non-planar display component;
tracking user head position, thereby creating head tracking output data; and
adjusting a user perspective of 3-D content according to the user head tracking output data, such that the user perspective of 3-D content changes in a natural manner as a user head moves when viewing the 3-D content on the non-planar display component.
22 . A method as recited in claim 21 further comprising:
detecting a collision between a user body part and the 3-D content.
23 . A method as recited in claim 21 wherein detecting a collision further comprises providing tactile feedback.
24 . A method as recited in claim 22 further comprising:
determining a location of the user body part with reference to 3-D content location.
25 . A method as recited in claim 21 further comprising:
detecting a user gesture with reference to the 3-D content, wherein the 3-D content is modified based on the user gesture.
26 . A method as recited in claim 25 wherein modifying 3-D content further comprises deforming the 3-D content.
27 . A method as recited in claim 21 further comprising:
tracking a user body part to determine a position of the body part.
28 . A method as recited in claim 21 further comprising receiving 3-D content coordinates.
29 . A method as recited in claim 22 further comprising enabling manipulation of the 3-D content when a user body part is visually aligned with the 3-D content from the user perspective.
30 . A method as recited in claim 21 wherein displaying the 3-D content on a non-planar display component further comprises:
providing an extended horizontal field-of-view to a user when viewing the 3-D content on the non-planar display component.
31 . A method as recited in claim 21 wherein displaying the 3-D content on a non-planar display component further comprises:
providing an extended vertical field-of-view to a user when viewing the 3-D content on the non-planar display component.
32 . A system for providing an immersive user environment for interacting with 3-D content, the system comprising:
means for displaying the 3-D content;
means for tracking user head position, thereby creating head tracking output data; and
means for adjusting a user perspective of 3-D content according to the user head tracking output data, such that the user perspective of 3-D content changes in a natural manner as a user head moves when viewing the 3-D content.
33 . A system as recited in claim 32 further comprising:
means for detecting a collision between a user body part and the 3-D content.
34 . A system as recited in claim 33 wherein the means for detecting a collision further comprises means for providing tactile feedback.
35 . A system as recited in claim 33 further comprising:
means for determining a location of the user body part with reference to 3-D content location.
36 . A system as recited in claim 32 further comprising:
means for detecting a user gesture with reference to the 3-D content, wherein the 3-D content is modified based on the user gesture.
37 . A computer-readable medium storing computer instructions for providing an immersive user environment for interacting with 3-D content in a 3-D viewing system, the computer-readable medium comprising:
computer code for displaying the 3-D content on a non-planar display component;
computer code for tracking user head position, thereby creating head tracking output data; and
computer code for adjusting a user perspective of 3-D content according to the user head tracking output data, such that the user perspective of 3-D content changes in a natural manner as a user head moves when viewing the 3-D content on the non-planar display component.
38 . A computer-readable medium as recited in claim 37 further comprising:
computer code for detecting a collision between a user body part and the 3-D content.
39 . A computer-readable medium as recited in claim 38 wherein computer code for detecting a collision further comprises computer code for providing tactile feedback.
40 . A computer-readable medium as recited in claim 37 further comprising:
computer code for determining a location of the user body part with reference to 3-D content location.
41 . A computer-readable medium method as recited in claim 37 further comprising:
computer code for detecting a user gesture with reference to the 3-D content, wherein the 3-D content is modified based on the user gesture.