Binaural horizontal perspective hands-on simulator
The present invention hands-on simulator system discloses a three dimension display system comprising a three dimensional horizontal perspective display and a 3-D audio system such as binaural simulation to lend realism to the three dimensional display. The three dimensional display system can futher comprise a second display, together with a curvilinear blending display section to merge the various images. The multi-plane display surface can accommodate the viewer by adjusting the various images and 3-D sound according to the viewer's eyepoint and earpoint locations. The present invention hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools.
1 . A method for 3-D horizontal perspective simulation by horizontal perspective projection, the horizontal perspective projection comprising displaying horizontal perspective images according to a predetermined projection eyepoint, the method comprising the steps of:
displaying a 3-D image onto an open space of a first display surface using horizontal perspective;
presenting 3-D sound to a predetermined projection earpoint corresponding to the 3-D image; and
manipulating the display image on the first display surface by touching the 3-D image with a peripheral device.
2 . A method for 3-D horizontal perspective simulation by horizontal perspective projection, the horizontal perspective projection comprising displaying horizontal perspective images according to a predetermined projection eyepoint, the method comprising the steps of:
displaying a 3-D image onto an open space of a first display surface using horizontal perspective;
display a second image onto a second display;
presenting 3-D sound to a predetermined projection earpoint corresponding to the 3-D image; and
manipulating the display image on the first display surface by touching the 3-D image with a peripheral device.
3 . A method as in claim 2 wherein presenting 3-D sound comprises outputting two channel sound through a HRTF (head related transfer function) filter.
4 . A method as in claim 2 wherein presenting 3-D sound comprises outputting sound through a 3-D loudspeaker audio system or a 3-D headphone audio system.
5 . A method as in claim 2 further comprising the step of taking an input from the second display and providing output to the first horizontal perspective display.
6 . A method as in claim 2 further comprising a step of tracking the physical peripheral device to the 3-D image.
7 . A method as in claim 6 wherein tracking the peripheral device comprises tracking a tip of the peripheral device.
8 . A method as in claim 6 wherein the peripheral device tracking comprises inputting the position of the peripheral device to the processing unit.
9 . A method as in claim 6 wherein the peripheral device tracking comprises a step of triangulation or infrared tracking.
10 . A method as in claim 2 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.
11 . A method as in claim 2 wherein the horizontal perspective display is a stereoscopic horizontal perspective display using horizontal perspective to display a stereoscopic 3-D image.
12 . A method as in claim 2 further comprising a step of automatic or manual eyepoint tracking for the horizontal perspective display.
13 . A method as in claim 12 further wherein the eyepoint tracking further acts as an earpoint tracking.
14 . A method as in claim 2 further comprising a step of automatic or manual earpoint tracking for the 3-D sound projection.
15 . A method as in claim 2 further comprising a step of zooming, rotating or moving the 3-D image.
16 . A method as in claim 2 wherein manipulating the display image by the peripheral device comprises tracking a tip of the peripheral device.
17 . A method as in claim 16 wherein the manipulation comprises the action of modifying the display image or the action of generating a different image.
18 . A 3-D simulation method using a 3-D horizontal perspective simulator system, the 3-D horizontal perspective simulator system comprising
a processing unit;
a first horizontal perspective display using horizontal perspective to display a 3-D image onto an open space;
a second display showing information related to the 3-D image;
a 3-D audio simulation system providing 3-D sound to a predetermined projection earpoint;
a peripheral device to manipulate the display image by touching the 3-D image; and
a peripheral device tracking unit for mapping the peripheral device to the 3-D image;
the method comprising
calibrating the peripheral device;
displaying a first 3-D image onto an open space of the first display surface using horizontal perspective;
displaying a second image onto the second display;
presenting 3-D sound corresponding to the 3-D image;
tracking the peripheral device; and
manipulating the display image by touching the 3-D image with the peripheral device.
19 . A method as in claim 18 wherein the 3-D audio simulation system comprises two sound channels and a HRTF (head related transfer function) filter.
20 . A method as in claim 18 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.