IP Library Granted Patent US 8,233,206
Granted Patent B2
US 8,233,206 · App. 12/050,527 · Granted Jul 31, 2012

User interaction with holographic images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,233,206
App. No.
12/050,527
Granted
Jul 31, 2012
Kind
B2
Abstract

User input is facilitated through gestural inputs with displayed two and three-dimensional objects using a holographic device and film that displays a static, digitally generated, three-dimensional, autostereoscopic, full-parallax, real image and a digital projector that displays dynamic images. A system includes computer-detectable tags mounted on a user-wearable glove, and on a base plate that holds the holographic device. The system determines the locations of the tags, and calculates a location of a feature of the image based on the locations of the tags. The system also determines the location, pose, and gestural motion of the input device based on the location of the tags. The system further calculates a distance and direction between the input device and the feature of the image.

Claims (54)

1. A system comprising:

a holographic device including a holographic film and displaying a static, digitally generated, three-dimensional, autostereoscopic, full-parallax, real image;

a projection system configured to illuminate the holographic film and to display two-dimensional shapes onto the holographic film;

a first set of one or more tags mounted on at least one input device that is a glove wearable by a user;

a second set of one or more tags mounted on a support system of the holographic device and located with a fixed distance and direction to the image;

a locating system configured to determine locations of the first and second set of tags; and

a processor coupled to the locating system and configured to calculate:

a location of a first feature of the image in response to the location of the second set of tags, and

a distance and direction between the input device and the first feature of the image in response to the location of the first and second sets of tags;

wherein the locating system is further configured to identify an intersection of the input device with the first feature of the image in response to the distance and direction between the input device and the first feature of the image.

2. The system of claim 1 , wherein the first set of tags comprises four first tags located at different locations adjacent to the holographic device.

3. The system of claim 1 , wherein the locating system is further configured to recognize a gestural motion of the input device as a user input.

4. The system of claim 1 , wherein the locating system is further configured to identify one or more of: a first user input in response to the input device being shaped into a gun pose, a second user input in response to the input device being shaped into a gesture comprising a gun pose and a thumb-down motion, a third user input in response to the input device being shaped into a flat-hand pose, or a fourth user input in response to the input device being shaped into an “ok” pose.

5. The system of claim 1 , wherein the locating system is further configured to identify the first feature of the image in response to a user using the input device to point at the first feature of the image.

6. The system of claim 1 , wherein the locating system is further configured to identify the first feature of the image in response to a user using the input device to poke the first feature of the image.

7. The system of claim 6 , wherein the locating system is further configured to identify a second feature of the image in response to a user using the input device to poke the second feature of the image.

8. The system of claim 1 , wherein the input device comprises two or more input devices, usable by two or more users.

9. The system of claim 1 , wherein the input device comprises two gloves wearable by a user.

10. The system of claim 9 , wherein the locating system is further configured to identify a first two-handed user input in response to the input device being manipulated into a first two-handed gesture, and a second two-handed user input in response to the input device being manipulated into a second two-handed gesture.

11. The system of claim 1 , further comprising the projection system configured to display two-dimensional graphics for user feedback in response to a user input through the input device.

12. The system of claim 1 , further comprising an audio output configured to provide audible user feedback in response to a user input through the input device.

13. The system of claim 1 , wherein the holographic film comprises an interference pattern formed by the interaction of an object beam and a reference beam.

14. The system of claim 1 , wherein the second set of tags is located with a fixed distance and direction to first feature of the image.

15. A computer implemented method comprising:

displaying an image using a holographic device including a holographic film, the image consisting of a static, digitally generated, three-dimensional, autostereoscopic, full-parallax, real image;

illuminating the holographic film and displaying two-dimensional shapes onto the holographic film;

detecting a first set of one or more tags mounted on at least one input device that is a glove wearable by a user;

detecting a second set of one or more tags mounted on a support system of the holographic device and located with a fixed distance and direction relative to the image;

determining locations of the first and second set of tags;

calculating a location of a first feature of the image in response to the location of the second set of tags;

calculating a distance and direction between the input device and the first feature of the image in response to the location of the first and second sets of tags; and

identifying an intersection of the input device with the first feature of the image in response to the distance and direction between the input device and the first feature of the image.

16. The method of claim 15 , further comprising:

identifying a user input in response to a gestural motion of the input device.

17. The method of claim 15 , further comprising:

identifying the first feature of the image in response to a user using the input device to point at the first feature of the image.

18. The method of claim 15 , further comprising identifying the first feature of the image in response to a user using the input device to poke the first feature of the image.

19. The method of claim 18 , further comprising:

identifying a second feature of the image in response to a user using the input device to poke the second feature of the image.

20. The method of claim 15 , further comprising:

displaying the two-dimensional shapes onto a tabletop aligned with the image.

21. The method of claim 15 , further comprising:

identifying a first two-handed user input in response to the input device being manipulated into a first two-handed gesture, and a second two-handed user input in response to the input device being manipulated into a second two-handed gesture.

22. The method of claim 15 , further comprising:

providing an audio output in response to a user input through the input device.

23. A non-transitory computer readable medium comprising instructions executable by a processor to perform a method comprising acts of:

displaying an image using a holographic device including a holographic film, the image consisting of a static, digitally generated, three-dimensional, autostereoscopic, full-parallax, real image;

illuminating the holographic film and displaying two-dimensional shapes onto the holographic film;

detecting a first set of one or more tags mounted on at least one input device that is a glove wearable by a user;

detecting a second set of one or more tags mounted on a support system of the holographic device and located with a fixed distance and direction relative to the image;

determining locations of the first and second set of tags;

calculating a location of a first feature of the image in response to the location of the second set of tags;

calculating a distance and direction between the input device and the first feature of the image in response to the location of the first and second sets of tags; and

identifying an intersection of the input device with the first feature of the image in response to the distance and direction between the input device and the first feature of the image.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2020
From: 3D PATENTS, LLC
To: 3D VIRTUÁLIS KINCSTÁR KFT.
Reel/Frame 052887/0276 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2019
From: FOVI3D, INC.
To: 3D PATENTS, LLC
Reel/Frame 050083/0745 →
SECURITY INTEREST Recorded Feb 5, 2019
From: FOVI 3D, INC.
To: NUEVO CAPITAL PARTNERS, L.P.
Reel/Frame 048260/0043 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2017
From: ZEBRA IMAGING, INC.
To: FOVI 3D, INC.
Reel/Frame 042391/0378 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2008
From: KLUG, MICHAEL A.; HOLZBACH, MARK E.; KRAMER, KWINDLA H.; UNDERKOFFLER, JOHN S.
To: ZEBRA IMAGING, INC.
Reel/Frame 020667/0838 →