Systems and methods for using sensing of real object position, trajectory, or attitude to enable user interaction with a virtual object

1. A system comprising:

at least one of a position sensor or tracker configured to detect boundaries of at least a partially transparent, real object within a three-dimensional coordinate system; and

a computing device configured to:

track positions of the detected boundaries of the real object within the three-dimensional coordinate system;

control a position of a virtual object within the three-dimensional coordinate system;

determine whether the position of the virtual object is within the positions of the detected boundaries of the real object in the three-dimensional coordinate system; and

in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object:

enable user interaction with the virtual object via user interface; and

receive input via the user interface for interacting with the virtual object.

2. The system of claim 1 , wherein the at least one position sensor or tracker is configured to detect a position of the real object within the three-dimensional coordinate system, and

wherein the computing device is communicatively connected to the at least one position sensor or tracker for receipt of the detected position of the real object.

3. The system of claim 1 , further comprising at least one orientation sensor or tracker configured to detect an orientation of the real object within the three-dimensional coordinate system, and

wherein the computing device is configured to:

track the detected orientation of the real object within the three-dimensional coordinate system; and

in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object, orient the virtual object to correspond to the detected orientation of the real object.

4. The system of claim 1 , wherein the computing device is configured to:

track movement of the real object based on the tracked positions of the detected boundaries of the real object; and

in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object, move the virtual object to correspond to the tracked movement of the real object.

5. The system of claim 1 , further comprising one or more rumble packs and/or one or more motion systems that are attached to the real object and used in conjunction with physics simulations to provide an ecologically valid simulation of the interaction of the virtual object with the real object.

6. The system of claim 1 , further comprising a display, and

wherein the computing device is operatively connected to the display and configured to control the display to display the virtual object at their respective positions within the three-dimensional coordinate system.

7. The system of claim 6 , wherein the computing device is configured to:

manage an augmented reality environment that is mapped by the three-dimensional coordinate system; and

control the display such that the virtual object and real object are seen from a user's perspective within the augmented reality environment.

8. The system of claim 7 , wherein the display is operatively configured within a world-fixed display, and

wherein the system further comprises:

one of a plurality of projectors or a plurality of monitors configured to render the virtual reality environment; and

the user wears stereoscopic glasses, or the display is autostereoscopic.

9. The system of claim 1 , wherein the computing device is configured to disable user interaction with the virtual object via the user interface.

10. The system of claim 9 , wherein the computing device is configured to disable the user interaction in response to receipt of a predetermined input into the user interface.

11. The system of claim 10 , wherein the predetermined input comprises one of a tap input, a shake input, and a voice command.

12. The system of claim 1 , further comprising one of a display or projector configured to project the virtual object onto a surface for view by the user, and

wherein the computing device control the display or projector to display the virtual object on the surface at a position such that the virtual object appears within the positions of the detected boundaries of the real object.

13. The system of claim 1 , wherein the at least one position sensor or tracker is attached to or remote from the real object.

14. The system of claim 1 , wherein the real object is cuboid or spherical in shape.

15. The system of claim 1 , wherein the real object comprises walls made of transparent material, and wherein the walls define an interior space containing air, other gases, or vacuum.

16. The system of claim 1 , wherein the computing device is configured to enable the user interaction in response to receipt of a predetermined input into the user interface.

17. The system of claim 16 , wherein the predetermined input comprises one of a tap input, a shake input, and a voice command.

18. The system of claim 16 , wherein the predetermined input comprises one of a tap input to the real object and a shake input to the real object.

19. The system of claim 1 , wherein refractive distortions due to transparent material of the real object are corrected using real-time dewarping.

20. A method comprising:

using at least one position sensor to detect boundaries of at least a partially transparent, real object within a three-dimensional coordinate system; and

tracking positions of the detected boundaries of the real object within the three-dimensional coordinate system;

tracking a position of a virtual object within the three-dimensional coordinate system;

determining whether the position of the virtual object is within the positions of the detected boundaries of the real object in the three-dimensional coordinate system; and

in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object:

enabling user interaction with the virtual object via user interface; and

receiving input via the user interface for interacting with the virtual object.

21. The method of claim 20 , wherein the at least one sensor is attached to the real object.

22. The method of claim 20 , further comprising:

using at least one orientation sensor to detect an orientation of the real object within the three-dimensional coordinate system;

tracking the detected orientation of the real object within the three-dimensional coordinate system; and

orienting the virtual object to correspond to the detected orientation of the real object in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object.

23. The method of claim 20 , further comprising:

tracking movement of the real object based on the tracked positions of the detected boundaries of the real object; and

moving the virtual object to correspond to the tracked movement of the real object in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object.

24. The method of claim 20 , further comprising using a display to display the virtual object at their respective positions within the three-dimensional coordinate system.

25. The method of claim 24 , further comprising:

managing an augmented reality environment that is mapped by the three-dimensional coordinate system; and

controlling the display to display the real object and the virtual object from a user's perspective within the augmented reality environment.

26. The method of claim 25 , wherein the display is operatively configured within a world-fixed display,

wherein the user wears stereoscopic glasses or the display is autostereoscopic, and

wherein the method comprising rendering the virtual reality environment using one of a plurality of projectors or a plurality of monitors.

27. The method of claim 20 , further comprising enabling the user interaction in response to receipt of a predetermined input into the user interface.

28. The method of claim 27 , wherein the predetermined input comprises one of a tap input, a shake input, and a voice command.

29. The method of claim 27 , wherein the predetermined input comprises one of a tap input to the real object and a shake input to the real object.

30. The method of claim 20 , further comprising disabling user interaction with the virtual object via the user interface.

31. The method of claim 30 , further comprising disabling the user interaction in response to receipt of a predetermined input into the user interface.

32. The method of claim 31 , wherein the predetermined input comprises one of a tap input, a shake input, and a voice command.

33. The method of claim 20 , further comprising:

using one of a display or projector to project the virtual object onto a surface for view by the user; and

controlling the display or projector to display the virtual object on the surface at a position such that the virtual object appears within the positions of the detected boundaries of the real object.

34. The method of claim 20 , further comprising using the at least one of position sensor and tracker to detect a position of the real object within the three-dimensional coordinate system.

35. The method of claim 20 , wherein the real object is cuboid in shape.

36. The method of claim 20 , wherein the real object comprises walls made of transparent material, and wherein the walls define an interior space containing air, gas, or vacuum.

37. A system comprising:

at least one of a position sensor or tracker configured to detect boundaries of at least a partially transparent, real object within a three-dimensional coordinate system; and

a computing device configured to:

track positions of the detected boundaries of the real object within the three-dimensional coordinate system;

control a position of a virtual object within the three-dimensional coordinate system;

determine whether the position of the virtual object is within the positions of the detected boundaries of the real object in the three-dimensional coordinate system; and

in response to determining that the position of the virtual object with respect to the positions of the detected boundaries of the real object meet the predetermined criteria:

enable user interaction with the virtual object via user interface; and

receive input via the user interface for interacting with the virtual object.

38. The system of claim 37 , wherein the real object is cuboid in shape, and

wherein the computing device is configured to:

determine that the virtual object is positioned on a top surface of the real object;

in response to determining that the virtual object is positioned on the top surface of the real object:

enable the user interaction with the virtual object via user interface; and

receive the input via the user interface for interacting with the virtual object.

39. The method of claim 37 , wherein the real object is cuboid in shape, and wherein the computing device is configured to:

determine that the virtual object is positioned on a top surface of the real object;

in response to determining that the virtual object is positioned on the top surface of the real object:

enabling the user interaction with the virtual object via user interface; and

receiving the input via the user interface for interacting with the virtual object.

40. A method comprising:

using at least one position sensor to detect boundaries of at least a partially transparent, real object within a three-dimensional coordinate system; and

tracking positions of the detected boundaries of the real object within the three-dimensional coordinate system;

tracking a position of a virtual object within the three-dimensional coordinate system;

determining whether the position of the virtual object is within the positions of the detected boundaries of the real object in the three-dimensional coordinate system; and

in response to determining that the position of the virtual object is within the positions of the detected boundaries of the real object:

enabling user interaction with the virtual object via user interface; and

receiving input via the user interface for interacting with the virtual object.