Interactive instruments and other striking objects
Systems, methods, and devices for providing interactive striking objects (e.g., drumsticks) and performing actions in response to striking motions of the striking objects are disclosed. In some embodiments, the systems and methods provide an interactive drumstick, which includes a lighting display located at a tip portion of the interactive drumstick, a motion detector contained at least partially within the drumstick, a processor and memory contained at least partially within the drumstick, and an interactive system stored within the memory of the drumstick. The interactive system includes a striking motion module that determines striking motions of the drumstick with respect to a virtual percussion instrument based on accessing information measured by the motion detector, and a display module that causes the lighting display to present a certain type of illumination based on the striking motions determined by the striking motion module.
1. A device comprising:
a motion detector contained at least partially within the device;
a processor and memory contained at least partially within the device; and
an interactive system stored within the memory of the device, wherein the interactive system comprises:
a device state module that measures a state of motion of the device relative to a virtual strike location for a virtual strike of a virtual object to be performed by the device;
a strike prediction module that determines a predicted time at which a virtual striking portion of the device arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion; and
a haptic feedback module synchronized with the strike prediction module to provide haptic feedback to a user at the predicted time at which the virtual striking portion of the device arrives at the virtual strike location.
2. The device of claim 1 , wherein the strike prediction module:
measures, from the state of motion of the device relative to the virtual strike location, a current acceleration and trajectory of the device within three-dimensional space with respect to the virtual strike location of the virtual object; and
determines the predicted time as a time at which the virtual striking portion of the device is predicted to arrive at the virtual strike location based on the current acceleration and trajectory of the device with respect to the virtual strike location.
3. The device of claim 1 , wherein the strike prediction module determines the predicted time as a time at which the state of motion of the device is associated with the virtual striking portion decelerating to approximately zero proximate to the virtual strike location of the virtual object.
4. The device of claim 1 , wherein the strike prediction module determines the predicted time as a time at which a trajectory of the device within three-dimensional space with respect to the virtual strike location of the virtual object is predicted to change from a first direction towards the virtual strike location of the virtual object to a second direction away from the virtual strike location of the virtual object.
5. The device of claim 1 , wherein the interactive system stored within the memory of the device further comprises:
a communication module that communicates a message from the strike prediction module to the haptic feedback module before the virtual striking portion of the device arrives at the virtual strike location of the virtual object, the message comprising information representing the predicted time and information representing the state of motion of the device.
6. The device of claim 1 , wherein the device is in communication over a network with a mobile device, an audio presentation device, and/or a gaming system.
7. The device of claim 1 , wherein the device comprises a wand, a mobile device, an audio presentation device, a gaming system, and/or is cloud based.
8. The device of claim 1 , wherein the device is worn on or is attached to the user.
9. The device of claim 1 , wherein the device fits in, is worn on, and/or is attached to a hand of the user.
10. The device of claim 1 , wherein the virtual striking portion is a virtual extension of the device.
11. A method, comprising:
measuring a state of motion of a device relative to a virtual strike location for a virtual strike of a virtual object at the virtual strike location;
determining a predicted time at which a virtual striking portion of the device arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion of the device;
performing a remote action associated with a striking object striking an object at the predicted time delayed by a first time to compensate for a communications delay associated with the virtual strike; and
performing a local action associated with the striking object striking the object at the predicted time delayed by a second time that is less than the first time.
12. The method of claim 11 , wherein determining the predicted time at which a virtual striking portion of the device arrives at the virtual strike location for a virtual strike of the virtual object based on the state of motion of the device comprises:
measuring, from the state of motion of the device relative to the virtual strike location, a current acceleration and trajectory of the device within three-dimensional space with respect to the virtual strike location of the virtual object; and
determining the predicted time as a time at which a virtual strike portion of the device is estimated to arrive at the virtual strike location based on the current acceleration and trajectory of the device with respect to the virtual strike location.
13. The method of claim 11 , wherein determining the predicted time at which the virtual striking portion of the device arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion of the striking object includes determining the predicted time as a time at which the state of motion of the device is associated with the device decelerating to approximately zero when proximate to the virtual strike location of the virtual object.
14. The method of claim 11 , wherein determining the predicted time at which the virtual striking portion of the device arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion of the device comprises determining the predicted time as a time at which a trajectory of the device within three-dimensional space with respect to the virtual strike location of the virtual object is predicted to change from a first direction towards the virtual strike location of the virtual object to a second direction away from the virtual strike location of the virtual object.
15. The method of claim 11 , wherein performing a remote action associated with the device striking an object upon commencement of the predicted time includes causing an audio and/or video presentation device to play a sound and/or video indicative of striking the object.
16. The method of claim 11 , wherein the device is in communication over a network with a mobile device, an audio presentation device, and/or a gaming system.
17. The method of claim 11 , wherein the device is worn on or is attached to a user of the device.
18. The method of claim 11 , wherein the device fits in, is worn on, and/or is attached to a hand of a user of the device.
19. The method of claim 11 , wherein the virtual striking portion is a virtual extension of the device.
20. A non-transitory computer-readable medium whose contents, when executed by a computing system, cause the computing system to perform operations for generating an audio and/or a video sequence based on a monitored movement of a device with respect to virtual object locations, the operations comprising:
monitoring movement of the device relative to the virtual object locations;
determining predicted times of virtual strikes performed by the device at the virtual object locations;
generating an audio and/or video sequence that comprises sounds and/or video to be played at the predicted times of virtual strikes at the virtual object locations; and
generating haptic feedback at the device synchronized with the predicted times of virtual strikes at the virtual object locations.