Interactive instruments and other striking objects
Systems, methods, and devices for providing interactive striking objects (e.g., drumsticks) and performing actions in response to striking motions of the striking objects are disclosed. In some embodiments, the systems and methods provide an interactive drumstick, which includes a lighting display located at a tip portion of the interactive drumstick, a motion detector contained at least partially within the drumstick, a processor and memory contained at least partially within the drumstick, and an interactive system stored within the memory of the drumstick. The interactive system includes a striking motion module that determines striking motions of the drumstick with respect to a virtual percussion instrument based on accessing information measured by the motion detector, and a display module that causes the lighting display to present a certain type of illumination based on the striking motions determined by the striking motion module.
1. A method comprising:
measuring a state of motion of a striking object relative to a virtual strike location for a virtual strike of a virtual percussion instrument to be performed by the striking object;
determining a predicted time at which the striking object arrives at the virtual strike location for the virtual strike of the virtual percussion instrument based on the state of motion measured for the striking object;
performing an action associated with striking a real percussion instrument upon commencement of the predicted time at which the striking object arrives at the virtual strike location; and
providing to a user, haptic feedback synchronized with the predicted time at which the striking object arrives at the virtual strike location.
2. The method of claim 1 , wherein determining a predicted time at which the striking object arrives at the virtual strike location for the virtual strike of the virtual percussion instrument based on the measured state of motion of the striking object comprises:
determining, from the state of motion measured for the striking object relative to the virtual strike location, acceleration and trajectory of the striking object within three-dimensional space with respect to the virtual strike location of the virtual percussion instrument; and
determining the predicted time as a time at which a striking portion of the striking object is expected to arrive at the virtual strike location based on the acceleration and trajectory determined for the striking object with respect to the virtual strike location.
3. The method of claim 1 , wherein determining the predicted time at which the striking object arrives at the virtual strike location for the virtual strike of the virtual percussion instrument, based on the state of motion measured for the striking object, comprises determining the predicted time as a time at which a state of motion predicted for the striking object is associated with the striking object decelerating to approximately zero acceleration when proximate to the virtual strike location of the virtual percussion instrument.
4. The method of claim 1 , wherein determining a predicted time at which the striking object arrives at the virtual strike location for the virtual strike of the virtual percussion instrument based on the measured state of motion of the striking object comprises determining the predicted time at which the striking object arrives at the virtual strike location as a time at which a trajectory of the striking object within three-dimensional space with respect to the virtual strike location of the virtual percussion instrument is predicted to change from a first direction towards the virtual strike location of the virtual percussion instrument to a second direction away from the virtual strike location of the virtual percussion instrument.
5. The method of claim 1 , wherein performing an action associated with striking a real percussion instrument upon commencement of the predicted time at which the striking object arrives at the virtual strike location comprises causing an audio presentation device associated with a user of the striking object to play a sound indicative of a drumstick striking a drum or cymbal.
6. The method of claim 1 , wherein performing an action associated with striking a real percussion instrument upon commencement of the predicted time at which the striking object arrives at the virtual strike location comprises causing an audio presentation device associated with a user of the striking object to play a sound indicative of a foot pedal striking a drum or engaging a cymbal.
7. A non-transitory computer-readable medium whose contents, when executed by a computing system, cause the computing system to perform operations for generating an audio sequence based on a monitored movement of drumsticks with respect to virtual drum locations, the operations comprising:
monitoring movement of the drumsticks relative to the virtual drum locations;
determining predicted times of virtual strikes performed by the drumsticks at the virtual drum locations;
generating an audio sequence that comprises sounds to be played upon commencement of the predicted times for the virtual strikes at the virtual drum locations; and
providing to a user, haptic feedback synchronized with the predicted times at which the drumsticks arrive at the virtual drum locations.
8. The non-transitory computer-readable medium of claim 7 , wherein determining predicted times of virtual strikes performed by the drumsticks at the virtual drum locations comprises, for each virtual strike performed by a drumstick at a virtual drum location:
determining a state of motion of the drumstick relative to the virtual drum location, wherein the state of motion is based on a measured acceleration of the drumstick and a measured trajectory of the drumstick within three-dimensional space with respect to the virtual drum location; and
determining a predicted time of a virtual strike performed by the drumstick at the virtual drum location based on the state of motion determined for the drumstick relative to the virtual drum location.
9. The non-transitory computer-readable medium of claim 7 , wherein monitoring movement of the drumsticks relative to the virtual drum locations comprises measuring movement of the drumsticks using one or more accelerometers or gyroscopes contained within the drumsticks.
10. The non-transitory computer-readable medium of claim 7 , wherein monitoring movement of the drumsticks relative to the virtual drum locations comprises:
visually capturing movement of the drumsticks using one or more image sensors; and
extracting information associated with acceleration of the drumsticks and a trajectory of the drumsticks within three-dimensional space from images captures by the one or more image sensors.
11. The non-transitory computer-readable medium of claim 7 , wherein generating an audio sequence that comprises sounds to be played upon commencement of the predicted times for the virtual strikes at the virtual drum locations comprises generating, for every virtual strike at a virtual drum location, a sound that is based on a specific virtual drum associated with the virtual drum location and a measured strike force applied from the drumsticks to the specific virtual drum during the virtual strike.
12. A method comprising:
measuring a state of motion of a wand relative to a virtual strike location for a virtual strike of a virtual object performed by the wand;
determining a predicted time at which a virtual striking portion of the wand arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion measured for the wand;
performing an action associated with striking a real object upon commencement of the predicted time at which the virtual striking portion of the wand arrives at the virtual strike location; and
providing to a user, haptic feedback synchronized with the predicted time at which the virtual striking portion of the wand arrives at the virtual strike location.
13. The method of claim 12 , wherein determining a predicted time at which the virtual striking portion of the wand arrives at the virtual strike location for the virtual strike of the virtual object based on the measured state of motion of the wand comprises:
determining acceleration and trajectory of the wand within three-dimensional space with respect to the virtual strike location of the virtual object from the state of motion measured for the virtual striking portion of the wand relative to the virtual strike location; and
determining the predicted time as a time at which the virtual striking portion of the wand is expected to arrive at the virtual strike location based on the acceleration and trajectory determined for the wand with respect to the virtual strike location.
14. The method of claim 12 , wherein determining a predicted time at which the virtual striking portion of the wand arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion measured for the wand comprises determining the predicted time as a time at which a predicted state of motion of the wand is associated with the wand decelerating to approximately zero acceleration when proximate to the virtual strike location of the virtual object.
15. The method of claim 12 , wherein determining a predicted time at which the virtual striking portion of the wand arrives at the virtual strike location for the virtual strike of the virtual object based on the state of motion measured for the wand comprises determining the predicted time as a time at which a trajectory of the wand within three-dimensional space with respect to the virtual strike location of the virtual object is predicted to change from a first direction towards the virtual strike location of the virtual object to a second direction away from the virtual strike location of the virtual object.
16. The method of claim 12 , wherein the method further comprising:
communicating information associated with the wand arriving at the virtual strike location to at least one external device.
17. The method of claim 16 , wherein the at least one external device performs an action associated with the wand arriving at the virtual strike location upon receiving the information associated with the wand arriving at the virtual strike location.
18. The method of claim 16 , wherein the information associated with the wand arriving at the virtual strike location is communicated to the at least one external device over a network.
19. The method of claim 18 , wherein the network comprises at least one of: a LAN; a WAN; a Bluetooth® network; a cellular network; and the Internet, or a combination of any thereof.
20. The method of claim 16 , wherein the at least one external device is any one of: a media player; a smartphone; a gaming device; and a computer, or a combination of any thereof.
21. The method of claim 16 , wherein the external device is a mobile device.
22. The method of claim 21 , wherein the mobile device comprises at least one mobile application configured to manage the performing of an action associated with striking a real object upon commencement of the predicted time at which the virtual striking portion of the wand arrives at the virtual strike location.