Mixed reality musical instrument
A method is disclosed, the method comprising the steps of identifying a first real object in a mixed reality environment, the mixed reality environment having a user; identifying a second real object in the mixed reality environment; generating, in the mixed reality environment, a first virtual object corresponding to the second real object; identifying, in the mixed reality environment, a collision between the first real object and the first virtual object; determining a first attribute associated with the collision; determining, based on the first attribute, a first audio signal corresponding to the collision; and presenting to the user, via one or more speakers, the first audio signal.
1. A method comprising:
identifying a first object in a mixed reality environment;
identifying a second object in the mixed reality environment, wherein one or more of the first object and the second object comprises a virtual object;
determining, in the mixed reality environment, a collision between the first object and the second object;
determining an attribute associated with the collision;
determining, based on the attribute, an audio signal corresponding to the collision, wherein the determining the audio signal comprises:
generating a MIDI parameter based on the attribute; and
determining, via a sound engine, the audio signal based on the MIDI parameter; and
presenting, via a speaker, the audio signal.
2. The method of claim 1 , wherein the collision is determined further based on a position of the first object and a velocity of the first object.
3. The method of claim 1 , wherein the attribute comprises a pitch associated with one or more of the first object and the second object, and the audio signal is determined further based on the pitch.
4. The method of claim 1 , wherein the attribute comprises a material associated with one or more of the first object and the second object, and the audio signal is determined further based on an acoustic property of the material.
5. The method of claim 1 , further comprising presenting, concurrently on a display, a view of the first object and a view of the second object.
6. The method of claim 1 , further comprising:
identifying a third object in the mixed reality environment;
determining, in the mixed reality environment, a collision between the first object and the third object;
determining a second attribute associated with the collision between the first object and the third object;
determining, based on the second attribute, a second audio signal corresponding to the collision between the first object and the third object; and
presenting, via the speaker, the second audio signal.
7. The method of claim 1 , wherein the determining the attribute comprises determining the attribute based on an output of one or more sensors.
8. The method of claim 7 , wherein the one or more sensors comprise a camera, a microphone, an inertial measurement unit, a LIDAR sensor, a GPS sensor, a magnetic sensor, or any combination thereof.
9. The method of claim 1 , wherein the determining the collision comprises determining a path of one or more of the first object and the second object.
10. The method of claim 1 , wherein the first object comprises a real object.
11. The method of claim 10 , wherein the real object comprises a controller.
12. A system comprising:
a speaker; and
one or more processors configured to perform a method comprising:
identifying a first object in a mixed reality environment;
identifying a second object in the mixed reality environment, wherein one or more of the first object and the second object comprises a virtual object;
determining, in the mixed reality environment, a collision between the first object and the second object;
determining an attribute associated with the collision;
determining, based on the attribute, an audio signal corresponding to the collision, wherein the determining the audio signal comprises:
generating a MIDI parameter based on the attribute; and
determining, via a sound engine, the audio signal based on the MIDI parameter; and
presenting, via the speaker, the audio signal.
13. The system of claim 12 , further comprising a display, wherein the method further comprises presenting, concurrently on the display, a view of the first object and a view of the second object.
14. The system of claim 12 , further comprising one or more sensors, wherein the determining the attribute comprises determining the attribute based on an output of the one or more sensors.
15. The system of claim 14 , wherein the one or more sensors comprise a camera, a microphone, an inertial measurement unit, a LIDAR sensor, a GPS sensor, a magnetic sensor, or any combination thereof.
16. The system of claim 12 , wherein the determining the collision comprises determining a path of one or more of the first object and the second object.
17. The system of claim 12 , wherein the first object comprises a real object.
18. The system of claim 17 , wherein the real object comprises a controller.
19. The system of claim 12 , further comprising a wearable head device, wherein the wearable head device comprises the speaker.
20. A non-transitory computer-readable medium containing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
identifying a first object in a mixed reality environment;
identifying a second object in the mixed reality environment, wherein one or more of the first object and the second object comprises a virtual object;
determining, in the mixed reality environment, a collision between the first object and the second object;
determining an attribute associated with the collision;
determining, based on the attribute, an audio signal corresponding to the collision, wherein the determining the audio signal comprises:
generating a MIDI parameter based on the attribute; and
determining, via a sound engine, the audio signal based on the MIDI parameter; and
presenting, via a speaker, the audio signal.