Mixed reality musical instrument

1. A method comprising:

identifying a first real object in a mixed reality environment, the mixed reality environment having a user;

identifying a second real object in the mixed reality environment;

generating, in the mixed reality environment, a first virtual object corresponding to the second real object;

identifying, in the mixed reality environment, a collision between the first real object and the first virtual object;

determining a first attribute associated with the collision;

determining, based on the first attribute, a first audio signal corresponding to the collision; and

presenting to the user, via a first speaker, the first audio signal,

wherein:

the first real object comprises a sensor, and

identifying the collision comprises predicting the collision based on an output of the sensor.

2. The method of claim 1 , wherein predicting the collision is further based on a position of the first real object and a velocity of the first real object.

3. The method of claim 1 , wherein the first attribute comprises a pitch associated with the first virtual object, and determining the first audio signal comprises determining an audio signal corresponding to the pitch.

4. The method of claim 1 , wherein the first attribute comprises a material associated with the first virtual object, and determining the first audio signal comprises

modifying an audio signal based on an acoustic property of the material.

5. The method of claim 1 , further comprising presenting, concurrently on a display of a wearable head device, the first virtual object and a view of the second real object.

6. The method of claim 1 , wherein determining the first audio signal comprises:

generating a MIDI parameter based on the first attribute; and

determining, using a sound engine, the first audio signal based on the MIDI parameter.

7. The method of claim 1 , further comprising:

identifying a third real object in the mixed reality environment;

generating, in the mixed reality environment, a second virtual object corresponding to the third real object;

identifying, in the mixed reality environment, a collision between the first virtual object and the second virtual object;

determining a second attribute associated with the collision between the first virtual object and the second virtual object;

determining, based on the second attribute, a second audio signal corresponding to the collision between the first virtual object and the second virtual object; and

presenting to the user, via the first speaker, the second audio signal.

8. The method of claim 1 , wherein determining the first attribute comprises determining the first attribute based on an output of a sensor of a wearable head device.

9. A system comprising:

a wearable head device including:

a display for displaying a mixed reality environment; and

a speaker; and

one or more processors configured to perform:

identifying a first real object in the mixed reality environment;

identifying a second real object in the mixed reality environment;

generating, in the mixed reality environment, a first virtual object corresponding to the second real object;

identifying, in the mixed reality environment, a collision between the first real object and the first virtual object;

determining a first attribute associated with the collision;

determining, based on the first attribute, a first audio signal corresponding to the collision; and

presenting, to a user of the wearable head device, via the speaker, the first audio signal,

wherein:

the first real object comprises a sensor, and

identifying the collision comprises predicting the collision based on an output of the sensor.

10. The system of claim 9 , wherein predicting the collision is further based on a position of the first real object and a velocity of the first real object.

11. The system of claim 9 , wherein the first attribute comprises a pitch associated with the first virtual object, and determining the first audio signal comprises determining an audio signal corresponding to the pitch.

12. The system of claim 9 , wherein the first attribute comprises a material associated with the first virtual object, and determining the first audio signal comprises:

modifying an audio signal based on an acoustic property of the material.

13. The system of claim 9 , the one or more processors further configured to perform presenting, concurrently on the display, the first virtual object and a view of the second real object.

14. The system of claim 9 , wherein determining the first audio signal comprises:

generating a MIDI parameter based on the first attribute; and

determining, using a sound engine, the first audio signal based on the MIDI parameter.

15. The system of claim 9 , wherein the wearable head device further includes a second sensor, and determining the first attribute comprises determining the first attribute based on an output of the second sensor.

16. The system of claim 9 , the one or more processors further configured to perform:

identifying a third real object in the mixed reality environment;

generating, in the mixed reality environment, a second virtual object corresponding to the third real object;

identifying, in the mixed reality environment, a collision between the first virtual object and the second virtual object;

determining a second attribute associated with the collision between the first virtual object and the second virtual object;

determining, based on the second attribute, a second audio signal corresponding to the collision between the first virtual object and the second virtual object; and

presenting, to the user, via the speaker, the second audio signal.

17. A non-transitory computer-readable medium containing instructions which, when executed by one or more processors cause the one or more processors to perform a method comprising:

identifying a first real object in a mixed reality environment, the mixed reality environment having a user;

identifying a second real object in the mixed reality environment;

generating, in the mixed reality environment, a first virtual object corresponding to the second real object;

identifying, in the mixed reality environment, a collision between the first real object and the first virtual object;

determining a first attribute associated with the collision;

determining, based on the first attribute, a first audio signal corresponding to the collision; and

presenting to the user, via a first speaker, the first audio signal,

wherein:

the first real object comprises a sensor, and

identifying the collision comprises predicting the collision based on an output of the sensor.

18. The non-transitory computer-readable medium of claim 17 , wherein predicting the collision is further based on a position of the first real object and a velocity of the first real object.

19. The non-transitory computer-readable medium of claim 17 , the method further comprising presenting, concurrently on a display of a wearable head device, the first virtual object and a view of the second real object.

20. The non-transitory computer-readable medium of claim 17 , the method further comprising:

identifying a third real object in the mixed reality environment;

generating, in the mixed reality environment, a second virtual object corresponding to the third real object;

identifying, in the mixed reality environment, a collision between the first virtual object and the second virtual object;

determining a second attribute associated with the collision between the first virtual object and the second virtual object;

determining, based on the second attribute, a second audio signal corresponding to the collision between the first virtual object and the second virtual object; and

presenting, to the user, via the first speaker, the second audio signal.