System and method using sound signal for material and texture identification for augmented reality

1. A method of determining, using an augmented-reality (AR) display device, a material of an object, comprising:

determining, using a depth camera function of the AR display device, a distance to an object;

emitting, using a speaker of the AR display device, a generated sound signal;

responsive to emitting the sound signal, detecting a reflected sound signal;

determining, relative to the sound signal emitted by the speaker of the AR display device, attenuation levels for a temporal portion of the reflected sound signal for at least two frequencies of the reflected sound signal, the temporal portion of the reflected sound signal corresponding to a computed round-trip travel time of the sound signal traveling the determined distance to and from the object; and

determining a material of the object based upon the determined attenuation levels for the at least two frequencies.

2. The method of claim 1 , further comprising obtaining, at the AR display device, object-selection data that is indicative of movement of a user of the AR display device with respect to the object, wherein a direction with respect to the object in which the generated sound signal is emitted is based on the object-selection data.

3. The method of claim 1 , further comprising determining received signal strength data for the detected reflected sound signal, wherein determining the attenuation levels comprises adjusting the received signal strength data based on atmosphere-condition data associated with an atmosphere in which the object is located.

4. The method of claim 3 , wherein the atmosphere-condition data comprises data selected from the group consisting of humidity data and temperature data.

5. The method of claim 3 , wherein the atmosphere-condition data comprises respective atmospheric attenuation coefficients corresponding to the at least two frequency levels.

6. The method of claim 1 , wherein determining a material of the object comprises comparing the determined attenuation levels for the respective frequencies with respective sound absorption coefficients associated with the material.

7. The method of claim 1 , further comprising calibrating the attenuation levels based on atmosphere-condition data associated with an atmosphere in which the object is located.

8. The method of claim 1 , further comprising presenting, via a display of the AR display device, material information based on the determined material.

9. The method of claim 8 , wherein presenting, via a display of the AR display device, material information based on the determined material comprises augmenting the material information over an image including the object.

10. The method of claim 1 , wherein the AR display device includes a sound signal transceiver that performs the detecting of the reflected sound signal.

11. The method of claim 1 , wherein the emitted sound signal is an ultrasound signal.

12. The method of claim 1 , wherein the emitted sound signal comprises at least two distinct frequencies.

13. The method of claim 1 , further comprising presenting an AR character via a display of the AR display device, the AR character interacting with the object based on the determined material of the object.

14. The method of claim 1 , further comprising detecting the object from a plurality of objects at least by emitting a light signal from a time-of-flight camera in a direction of the sound signal.

15. The method of claim 1 , wherein the AR display device is a head-mounted display (HMD).

16. The method of claim 1 , wherein determining the material of the object comprises determining a material of an exterior surface of the object.

17. The method of claim 1 , wherein determining the material of the object comprises determining a material of an exterior surface of the object.

18. A system comprising a processor and a non-transitory storage medium storing instructions operative, when executed by the processor, to perform the functions of:

determining, using a depth camera function of an augmented-reality (AR) display device, a distance to an object;

emitting, using a speaker of the AR display device, a generated sound signal;

responsive to emitting the sound signal, detecting a reflected sound signal;

determining, relative to the sound signal emitted by the speaker of the AR display device, attenuation levels for a temporal portion of the reflected sound signal for at least two frequencies of the reflected sound signal, the temporal portion of the reflected sound signal corresponding to a computed round-trip travel time of the sound signal traveling the determined distance to and from the object; and

determining a material of the object based upon the determined attenuation levels for the at least two frequencies.

19. The system of claim 18 , wherein determining the material of the object comprises determining a material of an exterior surface of the object.

20. A method comprising:

determining, using a depth camera, a distance to an object;

emitting a generated sound signal;

responsive to emitting the sound signal, detecting a reflected sound signal;

determining, relative to the emitted sound signal, attenuation levels for a temporal portion of the reflected sound signal for at least two frequencies of the reflected sound signal, the temporal portion of the reflected sound signal corresponding to a computed round-trip travel time of the sound signal traveling the determined distance to and from the object; and

determining a material of the object based upon the determined attenuation levels for the at least two frequencies.