IP Library › Granted Patent US 11,343,633
Granted Patent B2
US 11,343,633 · App. 16/884,284 · Granted May 24, 2022

Environmental condition based spatial audio presentation

Inventors: Arthur Charles Tomlin (Kirkland, WA); Kendall Clark York (Bellevue, WA); Jeffrey Sipko (Kirkland, WA); Adolfo Hernandez Santisteban (Bothell, WA); Aaron Daniel Krauss (Snoqualmie, WA); Andrew Frederick Muehlhausen (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
H04S7/303G06F3/165H04S3/008H04S2400/01H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,343,633
App. No.
16/884,284
Granted
May 24, 2022
Kind
B2
Abstract

A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Claims (39)

1. A wearable spatial audio output device, comprising:

one or more audio speakers;

one or more processors; and

a storage machine holding instructions executable by the one or more processors to:

obtain map data for a real-world environment including one or more dynamic audio objects;

obtain a device-specific subset of audio tracks and a device-specific spatialized audio mix of the device-specific subset of audio tracks based on the map data;

receive an indication of a change in a physical environmental condition relative to one or more of the dynamic audio objects, wherein the change in the physical environmental condition includes a change in acoustic properties of the real-world environment due to a physical change of a structure in the real-world environment; and

adjust the device-specific spatialized audio mix based on the change in the physical environmental condition.

2. The wearable spatial audio output device of claim 1 , further comprising one or more sensors, and wherein the storage machine further holds instructions executable by the one or more processors to:

generate the map data based on data received via one or more sensors of the spatial audio device.

3. The wearable spatial audio output device of claim 1 , wherein the indication of the change in the physical environmental condition is based at least upon data received at one more image sensors.

4. The wearable spatial audio output device of claim 1 , wherein the indication of the change in the physical environmental condition is based at least upon data received at one more acoustic sensors.

5. The wearable spatial audio output device of claim 1 , wherein the change in the physical environmental condition further comprises a change in position of a person in the real-world environment.

6. The wearable spatial audio output device of claim 1 , wherein receiving the indication of the change in the physical environmental condition comprises obtaining updated map data for the real-world environment.

7. The wearable spatial audio output device of claim 1 , wherein the one or more dynamic audio objects includes a real-world object located at a position within the real-world environment and associated with a set of audio tracks.

8. The wearable spatial audio output device of claim 1 , wherein the one or more dynamic audio objects includes a virtual object located at a position within the real-world environment and associated with a set of audio tracks, and wherein the instructions are further executable to adjust the device-specific spatialized audio mix based on a change in location of the wearable spatial audio output device relative to the one or more dynamic audio objects within the real-world environment.

9. One or more computer-readable media having computer-readable instructions thereon which, when executed by one or more processors, cause the one or more processors to:

receive sensor data captured by a sensor of one or more physical dynamic audio objects in a real-world environment;

generate, from the received sensor data, map data for the real-world environment;

obtain a device-specific subset of audio tracks and a device-specific spatialized audio mix of the device-specific subset of audio tracks based on the map data;

receive, from the sensor of the one or more physical dynamic audio objects, an indication of a change in a physical environmental condition relative to one or more of the dynamic audio objects; and

adjust the device-specific spatialized audio mix based on the change in the physical environmental condition.

10. The computer-readable media of claim 9 , further having instructions thereon, which, when executed by one or more processors, cause the one or more processors to generate the map data further based on data received via one or more sensors of a spatial audio device.

11. The computer-readable media of claim 9 , wherein the instructions are executable to receive the indication of the change in the physical environmental condition based on data received at one more image sensors.

12. The computer-readable media of claim 9 , wherein the instructions are executable to receive the indication of the change in the physical environmental condition based on data received at one more acoustic sensors.

13. The computer-readable media of claim 9 , wherein the instructions executable to receive the indication of the change in the physical environmental condition are executable to receive an indication of a change in acoustic properties of the real-world environment.

14. The computer-readable media of claim 9 , wherein the instructions executable to receive the indication of the change in the physical environmental condition are executable to receive an indication of a change in occupancy of the real-world environment.

15. The computer-readable media of claim 9 , wherein the instructions executable to receive the indication of the change in the physical environmental condition are executable to obtain updated map data for the real-world environment.

16. The computer-readable media of claim 9 , wherein the one or more dynamic audio objects includes a real-world object located at a position within the real-world environment and associated with a set of audio tracks.

17. The computer-readable media of claim 9 , wherein the one or more dynamic audio objects includes a virtual object located at a position within the real-world environment and associated with a set of audio tracks.

18. A method performed by a wearable spatial audio device, the method comprising:

capturing, via one or more sensors of the wearable spatial audio device, positional data for a real-world environment including one or more dynamic audio objects, wherein the wearable spatial audio device is physically located in the real-world environment;

based on the positional data, generating a first portion of map data for the real-world environment;

receiving, from another wearable spatial audio device physically present in the real-world environment, a second portion of map data for the real-world environment;

obtaining a device-specific subset of audio tracks and a device-specific spatialized audio mix of the device-specific subset of audio tracks based on at least one of the first portion or the second portion of the map data;

receiving an indication of a change in a physical environmental condition relative to one or more of the dynamic audio objects; and

adjusting the device-specific spatialized audio mix based on the change in the physical environmental condition.

19. The method of claim 18 , wherein the real-world environment is a physical room.

20. The method of claim 18 , wherein the change in the physical environmental condition includes a change in acoustic properties of the real-world environment due to a physical change of a structure in the real-world environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: TOMLIN, ARTHUR CHARLES; YORK, KENDALL CLARK; SIPKO, JEFFREY; HERNANDEZ SANTISTEBAN, ADOLFO; KRAUSS, AARON DANIEL; MUEHLHAUSEN, ANDREW FREDERICK
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 052759/0343 →
Continuity (2)
Continuation 15922791 · Mar 15, 2018
Related Publication 20200288263A1 · Sep 10, 2020
Cited By (1)
US 12,684,301