Enhanced audio using personal audio device
A head-worn device can determine that a playback device is outputting audio content. A microphone of the head-worn device can sense the audio content that is output by the playback device. Spatial filters can be applied to one or more audio channels of additional audio content that complements the audio content output by the playback device. The resulting spatialized audio can be played through speakers to a user wearing the head-worn device.
1 . A method comprising:
obtaining a microphone signal produced by a microphone of a head-worn device;
determining that a playback device, a distance away from a user wearing the head-worn device, is outputting audio content from one or more speakers of the playback device;
determining that the microphone signal includes the audio content that is output by the one or more speakers of the playback device; and
applying one or more filters to one or more audio channels based on a location of the playback device resulting in spatialized audio that is used to drive speakers of the head-worn device, wherein a camera of the head-worn device is used to determine that visual content presented by the playback device is associated with the audio content, and in response to the visual content being associated with the audio content, the one or more filters are applied to the one or more audio channels resulting in the spatialized audio that is used to drive the speakers of the head-worn device.
2 . The method of claim 1 , wherein applying the one or more filters to the one or more audio channels gives the spatialized audio a virtual location that appears to originate from the location of the playback device.
3 . The method of claim 1 , wherein the one or more filters are applied to the one or more audio channels such that the spatialized audio has a plurality of virtual locations that appears to have a plurality of fixed positions surrounding a wearer of the head-worn device.
4 . The method of claim 1 , wherein determining that the playback device is outputting audio content includes obtaining information from the playback device or a separate media device that identifies the audio content that is output by the playback device.
5 . The method of claim 1 , wherein the one or more filters are applied to the one or more audio channels in response to determining that the microphone signal includes the audio content.
6 . The method of claim 1 , further comprising, in response to determining that the microphone signal includes the audio content, determining that the head-worn device is oriented towards the playback device based on an inertial measurement unit (IMU) or one or more images produced by a camera, wherein the one or more filters are applied to the one or more audio channels in response to determining that the head-worn device is oriented towards the playback device.
7 . The method of claim 1 , wherein the one or more filters are applied to the one or more audio channels in response to determining that the one or more speakers of the playback device are blocked, positioned incorrectly, or outputting the audio content incorrectly.
8 . The method of claim 1 , further comprising synchronizing the spatialized audio with the audio content that is present in the microphone signal, based on a time of flight of the audio content from the playback device to the head-worn device.
9 . The method of claim 1 , further comprising presenting a prompt to a display of the head-worn device and receiving an input indicating to play the spatialized audio through the speakers of the head-worn device.
10 . The method of claim 1 , further comprising adjusting a loudness of an output of the speakers of the head-worn device based on a loudness of the audio content that is output by the playback device or sensed by the microphone.
11 . The method of claim 1 , further comprising adjusting the one or more filters based on a tracked head position that is determined based on one or more sensors of the head-worn device, to compensate for the tracked head position of a user.
12 . The method of claim 1 , further comprising, in response to determining that the microphone signal includes the audio content that is output by the playback device, determining whether the one or more audio channels are available to play for the audio content, wherein in response to the one or more audio channels being present, the one or more filters are applied to the one or more audio channels resulting in spatialized audio that is used to drive the speakers of the head-worn device.
13 . The method of claim 1 , wherein the one or more audio channels includes a language that is different from a language of the audio content.
14 . The method of claim 1 , wherein the audio content is output by the playback device without dialogue, and each of a plurality of head-worn devices separately select respective one or more audio channels for presenting to a respective user.
15 . The method of claim 1 , wherein if the playback device is in a silent or mute mode, then visual content that is presented by the playback device is used to determine whether or not to apply the one or more filters to the one or more audio channels, otherwise the microphone signal is used to determine whether or not to present the spatialized audio to a user.
16 . The method of claim 1 , wherein the one or more audio channels includes dialogue and a loudness of the dialogue is increased in the spatialized audio when used to drive the speakers of the head-worn device.
17 . The method of claim 1 , wherein in response to the playback device not outputting unsupported audio channels of the audio content, the unsupported audio channels are included in the one or more audio channels such that, in playback of the spatialized audio, the unsupported audio channels have one or more corresponding virtual locations in a listening area.
18 . A head-worn device having:
one or more microphones that produce one or more microphone signals, speakers, and a processor, configured to perform the following:
determining that a playback device, a distance away from a user wearing the head-worn device, is outputting audio content from one or more speakers of the playback device;
determining that the one or more microphone signals includes the audio content that is output by the one or more speakers of the playback device; and
applying one or more filters to one or more audio channels based on a location of the playback device resulting in spatialized audio that is used to drive the speakers of the head-worn device, wherein if the playback device is in a silent or mute mode, then visual content that is presented by the playback device is used to determine whether or not to apply the one or more filters to the one or more audio channels, otherwise the one or more microphone signals are used to determine whether or not to present the spatialized audio to a user.
19 . The head-worn device of claim 18 , wherein the one or more filters are applied to the one or more audio channels such that the spatialized audio has a virtual location that is perceived by a wearer of the head-worn device to originate from a location of the playback device.
20 . The head-worn device of claim 18 , wherein applying the one or more filters to the one or more audio channels gives the spatialized audio a virtual location that appears to originate from the location of the playback device.