Spatialized audio relative to a peripheral device
Techniques and devices are described for generating modified audio signals. The techniques include receiving an audio signal at a device, tracking a movement of the device, generating a first modified audio signal to spatialize the audio signal, generating a second modified audio signal to spatialize the audio signal, causing the first modified audio signal to be rendered using a first speaker of the device, and causing the second modified audio signal to be rendered using a second speaker of the device. In some cases, the first modified audio signal is generated using a first head-related transfer function (HRTF) and the movement of the device, and the second modified audio signal is generated using a second HRTF and the movement of the device, where the second HRTF is different from the first HRTF. Numerous variations and configurations will be apparent in view of this disclosure.
1 . A computer program product for generating modified audio signals, the computer program product including a set of non-transitory computer-readable instructions stored in memory, the set of non-transitory computer-readable instructions being executable on at least one processor and configured to:
receive an audio signal at a device;
separate the audio signal into a pre-spatialized audio portion and a non-spatialized audio portion, wherein the pre-spatialized audio portion corresponds to a first frequency range and the non-spatialized audio portion corresponds to a second frequency range, and wherein each frequency of the first frequency range is greater than each frequency of the second frequency range;
track a movement of the device;
generate a first spatialized audio signal to spatialize the pre-spatialized audio portion, wherein the first spatialized audio signal is generated using a first head-related transfer function (HRTF) and the movement of the device;
generate a second spatialized audio signal to spatialize the pre-spatialized audio portion, wherein the second spatialized audio signal is generated using a second HRTF and the movement of the device, the second HRTF different from the first HRTF;
cause a combination of the first spatialized audio signal and the non-spatialized audio portion to be rendered using a first speaker of the device; and
cause a combination of the second spatialized audio signal and the non-spatialized audio portion to be rendered using a second speaker of the device.
2 . The computer program product of claim 1 , wherein the movement of the device includes a rotational orientation of the device.
3 . The computer program product of claim 1 , wherein the movement of the device includes a change in position of the device within an environment.
4 . The computer program product of claim 1 , wherein the tracking of the movement of the device is performed using at least one of a gyroscope, an accelerometer, a magnetometer, a global positioning sensor (GPS), a proximity sensor, a microphone, a lidar sensor, or a camera.
5 . The computer program product of claim 1 , wherein the spatializing of the audio signal includes simulating at least two virtual sound sources.
6 . The computer program product of claim 5 , wherein the at least two virtual sound sources include a discrete, extracted, or phantom center channel.
7 . The computer program product of claim 5 , wherein the at least two virtual sound sources include a virtual surround sound system, and wherein the virtual surround sound system includes virtual height channels.
8 . The computer program product of claim 1 , wherein the spatializing of the audio signal includes first order acoustic reflections.
9 . A device comprising:
a first speaker;
a second speaker; and
at least one processor configured to:
track a movement of the device,
separate the audio signal into a pre-spatialized audio portion and a non-spatialized audio portion, wherein the pre-spatialized audio portion corresponds to a first frequency range and the non-spatialized audio portion corresponds to a second frequency range, and wherein each frequency of the first frequency range is greater than each frequency of the second frequency range,
generate a first spatialized audio signal to spatialize the pre-spatialized audio portion of an audio signal, wherein the first spatialized audio signal is generated using a first head-related transfer function (HRTF) and the movement of the device,
generate a second spatialized audio signal to spatialize the pre-spatialized audio portion of the audio signal, wherein the second spatialized audio signal is generated using a second HRTF and the movement of the device, the second HRTF different from the first HRTF,
cause a combination of the first spatialized audio signal and the non-spatialized audio portion to be rendered using the first speaker, and
cause a combination of the second spatialized audio signal and the non-spatialized audio portion to be rendered using the second speaker.
10 . The device of claim 9 , wherein the movement of the device includes a rotational orientation of the device.
11 . The device of claim 9 , wherein the movement of the device includes a change in position of the device within an environment.
12 . The device of claim 9 , wherein the tracking of the movement of the device is performed using at least one of a gyroscope, an accelerometer, a magnetometer, a global positioning sensor (GPS), a proximity sensor, a microphone, a lidar sensor, or a camera.
13 . The device of claim 9 , wherein the spatializing of the audio signal includes simulating at least two virtual sound sources, wherein the at least two virtual sound sources include a discrete, extracted, or phantom center channel.
14 . The device of claim 9 , wherein the at least two virtual sound sources include a virtual surround sound system, wherein the virtual surround sound system includes virtual height channels.
15 . The device of claim 9 , wherein the spatializing of the audio signal includes first order acoustic reflections.
16 . A method for generating modified audio signals comprising:
receiving an audio signal at a device;
separating the audio signal into a pre-spatialized audio portion and a non-spatialized audio portion, wherein the pre-spatialized audio portion corresponds to a first frequency range and the non-spatialized audio portion corresponds to a second frequency range, and wherein each frequency of the first frequency range is greater than each frequency of the second frequency range;
tracking a movement of the device;
generating a first spatialized audio signal to spatialize the pre-spatialized audio portion, wherein the first spatialized audio signal is generated using a first head-related transfer function (HRTF) and the movement of the device;
generating a second spatialized audio signal to spatialize the pre-spatialized audio portion, wherein the second spatialized audio signal is generated using a second HRTF and the movement of the device, the second HRTF different from the first HRTF;
causing a combination of the first spatialized audio signal and the non-spatialized audio portion to be rendered using a first speaker of the device; and
causing a combination of the second spatialized audio signal and the non-spatialized audio portion to be rendered using a second speaker of the device.
17 . The method of claim 16 , wherein the spatializing of the audio signal includes simulating at least two virtual sound sources.
18 . The computer program product of claim 1 , wherein the non-spatialized audio portion corresponds to a subwoofer channel.
19 . The device of claim 9 , wherein the non-spatialized audio portion corresponds to a subwoofer channel.
20 . The method of claim 16 , wherein the non-spatialized audio portion corresponds to a subwoofer channel.