METHOD AND APPARATUS FOR A CAMERA DRIVEN AUDIO EQUALIZATION OF PLAYBACK IN A COMMUNICATION DEVICE

1 . A method comprising:

receiving an audio signal intended for audio playback by a client device;

receiving locations of one or more target individuals within an environment in which the client device is located;

determining a target position based on the received locations of the one or more target individuals;

determining, based on the target position, equalization parameters of an equalization function by retrieving the equalization parameters from stored one or more look-up tables based on the determined target position, wherein the stored one or more look-up tables are based on a stored persistent map of the environment, the persistent map of the environment including one or more persistent objects of the environment rather than one or more dynamic or temporary or moving objects;

applying the equalization function to the received audio signal to generate an equalized audio signal based on the determined equalization parameters;

providing the equalized audio signal for audio playback to an audio output system of the client device; and

the method further comprising:

periodically updating the stored persistent map of the environment and

modifying the stored one or more look-up tables based on the updated persistent map.

2 . The method of claim 1 , wherein the locations of the one or more target individuals is determined from sensor data provided by one or more sensors on the client device.

3 . The method of claim 1 , wherein receiving the locations of the one or more target individuals within the environment in which the client device is located comprises:

receiving a distance of each of the one or more target individuals from the client device; and

receiving an azimuthal angle made by each of the one or more target individuals with respect to a reference listening direction for the client device.

4 . The method of claim 3 , wherein determining a target position based on the received locations of the one or more target individuals comprises:

generating the target position as a weighted combination of the received distances and azimuthal angles of each of the one or more target individuals.

5 . The method of claim 1 , wherein

the stored one or more look-up tables provide a frequency-dependent mapping of target positions to the equalization parameters.

6 . The method of claim 1 , wherein applying the equalization function to the received audio signal to generate the equalized audio signal comprises:

computing the equalization function based on the determined equalization parameters; and

generating the equalized audio signal by applying the computed equalization function to the received audio signal.

7 . The method of claim 1 , wherein applying the equalization function to the received audio signal to generate an equalized audio signal based on the determined equalization parameters comprises:

computing a frequency dependent complex gain function based on the determined equalization parameters; and applying the frequency dependent complex gain function to the received audio signal to compensate for an expected loss in the audio signal between the client device and the determined target position.

8 . The method of claim 1 , wherein the equalization parameters of the equalization function may be based on one or more of:

empirical user information; and

a prior history of user behavior.

9 . The method of claim 1 ,

wherein the persistent map of the environment is generated by:

receiving sensor data of the environment over a period of time from one or more sensors in the client device;

pre-processing the sensor data to generate the persistent map of the environment; and

storing the generated persistent map of the environment; and

wherein periodically updating the stored persistent map of the environment is based on periodic pre-processing of image data of the environment.

10 . (canceled)

11 . A non-transitory computer-readable medium comprising computer program instructions that, when executed by a computer processor of an online system, cause the processor to perform steps comprising:

receiving an audio signal intended for audio playback by a client device;

receiving locations of one or more target individuals within an environment in which the client device is located;

determining a target position based on the received locations of the one or more target individuals;

determining, based on the target position, equalization parameters of an equalization function by retrieving the equalization parameters from stored one or more look-up tables based on the determined target position, wherein the stored one or more look-up tables are based on a stored persistent map of the environment, the persistent map of the environment including one or more persistent objects of the environment rather than one or more dynamic or temporary or moving objects;

applying the equalization function to the received audio signal to generate an equalized audio signal based on the determined equalization parameters;

providing the equalized audio signal for audio playback to an audio output system of the client device; and

the method further comprising:

periodically updating the stored persistent map of the environment and

modifying the stored one or more look-up tables based on the updated persistent map.

12 . The non-transitory computer-readable medium of claim 11 , wherein the locations of the one or more target individuals is determined from sensor data provided by one or more sensors on the client device.

13 . The non-transitory computer-readable medium of claim 11 , wherein receiving the locations of the one or more target individuals within the environment in which the client device is located comprises:

receiving a distance of each of the one or more target individuals from the client device; and

receiving an azimuthal angle made by each of the one or more target individuals with respect to a reference listening direction for the client device.

14 . The non-transitory computer-readable medium of claim 13 , wherein determining a target position based on the received locations of the one or more target individuals comprises:

generating the target position as a weighted combination of the received distances and azimuthal angles of each of the one or more target individuals.

15 . The non-transitory computer-readable medium of claim 11 , wherein

the stored one or more look-up tables provide a frequency-dependent mapping of target positions to the equalization parameters.

16 . The non-transitory computer-readable medium of claim 11 , wherein applying the equalization function to the received audio signal to generate the equalized audio signal comprises:

computing the equalization function based on the determined equalization parameters; and

generating the equalized audio signal by applying the computed equalization function to the received audio signal.

17 . A system comprising:

a processor; and

a non-transitory computer-readable medium comprising computer program instructions that when executed by the processor of an online system causes the processor to perform steps comprising:

receiving an audio signal intended for audio playback by a client device;

receiving locations of one or more target individuals within an environment in which the client device is located;

determining a target position based on the received locations of the one or more target individuals;

determining, based on the target position, equalization parameters of an equalization function by retrieving the equalization parameters from stored one or more look-up tables based on the determined target position, wherein the stored one or more look-up tables are based on a stored persistent map of the environment, the persistent map of the environment including one or more persistent objects of the environment rather than one or more dynamic or temporary or moving objects;

applying the equalization function to the received audio signal to generate an equalized audio signal based on the determined equalization parameters;

providing the equalized audio signal for audio playback to an audio output system of the client device; and

the method further comprising:

periodically updating the stored persistent map of the environment and

modifying the stored one or more look-up tables based on the updated persistent map.

18 . The system of claim 17 , wherein the locations of the one or more target individuals is determined from sensor data provided by one or more sensors on the client device.

19 . The system of claim 17 , wherein

the stored one or more look-up tables provide a frequency-dependent mapping of target positions to the equalization parameters.

20 . The system of claim 17 , wherein applying the equalization function to the received audio signal to generate the equalized audio signal comprises:

computing the equalization function based on the determined equalization parameters; and

generating the equalized audio signal by applying the computed equalization function to the received audio signal.