Granted Patent B2

US 12,436,227 · App. 17/483,639 · Granted Oct 7, 2025

Inventors: Jacek Ossowski (Gdansk, PL); Marek Dabek (Gdansk, PL); Pawel Obszarski (Gdansk, PL); Krzysztof Pawlak (Gdynia, PL)

Assignee: Intel Corporation

G01S5/30G01S5/20G01S5/22G01S7/539G01S15/876

Abstract

Claims (61)

1. An apparatus to determine a location of an audio source, the apparatus comprising:

at least one memory;

machine readable instructions; and

at least one programmable circuit to be programmed by the machine readable instructions to:

before determination of the location of the audio source, determine error values corresponding respectively to first time difference of arrival (TDOA) distance values between different pairs of acoustic sensors in a plurality acoustic sensors, the error values based on a cost function, a first set of constraints associated with respective groups of three of the pairs of acoustic sensors, and a second set of constraints associated with individual ones of the pairs of acoustic sensors;

before determination of the location of the audio source, adjust ones of the first TDOA distance values based on corresponding ones of the error values to determine second TDOA distance values, a first one of the second TDOA distance values based on a first one of the first TDOA distance values and a first one of the error values that corresponds to the first one of the first TDOA distance values; and

output the second TDOA distance values to source location circuitry that is to determine the location of the audio source.

2. The apparatus of claim 1 , wherein one or more of the at least one programmable circuit is to generate the first TDOA distance values based on calculated TDOA values multiplied by a propagation speed of an acoustic signal, a first one of the TDOA values to represent a difference in an arrival time of an audio signal at a first acoustic sensor and an arrival time of the audio signal at a second acoustic sensor, a corresponding first one of the TDOA distance values to represent a first delay distance between the first acoustic sensor and the second acoustic sensor.

3. The apparatus of claim 1 , wherein a number of acoustic sensors is at least four, and the first TDOA distance values are associated with respective ones of the pairs of acoustic sensors among the at least four acoustic sensors.

4. The apparatus of claim 3 , wherein one or more of the at least one programmable circuit is to:

obtain audio signal data from the at least four acoustic sensors and access configuration data that specifies physical locations of the at least four acoustic sensors; and

generate a dataset based on the physical locations specified in the configuration data, the dataset to include physical distance values between respective ones of the pairs of acoustic sensors.

5. The apparatus of claim 4 , wherein respective ones of the first set of constraints are based on combinations of three TDOA distance values and respective ones of the second set of constraints are based on the physical distance values between respective individual ones of the pairs of acoustic sensors.

6. The apparatus of claim 5 , wherein a first one of the first set of constraints is based on:

a combination of a first one of the TDOA distance values corresponding to a first delay distance between a first acoustic sensor and a second acoustic sensor, a second one of the TDOA distance values corresponding to a second delay distance between the first acoustic sensor and a third acoustic sensor, and a third one of the TDOA distance values corresponding to a third delay distance between the third acoustic sensor and the second acoustic sensor, the first acoustic sensor and the second acoustic sensor corresponding to a first one of the pairs of acoustic sensors, the first acoustic sensor and the third acoustic sensor corresponding to a second one of the pairs of acoustic sensors, and the third acoustic sensor and the second acoustic sensor corresponding to a third one of the pairs of acoustic sensors; and

a combination of a first one of the error values corresponding to the first one of the TDOA distance values, a second one of the error values corresponding to the second one of the TDOA distance values, and a third one of the error values corresponding to the third one of the TDOA distance values.

7. The apparatus of claim 5 , wherein a first one of the second set of constraints is based on:

a first combination of a first one of the physical distance values corresponding to a first physical distance between a first acoustic sensor and a second acoustic sensor and a first one of the TDOA distance values corresponding to a first delay distance between the first acoustic sensor and the second acoustic sensor, the first acoustic sensor and the second acoustic sensor corresponding to a first one of the pairs of acoustic sensors;

a first one of the error values corresponding to the first one of the TDOA distance values; and

a second combination of the first one of the physical distance values and the first one of the TDOA distance values.

8. The apparatus of claim 1 , wherein one or more of the at least one programmable circuit is to select at least one of a linear programming algorithm or a non-linear programming algorithm to determine the error values for the corresponding ones of the first TDOA distance values based on the cost function, the first set of constraints and the second set of constraints.

9. The apparatus of claim 8 , wherein when the linear programming algorithm is selected, one or more of the at least one programmable circuit is to split respective ones of the error values into corresponding pairs of component error values.

10. The apparatus of claim 1 , wherein to adjust the corresponding ones of the first TDOA distance values, one or more of the at least one programmable circuit is to add the error values to the corresponding ones of the TDOA distance values to determine the TDOA distance values.

11. The apparatus of claim 1 , wherein the second set of constraints includes a constraint that an absolute value of a sum of the first one of the first TDOA distance values and the first one of the error values is less than or equal to a specified physical distance between a first one of the pairs of acoustic sensors, the first one of the pairs of acoustic sensors corresponding to the first one of the first TDOA distance values.

12. A method to identify a location of an audio source, the method comprising:

determining, by at least one programmable circuit programmed based on at least one instruction, error values corresponding respectively to first time difference of arrival (TDOA) distance values between different pairs of acoustic sensors in a plurality acoustic sensors before determination of the location of the audio source, the error values based on a cost function, a first set of constraints associated with respective groups of three of the pairs of acoustic sensors, and a second set of constraints associated with individual ones of the pairs of acoustic sensors;

adjusting, by one or more of the at least one programmable circuit, ones of the first TDOA distance values based on corresponding ones of the error values to determine second TDOA distance values before determination of the location of the audio source, a first one of the second TDOA distance values based on a first one of the first TDOA distance values and a first one of the error values that corresponds to the first one of the first TDOA distance values; and

outputting the second TDOA distance values to source location circuitry that is to determine the location of the audio source.

13. The method of claim 12 , wherein a number of acoustic sensors is at least four, and the first TDOA distance values are associated with respective ones of the pairs of acoustic sensors among the at least four acoustic sensors.

14. The method of claim 13 , including:

obtaining audio signal data from the at least four acoustic sensors and accessing configuration data that specifies physical locations of the at least four acoustic sensors; and

generating a dataset based on the physical locations specified in the configuration data, the dataset including physical distance values between respective ones of the pairs of acoustic sensors.

15. The method of claim 14 , wherein respective ones of the first set of constraints are based on combinations of three TDOA distance values and respective ones of the second set of constraints are based on the physical distance values between respective individual ones of the pairs of acoustic sensors.

16. The method of claim 15 , wherein a first one of the first set of constraints is based on:

a combination of a first one of the TDOA distance values corresponding to a first delay distance between a first acoustic sensor and a second acoustic sensor, a second one of the TDOA distance values corresponding to a second delay distance between the first acoustic sensor and a third acoustic sensor, and a third one of the TDOA distance values corresponding to a third delay distance between the third acoustic sensor and the second acoustic sensor, the first acoustic sensor and the second acoustic sensor corresponding to a first one of the pairs of acoustic sensors, the first acoustic sensor and the third acoustic sensor corresponding to a second one of the pairs of acoustic sensors, and the third acoustic sensor and the second acoustic sensor corresponding to a third one of the pairs of acoustic sensors; and

a combination of a first one of the error values corresponding to the first one of the TDOA distance values, a second one of the error values corresponding to the second one of the TDOA distance values, and a third one of the error values corresponding to the third one of the TDOA distance values.

17. The method of claim 15 , wherein a first one of the second set of constraints is based on:

a first combination of a first one of the physical distance values corresponding to a first physical distance between a first acoustic sensor and a second acoustic sensor and a first one of the TDOA distance values corresponding to a first delay distance between the first acoustic sensor and the second acoustic sensor, the first acoustic sensor and the second acoustic sensor corresponding to a first one of the pairs of acoustic sensors;

a first one of the error values corresponding to the first one of the TDOA distance values; and

a second combination of the first one of the physical distance values and the first one of the TDOA distance values.

18. At least one non-transitory computer readable medium comprising computer readable instructions to cause at least one programmable circuit to at least:

determine error values respectively corresponding to first time difference of arrival (TDOA) distance values between different pairs of acoustic sensors in a plurality acoustic sensors, the error values based on a cost function, a first set of constraints associated with respective groups of three of the pairs of acoustic sensors, and a second set of constraints associated with individual ones of the pairs of acoustic sensors;

adjust ones of the first TDOA distance values based on corresponding ones of the error values to determine second TDOA distance values, a first one of the second TDOA distance values based on a first one of the first TDOA distance values and a first one of the error values that corresponds to the first one of the first TDOA distance values; and

output the second TDOA distance values to source location circuitry that is to determine a location of an audio source.

19. The at least one non-transitory computer readable medium of claim 18 , wherein a number of acoustic sensors is at least four, and the first TDOA distance values are associated with respective ones of the pairs of acoustic sensors among the at least four acoustic sensors.

20. The at least one non-transitory computer readable medium of claim 19 , wherein the computer readable instructions further cause one or more of the at least one programmable circuit to:

obtain audio signal data from the at least four acoustic sensors and access configuration data that specifies physical locations of the at least four acoustic sensors; and

generate a dataset based on the physical locations specified in the configuration data, the dataset to include physical distance values between respective pairs of acoustic sensors.

21. The at least one non-transitory computer readable medium of claim 20 , wherein respective ones of the first set of constraints are based on combinations of three TDOA distance values and respective ones of the second set of constraints are based on the physical distance values between respective individual ones of the pairs of acoustic sensors.

22. The at least one non-transitory computer readable medium of claim 18 , wherein to adjust the corresponding ones of the first TDOA distance values, the computer readable instructions are to cause one or more of the at least one programmable circuit to add the error values to the corresponding ones of the TDOA distance values to determine the second TDOA distance values.

23. An apparatus comprising:

interface circuitry to access signal data; and

processor circuitry including one or more of:

at least one of a central processing unit, a graphic processing unit or a digital signal processor, the at least one of the central processing unit, the graphic processing unit or the digital signal processor having control circuitry to control data movement within the processor circuitry, arithmetic and logic circuitry to perform one or more first operations corresponding to instructions, and one or more registers to store a result of the one or more first operations, the instructions in the apparatus;

a Field Programmable Gate Array (FPGA), the FPGA including logic gate circuitry, a plurality of configurable interconnections, and storage circuitry, the logic gate circuitry and interconnections to perform one or more second operations, the storage circuitry to store a result of the one or more second operations; or

Application Specific Integrate Circuitry (ASIC) including logic gate circuitry to perform one or more third operations;

the processor circuitry to perform at least one of the first operations, the second operations or the third operations to:

determine error values respectively corresponding to first time difference of arrival (TDOA) distance values between pairs of sensors in a plurality acoustic sensors, the error values based on a cost function, a first set of constraints associated with respective groups of three of the pairs of acoustic sensors, and a second set of constraints associated with individual ones of the pairs of acoustic sensors; and

ones of the first TDOA distance values based on corresponding ones of the error values to determine second TDOA distance values, a first one of the second TDOA distance values based on a first one of the first TDOA distance values and a first one of the error values that corresponds to the first one of the first TDOA distance values.

24. The apparatus of claim 23 , wherein the processor circuitry is to determine a location of an audio source based on the second TDOA distance values.

25. The apparatus of claim 23 , wherein the processor circuitry is to generate the first TDOA distance values based on calculated TDOA values multiplied by a propagation speed of an acoustic signal, a first one of the TDOA values to represent a difference in an arrival time of a signal at a first sensor and an arrival time of the signal at a second sensor, a corresponding first one of the TDOA distance values to represent a first delay distance between the first sensor and the second sensor.

Assignments (1)

Continuity (1)

References Cited (9)