IP Library › Granted Patent US 10,582,288
Granted Patent B2
US 10,582,288 · App. 15/575,302 · Granted Mar 3, 2020

Sports headphone with situational awareness

Inventors: James M. Kirsch (Salt Lake City, UT); Jeffrey Hutchings (Sandy, UT)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
H04R1/1041H04R1/1083H04R5/033H04R2430/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,582,288
App. No.
15/575,302
Granted
Mar 3, 2020
Kind
B2
Abstract

One or more embodiments set forth an audio processing system for a personal listening device that includes a set of microphones, a noise reduction module, an audio ducker, and a mixer. The set of microphones is configured to receive a first set of audio signals from an environment. The noise reduction module is configured to detect when a signal of interest is present in the first plurality of audio signals, and, upon detecting a signal of interest, transmit a ducking control signal. The audio ducker is configured to receive the ducking control signal, and receive a second plurality of audio signals via a playback device. The audio ducker is further configured to reduce an amplitude of a second plurality of audio signals relative to the signal of interest based on the ducking control signal. The mixer combines the first plurality of audio signals and second plurality of audio signals.

Claims (80)

1. An audio processing system for a personal listening device, comprising:

a first plurality of microphones integrated into the personal listening device and configured to receive a first plurality of audio signals from an environment;

a noise reduction circuit coupled to the first plurality of microphones and configured to:

detect that a signal of interest is present in the first plurality of audio signals, by:

dividing the first plurality of audio signals into a plurality of frequency bins, and

determining that at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than a threshold amount;

in response to determining that the at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than the threshold amount, amplify the at least one of the plurality of frequency bins; and

upon detecting the signal of interest, transmit a ducking control signal;

an audio ducker coupled to the noise reduction circuit and configured to:

receive the ducking control signal,

receive a second plurality of audio signals via a playback device,

reduce an amplitude of the second plurality of audio signals relative to the signal of interest based on the ducking control signal; and

a mixer coupled to the audio ducker and configured to combine the first plurality of audio signals and the second plurality of audio signals.

2. The audio processing system of claim 1 , wherein the noise reduction circuit is further configured to:

determine that a first portion of the first plurality of audio signals corresponding to a first frequency band includes a noise signal; and

reduce an amplitude of the first portion of the first plurality of audio signals.

3. The audio processing system of claim 1 , wherein the noise reduction circuit is further configured to:

determine that a first portion of the first plurality of audio signals corresponding to a first frequency band includes the signal of interest; and

amplify the first portion of the first plurality of audio signals.

4. The audio processing system of claim 1 , further comprising an equalizer configured to perform frequency-based amplitude adjustments on the first plurality of audio signals to compensate for an acoustic change resulting from a physical characteristic of the personal listening device.

5. The audio processing system of claim 1 , further comprising a gate configured to:

determine that a first portion of the first plurality of audio signals is below a threshold amplitude; and

reduce an amplitude of the first portion of the first plurality of audio signals.

6. The audio processing system of claim 1 , further comprising a limiter configured to:

determine that a first portion of the first plurality of audio signals is above a maximum allowable amplitude; and

limit an amplitude of the first portion of the first plurality of audio signals to be no greater than the maximum allowable amplitude.

7. The audio processing system of claim 1 , further comprising a subharmonic processor configured to:

synthesize one or more subharmonic signals corresponding to at least a portion of the second plurality of audio signals to generate a third plurality of audio signals; and

combine the second audio signals with the third plurality of audio signals.

8. The audio processing system of claim 1 , further comprising an automatic gain controller configured to:

calculate a target audio level corresponding to the second plurality of audio signals;

determine that at least a portion of the second plurality of audio signals differs from the target audio level;

calculate a scaling factor such that, when the second plurality of audio signals are multiplied by the scaling factor, the resulting audio signals are closer to the target audio level; and

multiply the second plurality of audio signals by the scaling factor.

9. The audio processing system of claim 1 , wherein the signal of interest comprises an intermittent audio sound having a high audio level relative to an average audio signal level associated with the first plurality of audio signals.

10. The audio processing system of claim 9 , further comprising an amplifier configured to:

amplify the first plurality of audio signals; and

transmit the first plurality of audio signals to a speaker to generate sound output.

11. A method for processing playback and environmental audio signals, the method comprising:

receiving a first plurality of audio signals from an environment;

detecting that a signal of interest is present in the first plurality of audio signals, wherein the signal of interest comprises an intermittent audio sound having a high audio level relative to an average audio signal level associated with the first plurality of audio signals, by:

dividing the first plurality of audio signals into a plurality of frequency bins, and

determining that at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than a threshold amount;

in response to determining that the at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than the threshold amount, amplifying the at least one of the plurality of frequency bins;

upon detecting the signal of interest, generating a ducking control signal;

receiving a second plurality of audio signals via a playback device;

reducing an amplitude of the second plurality of audio signals relative to the signal of interest based on the ducking control signal; and

combining the first plurality of audio signals and the second plurality of audio signals.

12. The method of claim 11 , further comprising:

identifying a direction from where the first plurality of audio signals is originating; and

attenuating the first plurality of audio signals based on the direction.

13. The method of claim 12 , wherein attenuating the first plurality of audio signals comprises:

receiving a selection of a beamforming mode;

calculating a scaling factor based on the beamforming mode and the direction; and

applying the scaling factor to the first plurality of audio signals.

14. The method of claim 13 , wherein the beamforming mode comprises an omnidirectional mode, a dipole mode, or a cardioid mode.

15. The method of claim 11 , further comprising:

determining that a first portion of the first plurality of audio signals corresponding to a first frequency band includes a noise signal; and

reducing an amplitude of the first portion of the first plurality of audio signals.

16. The method of claim 11 , further comprising:

determining that a first portion of the first plurality of audio signals corresponding to a first frequency band includes the signal of interest; and

amplifying the first portion of the first plurality of audio signals.

17. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to process playback and environmental audio signals, by performing the steps of:

receiving a first plurality of audio signals from an environment;

detecting that a signal of interest is present in the first plurality of audio signals, wherein the signal of interest comprises an intermittent audio sound having a high audio level relative to an average audio signal level associated with the first plurality of audio signals, by:

dividing the first plurality of audio signals into a plurality of frequency bins, and

determining that at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than a threshold amount;

in response to determining that the at least one of the plurality of frequency bins is associated with an amplitude that fluctuates more than the threshold amount, amplifying the at least one of the plurality of frequency bins;

upon detecting the signal of interest, generating a ducking control signal;

receiving a second plurality of audio signals via a playback device;

reducing an amplitude of the second plurality of audio signals relative to the signal of interest based on the ducking control signal; and

combining the first plurality of audio signals and the second plurality of audio signals.

18. The non-transitory computer-readable storage medium of claim 17 , further including instructions that, when executed by the processor, cause the processor to perform the steps of:

identifying a direction from where the first plurality of audio signals is originating; and

attenuating the first plurality of audio signals based on the direction.

19. The non-transitory computer-readable storage medium of claim 18 , wherein attenuating the first plurality of audio signals comprises:

receiving a selection of a beamforming mode;

calculating a scaling factor based on the beamforming mode and the direction; and

applying the scaling factor to the first plurality of audio signals.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the beamforming mode comprises an omnidirectional mode, a dipole mode, or a cardioid mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2018
From: KIRSCH, JAMES M.; HUTCHINGS, JEFFREY
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 045273/0603 →
Continuity (1)
Related Publication 20180160211A1 · Jun 7, 2018
Cited By (2)
US 12,501,211 US 12,542,997