IP Library Granted Patent US 11,335,357
Granted Patent B2
US 11,335,357 · App. 16/103,039 · Granted May 17, 2022

Playback enhancement in audio systems

Inventor: Joseph Gaalaas (Woodbury, MN)
Assignee: BOSE CORPORATION
G10L21/0364G10L21/0216H04R5/04G10L2021/02082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,335,357
App. No.
16/103,039
Filed
Aug 14, 2018
Granted
May 17, 2022
Kind
B2
Art Unit
2654
USPC
704/226
Abstract

Audio systems and methods are provided that enhance a portion of audio content relative to other portions of the audio content. The systems and methods select the portion to be enhanced and calculate an intelligibility metric of the selected portion, such as a dialogue portion. The systems and methods determine a gain based at least in part upon the intelligibility metric and apply the gain to the selected portion to provide an enhanced portion. The systems and methods provide an audio signal, based at least in part upon the enhanced portion, to an output for conversion to an acoustic signal, such as by an acoustic transducer.

Claims (40)

1. An audio sound system, comprising:

an input to receive input audio content to be played in a listening environment;

an output configured to provide an audio signal;

at least one playback device configured to play the audio signal in the listening environment; and

a processor coupled to the input and to the output and configured to select a portion of the input audio content to be enhanced relative to other portions of the input audio content, to calculate a first signal energy value of the selected portion and a second signal energy value of the other portions of the input audio content to calculate an intelligibility metric of the selected portion based on the first and second signal energy values and an input from the listening environment, to calculate a reference intelligibility metric based on the input audio content and acoustic properties of a reference environment, to determine a gain based at least in part upon a comparison of the intelligibility metric to the reference intelligibility metric, to apply the gain to the selected portion to provide an enhanced portion, to produce output audio content by combining the enhanced portion with the other portions of the input audio content, and to provide the output audio content to the output as the audio signal,

wherein the at least one playback device is configured to play the audio signal including the enhanced portion in the listening environment to provide a listening experience corresponding to the reference environment.

2. The audio sound system of claim 1 wherein the processor is further configured to select the portion of the input audio content as a dialogue portion and to calculate the intelligibility metric as a speech intelligibility metric of the selected dialogue portion relative to the other portions of the input audio content.

3. The audio sound system of claim 2 wherein the processor is further configured to select the portion of the input audio content as a dialogue portion based upon at least one of a center channel of the input audio content and a correlated portion of a left and right channel of the input audio content.

4. The audio sound system of claim 1 further comprising one or more microphones to detect environmental acoustic signals in the listening environment and to provide an environmental noise signal, the processor being further configured to calculate the intelligibility metric of the selected portion relative to a combination of the other portions and the environmental noise signal.

5. The audio sound system of claim 4 further comprising an echo canceller coupled to the one or more microphones to reduce the environmental acoustic signals from the one or more microphones to provide the environmental noise signal.

6. The audio sound system of claim 1 wherein the processor is further configured to calculate an enhanced intelligibility metric of the enhanced portion relative to the other portions of the input audio content and to determine the gain based at least in part upon the intelligibility metric and the enhanced intelligibility metric.

7. A method of enhancing audio content in an audio sound system having an input to receive input audio content to be played a listening environment, an output to provide an audio signal, and at least one playback device configured to play the audio signal in the listening environment, the method comprising:

selecting a portion of the input audio content to be enhanced;

calculating a first signal energy value of the selected portion and a second signal energy value of the other portions of the input audio signal;

calculating an intelligibility metric of the selected portion based on the first and second signal energy values and an input from the listening environment;

calculating a reference intelligibility metric based on the input audio content and acoustic properties of a reference environment;

determining a gain based at least in part upon a comparison of the intelligibility metric to the reference intelligibility metric;

applying the gain to the selected portion to provide an enhanced portion; combining the enhanced portion with the other portions of the input audio content to produce output audio content;

providing the output audio content to the output as the audio signal; and

playing the audio signal including the enhanced portion in the listening environment via the at least one playback device to provide a listening experience corresponding to the reference environment.

8. The method of claim 7 wherein selecting a portion of the input audio content comprises selecting a dialogue portion.

9. The method of claim 8 wherein the dialogue portion is derived from at least one of a center channel of the input audio content and a correlated portion of a left and right channel of the input audio content.

10. The method of claim 7 further comprising detecting an environmental noise signal, and calculating the intelligibility metric of the selected portion relative to a combination of the other portions and the environmental noise signal.

11. The method of claim 10 further comprising reducing an echo component of the environmental noise signal, the echo component correlated to the input audio content.

12. The method of claim 7 further comprising calculating an enhanced intelligibility metric of the enhanced portion relative to the other portions, and determining the gain based at least in part upon the intelligibility metric includes determining the gain based at least in part upon the enhanced intelligibility metric.

13. An audio sound system, comprising:

an input to receive a selected signal of an input program content signal to be played in a listening environment;

an input to receive other portions of the input program content signal;

an input to receive an environmental noise signal from the listening environment;

an output configured to provide an output program content signal;

at least one playback device configured to play the output program content signal in the listening environment; and

a processor configured to calculate a first signal energy value for the selected signal and a second signal energy value for the other portions of the input program content signal, to calculate an intelligibility metric of the selected signal based on the first and second signal energy values and the environmental noise signal, to calculate a reference intelligibility metric based on the selected signal and acoustic properties of a reference environment, to determine a gain based at least in part upon a comparison of the intelligibility metric to the reference intelligibility metric, to apply the gain to the selected signal to provide an enhanced signal, to produce the output program content signal by combining the enhanced signal with the other portions of the input program content signal, and to provide the output program content signal to the output,

wherein the at least one playback device is configured to play the output program content signal including the enhanced portion in the listening environment to provide a listening experience corresponding to the reference environment.

14. The audio sound system of claim 13 further comprising one or more microphones to provide the environmental noise signal.

15. The audio sound system of claim 13 wherein the processor is further configured to provide a dialogue signal as the selected signal.

16. The audio sound system of claim 15 wherein the processor is further configured to provide the dialogue signal based upon at least one of a center channel of the input program content signal and a correlated portion of a left and right channel of the input program content signal.

17. The audio sound system of claim 13 wherein the processor is further configured to calculate an enhanced intelligibility metric of the enhanced signal relative to the other portions and to determine the gain based at least in part upon the intelligibility metric and the enhanced intelligibility metric.

18. The audio sound system of claim 1 wherein the processor is configured to calculate the intelligibility metric based on the input from the listening environment including at least one of the input audio content played in the listening environment and noise in the listening environment produced by an external source in the listening environment.

19. The method of claim 7 wherein calculating the intelligibility metric is based on the input from the listening environment including at least one of the input audio content played in the listening environment and noise in the listening environment produced by an external source in the listening environment.

20. The audio sound system of claim 13 wherein the processor is configured to calculate the intelligibility metric based on the environmental noise signal being produced from at least one of the input program content signal played in the listening environment and noise in the listening environment produced by an external source in the listening environment.

Assignments (2)
SECURITY INTEREST Recorded Feb 28, 2025
From: BOSE CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 070438/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2018
From: GAALAAS, JOSEPH
To: BOSE CORPORATION
Reel/Frame 046958/0422 →
Continuity (1)
Related Publication 20200058317A1 · Feb 20, 2020