IP Library › Granted Patent US 11,259,112
Granted Patent B1
US 11,259,112 · App. 17/037,344 · Granted Feb 22, 2022

Sound modification based on direction of interest

Inventors: Stefan Marti (Oakland, CA); Evgeny Burmistrov (Saratoga, CA); Priya Seshadri (San Francisco, CA); Joseph Verbeke (San Francisco, CA)
Assignee: Harman International Industries, Incorporated
H04R1/326G06F3/012G06F3/013G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,259,112
App. No.
17/037,344
Granted
Feb 22, 2022
Kind
B1
Abstract

Embodiments of the present disclosure set forth a computer-implemented method comprising determining a first direction of interest associated with a user, receiving a set of audio signals associated with the first direction of interest, determining a first dominant frequency band within the set of audio signals, modifying a first portion of the set of audio signals corresponding to the first dominant frequency band, and outputting the modified set of audio signals.

Claims (56)

1. A computer-implemented method, comprising:

determining a first direction of interest associated with a user;

receiving a set of audio signals associated with the first direction of interest;

determining a first dominant frequency band within the set of audio signals;

modifying a first portion of the set of audio signals corresponding to the first dominant frequency band; and

outputting the modified set of audio signals.

2. The method of claim 1 , wherein determining the first direction of interest associated with the user comprises determining the first direction of interest based on a pointing gesture by the user pointing toward the first direction of interest.

3. The method of claim 1 , wherein determining the first direction of interest associated with the user comprises determining the first direction of interest based on a head direction or an eye gaze direction of the user toward the first direction of interest.

4. The method of claim 1 , wherein modifying the first portion of the set of audio signals corresponding to the first dominant frequency band comprises modifying the first portion of the set of audio signals based on a first user input indicating at least one of a direction or a magnitude of the modifying.

5. The method of claim 4 , wherein the first user input is made by the user subsequent to a second user input indicating the first direction of interest.

6. The method of claim 1 , wherein modifying the first portion of the set of audio signals corresponding to the first dominant frequency band comprises generating a parametric equalizer setting associated with the dominant frequency band.

7. The method of claim 1 , wherein receiving the set of audio signals associated with the first direction of interest comprises physically orienting a directional microphone toward the first direction of interest.

8. The method of claim 1 , wherein receiving the set of audio signals associated with the first direction of interest comprises applying beamforming to audio signals captured by a microphone.

9. The method of claim 1 , further comprising:

determining a second dominant frequency band within the set of audio signals; and

modifying a second portion of the set of audio signals corresponding to the second dominant frequency band.

10. The method of claim 1 , wherein outputting the modified set of audio signals comprises mixing the modified set of audio signals with an omnidirectional audio signal.

11. A system, comprising:

a microphone;

an audio output device;

a memory storing an application; and

a processor that, when executing the application, is configured to:

determining a first direction of interest associated with a user;

receiving, via the microphone, audio signals associated with the first direction of interest;

determining at least one dominant frequency band within the audio signals;

modifying at least one portion of the audio signals corresponding to the at least one dominant frequency band; and

outputting the modified audio signals to the audio output device.

12. The system of claim 11 , wherein the microphone comprises a directional microphone, and receiving the audio signals associated with the first direction of interest comprises physically orienting a directional microphone toward the first direction of interest.

13. The system of claim 11 , wherein receiving the audio signals associated with the first direction of interest comprises applying beamforming to audio signals captured by the microphone.

14. The system of claim 11 , further comprising a sensor device, and wherein the processor, when executing the application, is further configured to detect a user input indicating the first direction of interest via the sensor device.

15. The system of claim 11 , further comprising a sensor device, and wherein the processor, when executing the application, is further configured to:

orient the microphone toward the first direction of interest;

after orienting the microphone, detect movement associated with the user; and

in response to detecting the movement associated with the user, continue to orient the microphone toward the first direction of interest.

16. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

determining a first direction of interest associated with a user;

receiving a set of audio signals;

determining a first dominant frequency band within a first portion of the set of audio signals associated with the first direction of interest;

modifying at least a portion of the set of audio signals corresponding to the first dominant frequency band; and

outputting the modified set of audio signals.

17. The one or more computer-readable storage media of claim 16 , wherein modifying at least the portion of the set of audio signals corresponding to the first dominant frequency band comprises:

generating a parametric equalizer setting associated with the dominant frequency band, wherein the parametric equalizer setting enhances audio signals corresponding to the first dominant frequency band; and

applying the parametric equalizer setting to the first portion of the set of audio signals associated with the first direction of interest.

18. The one or more computer-readable storage media of claim 16 , wherein modifying at least the portion of the set of audio signals corresponding to the first dominant frequency band comprises:

generating a parametric equalizer setting associated with the dominant frequency band, wherein the parametric equalizer setting suppresses audio signals corresponding to the first dominant frequency band; and

applying the parametric equalizer setting to the set of audio signals, wherein the set of audio signals corresponds to an omnidirectional audio signal.

19. The one or more computer-readable storage media of claim 16 , wherein modifying at least the portion of the set of audio signals corresponding to the first dominant frequency band comprises:

generating a parametric equalizer setting associated with the dominant frequency band, wherein the parametric equalizer setting enhances audio signals corresponding to the first dominant frequency band;

applying the parametric equalizer setting to the first portion of the set of audio signals associated with the first direction of interest to generate equalized audio signals;

inverting the equalized audio signals; and

mixing the inverted and equalized audio signals with audio signals corresponding to the omnidirectional audio signal.

20. The one or more computer-readable storage media of claim 16 , wherein modifying at least the portion of the set of audio signals corresponding to the first dominant frequency band comprises:

generating a parametric equalizer setting associated with the dominant frequency band, wherein the parametric equalizer setting enhances audio signals corresponding to the first dominant frequency band;

applying the parametric equalizer setting to the first portion of the set of audio signals associated with the first direction of interest to generate equalized audio signals;

inverting the equalized audio signals; and

outputting the inverted and equalized audio signals to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2021
From: MARTI, STEFAN; BURMISTROV, EVGENY; SESHADRI, PRIYA; VERBEKE, JOSEPH
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 055699/0603 →
Cited By (1)
US 12,206,991