IP Library Granted Patent US 10,979,839
Granted Patent B2
US 10,979,839 · App. 16/578,493 · Granted Apr 13, 2021

Sound pickup device and sound pickup method

Inventors: Satoshi Ukai (Waltham, MA); Tetsuto Kawai (Hamamatsu, JP); Mikio Muramatsu (Fukuroi, JP); Takayuki Inoue (Hamamatsu, JP)
Assignee: Yamaha Corporation
H04R29/006H04R1/406H04R3/005H04R2410/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,979,839
App. No.
16/578,493
Granted
Apr 13, 2021
Kind
B2
Abstract

A sound pickup method obtains a correlation between a first sound pickup signal of a directional first microphone and a second sound pickup signal of a non-directional second microphone, and performs level control of the first sound pickup signal or the second sound pickup signal according to a calculation result of the correlation.

Claims (54)

1. A sound pickup device comprising:

a directional first microphone;

a non-directional second microphone; and

a level controller that:

obtains a first sound pickup signal to be generated from the first microphone and a second sound pickup signal to be generated from the second; microphone

converts the first sound pickup signal and the second sound pickup signal into a first frequency signal and a second frequency signal;

calculates a coherence between the first frequency signal and the second frequency signal;

calculates a ratio of a frequency component of which the calculated coherence exceeds a first threshold value with respect to all frequency components; and

controls a level of the first sound pickup signal or the second sound pickup signal according to the calculated ratio.

2. The sound pickup device according to claim 1 , wherein

the level controller includes a selector that selects as the first sound pickup signal a higher level signal of either an output signal of the first microphone and a difference signal by subtracting the output signal of the first microphone from the output signal of the second microphone.

3. The sound pickup device according to claim 1 , wherein

the level controller estimates a noise component, and, as the level control, performs processing to reduce the estimated noise component from the first sound pickup signal or the second sound pickup signal.

4. The sound pickup device according to claim 3 , wherein

the level controller turns on or off the processing to reduce the noise component according to the calculated ratio.

5. The sound pickup device according to claim 1 , wherein

the level controller includes a comb filter that reduces a harmonic component on a basis of human voice.

6. The sound pickup device according to claim 5 , wherein

the level controller turns on or off processing by the comb filter according to the calculated ratio.

7. The sound pickup device according to claim 1 , wherein

the level controller includes a gain controller that controls a gain of the first sound pickup signal or the second sound pickup signal.

8. The sound pickup device according to claim 7 , wherein

the level controller changes the gain of the gain controller based on the calculated ratio.

9. The sound pickup device according to claim 8 , wherein

the level controller attenuates the gain according to the calculated ratio in a case in which the calculated ratio is less than a first threshold value.

10. The sound pickup device according to claim 9 , wherein

the first threshold value is determined based on the calculated ratio calculated within a predetermined time.

11. The sound pickup device according to claim 8 , wherein

the level controller sets the gain as a minimum gain in a case in which the calculated ratio is less than a second threshold value.

12. The sound pickup device according to claim 1 , wherein

the level controller determines whether or not the coherence exceeds the threshold value for each frequency, obtains the ratio of the frequency component as a total result obtained by totaling a number of frequencies that exceed the threshold value, and performs the level control according to the total result.

13. A sound pickup method comprising:

obtaining a first sound pickup signal of a directional first microphone and a second sound pickup signal of a non-directional second microphone;

converting the first sound pickup signal and the second sound pickup signal into a first frequency signal and a second frequency signal;

calculating a coherence between the first frequency signal and the second frequency signal;

calculating a ratio of a frequency component of which the calculated coherence exceeds a first threshold value with respect to all frequency components;

and controlling a level of the first sound pickup signal or the second sound pickup signal according to the calculated ratio.

14. The sound pickup method according to claim 13 , further comprising selecting as the first sound pickup signal a higher level signal of either an output signal of the first microphone and a difference signal by subtracting the output signal of the first microphone from the output signal of the second microphone.

15. The sound pickup method according to claim 13 , further comprising estimating a noise component, and, as the level control, performing processing to reduce the estimated noise component from the first sound pickup signal or the second sound pickup signal.

16. The sound pickup method according to claim 15 , further comprising turning on or off the processing to reduce the noise component according to the calculated coherence.

17. The sound pickup method according to claim 13 , wherein

a comb filter that reduces a harmonic component on a basis of human voice is used.

18. The sound pickup method according to claim 17 , further comprising turning on or off processing by the comb filter according to the calculated coherence.

19. A sound pickup device comprising:

a directional first microphone;

a non-directional second microphone; and

at least one memory device that stores instructions; and

at least one processor that executes the instructions,

wherein the instructions cause the processor to perform:

obtaining a first sound pickup signal to be generated from the first microphone and a second sound pickup signal to be generated from the second microphone;

converting the first sound pickup signal and the second sound pickup signal into a first frequency signal and a second frequency signal;

calculating a coherence between the first frequency signal and the second frequency signal;

calculating a ratio of a frequency component of which the calculated coherence exceeds a first threshold value with respect to all frequency components; and

controlling a level of the first sound pickup signal or the second sound pickup signal according to the calculated ratio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: UKAI, SATOSHI; KAWAI, TETSUTO; MURAMATSU, MIKIO; INOUE, TAKAYUKI
To: YAMAHA CORPORATION
Reel/Frame 051313/0135 →
Continuity (2)
Continuation PCTJP2017012071 · Mar 24, 2017
Related Publication 20200021932A1 · Jan 16, 2020