IP Library Granted Patent US 12,015,901
Granted Patent B2
US 12,015,901 · App. 17/830,931 · Granted Jun 18, 2024

Information processing device, and calculation method

Inventors: Tomoharu Awano (Tokyo, JP); Masaru Kimura (Tokyo, JP)
Assignee: Mitsubishi Electric Corporation
H04R3/005H04R1/406H04R3/04H04R29/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,015,901
App. No.
17/830,931
Granted
Jun 18, 2024
Kind
B2
Abstract

An information processing device includes a sound signal acquisition unit that acquires sound signals outputted from a mic array, an analysis unit that analyzes frequencies of the sound signals, an information acquisition unit that acquires predetermined information indicating a steering vector in a first direction as a direction from the mic array to a target sound source, and a calculation unit that calculates a filter for formation in a second direction as a direction different from the first direction based on the frequencies and the information indicating the steering vector in the first direction and calculates a steering vector in the second direction by using an expression indicating a relationship between the calculated filter and the steering vector in the second direction.

Claims (44)

1. An information processing device comprising:

a sound signal acquiring circuitry to acquire sound signals outputted from a plurality of microphones;

an analyzing circuitry to analyze frequencies of the sound signals;

an information acquiring circuitry to acquire predetermined information indicating a steering vector in a first direction as a direction from the plurality of microphones to a target sound source; and

a first calculating circuitry to calculate a filter for formation in a second direction as a direction different from the first direction based on the frequencies and the information indicating the steering vector in the first direction and calculate a steering vector in the second direction by using an expression indicating a relationship between the calculated filter and the steering vector in the second direction.

2. The information processing device according to claim 1 , further comprising a second calculating circuitry, wherein

the information acquiring circuitry acquires predetermined information indicating the steering vector in the second direction, and

the second calculating circuitry calculates a filter for formation in the first direction based on the frequencies and the information indicating the steering vector in the second direction and calculates the steering vector in the first direction by using an expression indicating a relationship between the calculated filter and the steering vector in the first direction.

3. The information processing device according to claim 2 , wherein

the second calculating circuitry includes a beamforming processing circuitry, and

the beamforming processing circuitry executes a process of forming a beam in the second direction based on the calculated steering vector in the second direction.

4. The information processing device according to claim 2 , wherein

the first calculating circuitry includes a beamforming processing circuitry, and

the beamforming processing circuitry executes a process of forming a beam in the first direction based on the calculated steering vector in the first direction.

5. The information processing device according to claim 2 , wherein

the sound signal acquiring circuitry acquires sound signals outputted from the plurality of microphones after the calculation of the steering vector in the first direction, and

the first calculating circuitry calculates the filter for the formation in the second direction by using frequencies of the sound signals acquired after the calculation of the steering vector in the first direction and the calculated steering vector in the first direction and calculates the steering vector in the second direction by using an expression indicating a relationship between the calculated filter and the steering vector in the second direction.

6. The information processing device according to claim 2 , wherein

the sound signal acquiring circuitry acquires sound signals outputted from the plurality of microphones after the calculation of the steering vector in the second direction, and

the second calculating circuitry calculates the filter for the formation in the first direction by using frequencies of the sound signals acquired after the calculation of the steering vector in the second direction and the calculated steering vector in the second direction and calculates the steering vector in the first direction by using an expression indicating a relationship between the calculated filter and the steering vector in the first direction.

7. The information processing device according to claim 2 , wherein

each time sound signals outputted from the plurality of microphones are acquired, the second calculating circuitry calculates the filter for the formation in the first direction by using frequencies of the acquired sound signals, the information indicating the steering vector in the second direction, and a cross-correlation matrix, and

the cross-correlation matrix is an average of a matrix representing frequency components of the acquired sound signals and the cross-correlation matrix used in the calculation of the filter at the previous time.

8. The information processing device according to claim 7 , further comprising a speech judging circuitry to judge whether or not there occurred speech in the first direction or the second direction based on an image obtained by photographing a user or sound signals outputted from the plurality of microphones,

wherein the second calculating circuitry calculates the filter for the formation in the first direction when there occurred speech in the first direction.

9. The information processing device according to claim 1 , wherein

each time sound signals outputted from the plurality of microphones are acquired, the first calculating circuitry calculates the filter for the formation in the second direction by using frequencies of the acquired sound signals, the information indicating the steering vector in the first direction, and a cross-correlation matrix, and

the cross-correlation matrix is an average of a matrix representing frequency components of the acquired sound signals and the cross-correlation matrix used in the calculation of the filter at the previous time.

10. The information processing device according to claim 9 , further comprising a speech judging circuitry to judge whether or not there occurred speech in the first direction or the second direction based on an image obtained by photographing a user or sound signals outputted from the plurality of microphones,

wherein the first calculating circuitry calculates the filter for the formation in the second direction when there occurred speech in the second direction.

11. A calculation method performed by an information processing device, the calculation method comprising:

acquiring sound signals outputted from a plurality of microphones;

analyzing frequencies of the sound signals;

acquiring predetermined information indicating a steering vector in a first direction as a direction from the plurality of microphones to a target sound source;

calculating a filter for formation in a second direction as a direction different from the first direction based on the frequencies and the information indicating the steering vector in the first direction; and

calculating a steering vector in the second direction by using an expression indicating a relationship between the calculated filter and the steering vector in the second direction.

12. An information processing device comprising:

a processor to execute a program; and

a memory to store the program which, when executed by the processor, performs processes of,

acquiring sound signals outputted from a plurality of microphones;

analyzing frequencies of the sound signals;

acquiring predetermined information indicating a steering vector in a first direction as a direction from the plurality of microphones to a target sound source;

calculating a filter for formation in a second direction as a direction different from the first direction based on the frequencies and the information indicating the steering vector in the first direction; and

calculating a steering vector in the second direction by using an expression indicating a relationship between the calculated filter and the steering vector in the second direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2022
From: AWANO, TOMOHARU; KIMURA, MASARU
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 060104/0702 →
Continuity (2)
Continuation PCTJP2019049975 · Dec 20, 2019
Related Publication 20220295180A1 · Sep 15, 2022