IP Library › Granted Patent US 10,206,030
Granted Patent B2
US 10,206,030 · App. 15/001,634 · Granted Feb 12, 2019

Microphone array system and microphone array control method

Inventors: Hiroyuki Matsumoto (Fukuoka, JP); Shuichi Watanabe (Fukuoka, JP); Hisashi Tsuji (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04R1/406G01S5/20H04N5/23293H04R3/005H04R29/008H04R2201/401H04R2430/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,206,030
App. No.
15/001,634
Granted
Feb 12, 2019
Kind
B2
Abstract

A microphone array system includes a camera that images a picture for a target place, and a microphone array that picks up sound. A sound source position is calculated based on the picked up sound. An image is displayed on a display, the image including an imaged target place picture and a sound source position mark indicative of the sound source position. An instruction of a specified spot is received in the target place picture displayed on the display. Sound directivity is formed in a direction from the microphone array toward the specified spot based on the picked up sound, and sound data is generated by emphasizing sound in the direction in which the sound directivity is formed. The generated sound data is output to the speaker to reproduce the sound data.

Claims (30)

1. A microphone array system comprising:

an imaging device that images a picture for a target place;

a display that displays image data which is imaged by the imaging device;

a microphone array that includes a plurality of microphones, and picks up sound using the plurality of microphones;

a sound reproducer that reproduces and outputs the sound which is picked up by the microphone array; and

a processor that performs operations comprising:

calculating a sound source position based on the sound picked up by the microphone array;

displaying, on a display, an image, which includes the picture for the target place and a sound source position mark indicative of the sound source position;

receiving an instruction of a specified spot in the image displayed on the display;

forming sound directivity in a direction from the microphone array toward a position corresponding to the specified spot in the image displayed on the display based on the sound picked up by the microphone array, and generating or composing sound data by emphasizing sound in the direction in which the sound directivity formed; and

outputting the sound data, which is generated or composed after the sound directivity is formed, to cause the sound reproducer to reproduce the sound data,

wherein, the displaying of the image comprises generating a silent area mark, which indicates an area having a volume level equal to or lower than a predetermined value for the sound source position, and displaying the generated silent area mark on the display.

2. The microphone array system according to claim 1 ,

wherein, when a plurality of sound source positions are calculated, the sound source position marks corresponding to the plurality of respective sound source positions are generated and displayed on the display.

3. The microphone array system according to claim 2 ,

wherein, when the instruction of the specified spot corresponding to one of the plurality of sound source positions is received, the sound data is generated and composed by emphasizing the sound in the direction from the microphone array toward the sound source position of the specified spot.

4. A microphone array control method comprising:

imaging a picture for a target place by an imaging device;

picking up sound, by a microphone array that includes a plurality of microphones;

calculating a sound source position based on the picked up sound;

displaying, on a display, an image, which includes the picture of the target place and a sound source position mark indicative of the sound source position;

receiving an instruction of a specified spot in the image displayed on the display;

forming sound directivity in a direction from the microphone array toward a position corresponding to the specified spot in the image displayed on the display, based on the sound picked up by the microphone array, and generating or composing sound data by emphasizing sound in the direction in which the sound directivity is formed; and

outputting the sound data, which is generated or composed after the sound directivity is formed,

wherein, the displaying of the image comprises generating a silent area mark, which indicates an area having a volume level equal to or lower than a predetermined value for the sound source position, and displaying the generated silent area mark on the display.

5. The microphone array control method according to claim 4 ,

wherein, when a plurality of sound source positions are calculated, sound source position marks corresponding to the plurality of respective sound source positions are generated and displayed on the display.

6. The microphone array control method according to claim 5 ,

wherein, when the instruction of the specified spot corresponding to one of the plurality of sound source positions is received, the sound data is generated and composed by emphasizing the sound in the direction from the microphone array toward the sound source position of the specified spot.

7. The microphone array system according to claim 1 , wherein the imaging device comprises a camera, and the sound reproducer comprises a speaker.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2016
From: MATSUMOTO, HIROYUKI; WATANABE, SHUICHI; TSUJI, HISASHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 037660/0255 →
Priority Claims (1)
JP 2015-022423 · Feb 6, 2015 · national
Continuity (1)
Related Publication 20160234593A1 · Aug 11, 2016
Cited By (14)
US 12,250,526 US 12,256,169 US 12,262,174 US 12,284,479 US 12,289,584 US 12,309,326 US 12,425,766 US 12,452,584 US 12,490,023 US 12,501,207 US 12,525,083 US 12,542,123 US 12,598,261 US 12,689,855