IP Library Granted Patent US 10,225,650
Granted Patent B2
US 10,225,650 · App. 15/533,399 · Granted Mar 5, 2019

Directivity control system, directivity control device, abnormal sound detection system provided with either thereof and directivity control method

Inventors: Hideki Tatematsu (Hyogo, JP); Shugo Yamamiya (Kanagawa, JP); Takatsugu Ito (Kanagawa, JP); Xia Yang (Fukuoka, JP); Yoshikazu Otonari (Fukuoka, JP); Hiroyuki Maruyama (Kanagawa, JP); Masanori Hagihara (Fukuoka, JP); Ryuuichi Yatsunami (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04R1/406G06F3/0486G06F3/04845G06F3/04883G06F3/165G08B13/1672H04N5/23293H04N5/23296H04N7/18H04R3/005G06F2203/04803G06F2203/04806G08B13/1963
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,225,650
App. No.
15/533,399
Granted
Mar 5, 2019
Kind
B2
Abstract

By registering a set range and a sound type which are not subject to detection of an abnormal sound in advance, a PC performs an alert notification in a case of detecting a sound which is regarded as an abnormal sound, and does not perform an alert notification in a case of detecting a sound which is not regarded as an abnormal sound. That is, in a target area such as a hotel lobby, a sound output from a television provided therein, a water sound emitted by a fountain, and the like are no longer erroneously detected as an abnormal sound. Further, the PC forms the directivity of sound data in a direction toward an actual position corresponding to a designated position on an image of a sound pickup area displayed on a display.

Claims (76)

1. An abnormal sound detection system comprising:

a sound pickup device, including a microphone, that picks up a sound in the sound pickup area including a plurality of abnormal sound detection areas,

an imaging device that images the sound pickup area;

a display that displays an image of the sound pickup area which is imaged by the imaging device;

a processor that performs operations including:

receiving a switching operation to switch a display range of the sound pickup area displayed on the display; and

forming directivity for the sound picked up by the sound pickup device, in a direction toward an actual position corresponding to a designated position on the image of the sound pickup area displayed on the display, in response to the switching operation of the display range of the sound pickup area; and

a storage that stores an abnormality notification exclusion list in which each of the plurality of abnormal sound detection areas and an abnormal sound are associated with each other,

wherein the processor further performs operations including:

designating an abnormal sound detection area of the plurality of abnormal sound detection areas;

forming directivity for the sound picked up by the sound pickup device, in a direction toward the designated abnormal sound detection area;

determining whether or not an abnormal sound is detected in the sound for which the directivity is formed;

determining, when an abnormal sound is detected, whether or not the detected abnormal sound is associated with the designated abnormal sound detection area in the abnormality notification exclusion list,

refraining from performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is determined to be associated with the designated abnormal sound detection area in the abnormality notification exclusion list, and

performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is not determined to be associated with the designated abnormal sound detection area in the abnormality notification exclusion list.

2. The abnormal sound detection system of claim 1 ,

wherein the processor forms directivity for the sound picked up by the sound pickup device, such that a formation range of the directivity is narrowed, as the image of the sound pickup area displayed on the display is enlarged, in response to the switching operation.

3. The abnormal sound detection system of claim 1 ,

wherein the designated position is a substantially center position on the image of the sound pickup area, which is displayed on the display in response to the switching operation.

4. The abnormal sound detection system of claim 1 ,

wherein the switching operation includes at least one of zoom-in, zoom-out, and drag operations.

5. The abnormal sound detection system of claim 4 ,

wherein, in response to the drag operation performed when an image of the display range corresponding to the zoom-in operation is displayed on the display, the processor changes the directivity for the sound data from a direction toward an actual position corresponding to a designated position on an image of the sound pickup area displayed on the display before the drag operation to a direction toward an actual position corresponding to a designated position on an image of the sound pickup area displayed on the display after the drag operation.

6. The abnormal sound detection system of claim 1 ,

wherein the processor sets a size of a formation range of the directivity for the sound to be constant even if the display range is switched.

7. The abnormal sound detection system of claim 1 ,

wherein, when the image of the sound pickup area displayed on the display is a whole of an imaging possible area of the imaging device, the processor outputs sound data which is picked up by the sound pickup device omnidirectionally.

8. The abnormal sound detection system of claim 1 ,

wherein the abnormal sound detection area is an area having a predetermined shape.

9. The abnormal sound detection system of claim 8 ,

wherein the area having a predetermined shape is an area drawn by a predetermined input operation.

10. The abnormal sound detection system of claim 1 , further comprising:

an additional imaging device and

an additional display that displays an image of the abnormal sound detection area, which is imaged by the additional imaging device and a subject of the alert notification, when a predetermined instruction operation for the alert notification is performed.

11. The abnormal sound detection system of claim 1 , wherein the processor further performs operations including:

setting the plurality of abnormal sound detection areas, by using the image of the sound pickup area which is imaged by the imaging device.

12. An abnormal sound detection system comprising:

a sound pickup that acquires a sound in the sound pickup area including a plurality of abnormal sound detection areas,

an imaging sensor that images the sound pickup area;

a display that displays an image of the sound pickup area which is imaged by the imaging sensor;

a processor that performs operations comprising:

receiving a switching operation to switch a display range of the sound pickup area displayed on the display; and

forming directivity for the sound acquired by the sound pickup, in a direction toward an actual position corresponding to a designated position on the image of the sound pickup area displayed on the display, in response to the switching operation of the display range of the sound pickup area; and

a storage that stores an abnormality notification exclusion list in which each of the plurality of abnormal sound detection areas and an abnormal sound are associated with each other,

wherein the processor further performs operations including:

designating an abnormal sound detection area of the plurality of abnormal sound detection areas;

forming directivity for the sound acquired by the sound pickup, in a direction toward the designated abnormal sound detection area;

determining whether or not an abnormal sound is detected in the sound for which the directivity is formed;

determining, when an abnormal sound is detected, whether or not the detected abnormal sound is associated with the designated abnormal sound detection area in the abnormality notification exclusion list,

refraining from performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is determined to be associated with the designated abnormal sound detection area in the abnormality notification exclusion list, and

performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is not determined to be associated with the abnormal sound detection area in the abnormality notification exclusion list.

13. An abnormal sound detection method in an abnormal sound detection system including a sound pickup device and an imaging device, comprising:

picking up a sound in a sound pickup area including a plurality of abnormal sound detection areas by the sound pickup device;

imaging the sound pickup area by the imaging device;

displaying an image of the sound pickup area which is imaged by the imaging device on a display;

receiving a switching operation to switch a display range of the sound pickup area displayed on the display;

forming directivity for the sound picked up by the sound pickup device, in a direction toward an actual position corresponding to a designated position on the image of the sound pickup area displayed on the display, in response to the switching operation of the display range of the sound pickup area;

storing, in a storage, an abnormality notification exclusion list in which each of the plurality of abnormal sound detection areas and an abnormal sound are associated with each other;

designating an abnormal sound detection area of the plurality of abnormal sound detection areas;

forming directivity for the sound picked up by the sound pickup device, in a direction toward the designated abnormal sound detection area;

determining whether or not an abnormal sound is detected in the sound for which the directivity is formed;

determining, when an abnormal sound is detected, whether or not the detected abnormal sound is associated with the designated abnormal sound detection area in the abnormality notification exclusion list;

refraining from performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is determined to be associated with the designated abnormal sound detection area in the abnormality notification exclusion list; and

performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is not determined to be associated with the abnormal sound detection area in the abnormality notification exclusion list.

14. An abnormal sound detection method in an abnormal sound detection apparatus including a sound pickup and an imaging sensor, comprising:

acquiring a sound in a sound pickup area including a plurality of abnormal sound detection areas;

acquiring an image of the sound pickup area;

displaying the acquired image of the sound pickup area on a display;

receiving a switching operation to switch a display range of the sound pickup area displayed on the display;

forming directivity for the acquired sound in a direction toward an actual position corresponding to a designated position on the image of the sound pickup area displayed on the display, in response to the switching operation of the display range of the sound pickup area;

storing, in a storage, an abnormality notification exclusion list in which each of the plurality of abnormal sound detection areas and an abnormal sound are associated with each other designating an abnormal sound detection area of the plurality of abnormal sound detection areas;

forming directivity for the acquired sound, in a direction toward the designated abnormal sound detection area;

determining whether or not an abnormal sound is detected in the sound for which the directivity is formed;

determining, when an abnormal sound is detected, whether or not the detected abnormal sound is associated with the designated abnormal sound detection area in the abnormality notification exclusion list,

refraining from performing the alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is determined to be associated with the designated abnormal sound detection area in the abnormality notification exclusion list, and

performing an alert notification corresponding to the detected abnormal sound, when the detected abnormal sound is not determined to be associated with the abnormal sound detection area in the abnormality notification exclusion list.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2017
From: TATEMATSU, HIDEKI; YAMAMIYA, SHUGO; ITO, TAKATSUGU; YANG, XIA; OTONARI, YOSHIKAZU; MARUYAMA, HIROYUKI; HAGIHARA, MASANORI; YATSUNAMI, RYUUICHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 043393/0481 →
Priority Claims (2)
JP 2014-259321 · Dec 22, 2014 · national
JP 2014-259323 · Dec 22, 2014 · national
Continuity (1)
Related Publication 20170353788A1 · Dec 7, 2017
Cited By (1)
US 12,256,169