IP Library › Granted Patent US 11,232,689
Granted Patent B2
US 11,232,689 · App. 16/733,814 · Granted Jan 25, 2022

Smoke detection method with visual depth

Inventors: Tsung-Han Lee (Kaohsiung, TW); Jinn-Feng Jiang (Kaohsiung, TW); Shih-Chun Hsu (Kaohsiung, TW); Tsu-Kun Chang (Kaohsiung, TW); Hung-Yuan Wei (Kaohsiung, TW)
Assignee: Metal Industries Research & Development Centre
G08B17/10G01B11/25G06K9/00771
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,689
App. No.
16/733,814
Granted
Jan 25, 2022
Kind
B2
Abstract

The present invention provides a smoke detection method with visual depth, which uses an image camera and a depth camera to extract surrounding images and surrounding depth information. A vehicle is used to patrol an area, such as the area of a processing factory, for receiving the surrounding environment information and detecting existence of burning objects or smoke. Then a processor adopting the clustering algorithm is used to estimate the smoke distribution or the location of fire source of burning objects, and uses an alarm to provide alarm information. Thereby, the rescue crew can prepare in advance and respond immediately. By providing the correct information to the firemen in the fire scenes, the time to control the fire can be shortened and the time for evacuation can be increased.

Claims (84)

1. A smoke detection method with visual depth, comprising steps of:

providing an image camera and a depth camera;

extracting a plurality of surrounding images according to said image camera, and acquiring a plurality pieces of surrounding depth information of said plurality of surrounding images according to said depth camera;

identifying one or more burning object in said plurality of surrounding images according to a processor;

acquiring image information and an outline of said one or more burning object according to said plurality of surrounding images and said plurality pieces of surrounding depth information;

estimating the smoke distribution of said one or more burning object or a location of fire source thereof according to said image information of said one or more burning object and said outline thereof and according to a clustering algorithm; and

producing alarm information according to the smoke distribution of said one or more burning object or the location of fire source thereof.

2. The smoke detection method with visual depth of claim 1 , wherein said step of identifying one or more burning object in said plurality of surrounding images according to the processor, said one or more burning object includes smoke and a fire source.

3. The smoke detection method with visual depth of claim 1 , wherein said one or more depth camera includes a structured-light projection module and a structured-light camera; said structured-light projection module projects a plurality of light planes to said one or more burning object; said structured-light camera receives a light-image message reflected by the projection of said plurality of light plane for acquiring the plurality pieces of surrounding depth information.

4. The smoke detection method with visual depth of claim 3 , wherein said structured-light projection module includes a laser light-emitting device and a lens set.

5. The smoke detection method with visual depth of claim 1 , wherein said step of producing alarm information according to the smoke distribution of said one or more burning object or the location of fire source thereof, one or more audio unit of said alarm module is used to launch said alarm information.

6. The smoke detection method with visual depth of claim 1 , wherein said clustering algorithm adopts the equations

μ

j

=

∑

i

=

1

m

⁢

{

c

i

=

j

}

⁢

x

i

∑

i

=

1

m

⁢

{

c

i

=

j

}

and C i =argmin ∥x i −μ j ∥ 2 ; K is the number of clusters; C i is the classification of the sample set i closest to the cluster K; μ j is the estimated location of the first cluster center; and j is the center of mass of each cluster center.

7. The smoke detection method with visual depth of claim 1 , wherein said image camera or said depth camera is installed on a vehicle.

8. The smoke detection method with visual depth of claim 7 , wherein said vehicle includes a mobile vehicle.

9. A smoke detection method with visual depth, comprising steps of:

providing an image camera and a depth camera;

extracting a plurality of surrounding images according to said image camera, and acquiring a plurality pieces of surrounding depth information of said plurality of surrounding images according to said depth camera;

acquiring image information and an outline of one or more burning object according to said plurality of surrounding images and said plurality pieces of surrounding depth information;

estimating the smoke distribution or a location of fire source of said one or more burning object according to said image information of said one or more burning object and said outline thereof and according to a clustering algorithm; and

producing alarm information according to the smoke distribution of said one or more burning object or the location of fire source thereof;

where said clustering algorithm adopts the equations

μ

j

=

∑

i

=

1

m

⁢

{

c

i

=

j

}

⁢

x

i

∑

i

=

1

m

⁢

{

c

i

=

j

}

and C i =argmin ∥x i −μ j ∥ 2 ; K is the number of clusters; C i is the classification of the sample set i closest to the cluster K; μ j is the estimated location of the first cluster center; and j is the center of mass of each cluster center.

10. The smoke detection method with visual depth of claim 9 , further comprising a step of identifying said one or more burning object in said plurality of surrounding images according to a processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2020
From: LEE, TSUNG-HAN; JIANG, JINN-FENG; HSU, SHIH-CHUN; CHANG, TSU-KUN; WEI, HUNG-YUAN
To: METAL INDUSTRIES RESEARCH & DEVELOPMENT CENTRE
Reel/Frame 051417/0929 →
Priority Claims (1)
TW 108100444 · Jan 4, 2019 · national
Continuity (1)
Related Publication 20200273309A1 · Aug 27, 2020