IP Library Granted Patent US 12,088,784
Granted Patent B2
US 12,088,784 · App. 17/971,558 · Granted Sep 10, 2024

Thermal imaging camera and shutter operation state monitoring method thereof

Inventors: Ki Bong Yun (Seongnam-si, KR); Ji Soo Lim (Seongnam-si, KR)
Assignee: Hanwha Vision Co., Ltd.
H04N17/002G01J5/90G06T5/80H04N23/634H04R1/028H04R1/08G01J2005/0077G06T2207/10048H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,088,784
App. No.
17/971,558
Granted
Sep 10, 2024
Kind
B2
Abstract

A shutter operation state monitoring method performed in a thermal imaging camera includes, controlling a shutter of the thermal imaging camera to be closed, capturing a first thermal image, calculating a correction offset value for the first thermal image, controlling the shutter to be opened, capturing a second thermal image, applying the correction offset value to the second thermal image, measuring a sound with a microphone when controlling the shutter to be closed and/or when controlling the shutter to be opened, determining whether the measured sound matches an operation sound of the shutter, and outputting an alarm indicating malfunction of the shutter if the measured sound does not match the operation sound.

Claims (44)

1. A shutter operation state monitoring method performed in a thermal imaging camera, which includes a processor and a memory storing instructions that can be executed by the processor, by the instructions under the control of the processor, the shutter operating state monitoring method comprising:

controlling a shutter of the thermal imaging camera to be closed;

capturing a first thermal image;

calculating a correction offset value for the first thermal image;

controlling the shutter to be opened;

capturing a second thermal image;

applying the correction offset value to the second thermal image;

measuring a sound with a microphone while controlling the shutter to be closed or while controlling the shutter to be opened; and

determining whether the measured sound matches an operation sound of the shutter, wherein the measured sound does not match the operation sound and an alarm indicating malfunction of the shutter is output.

2. The shutter operation state monitoring method of claim 1 , further comprising:

removing a common sound corresponding to noise from the measured sound.

3. The shutter operation state monitoring method of claim 1 , wherein

the operation sound source is a reference sound source stored in advance for the shutter, and

an operation sound of the shutter being opened is distinguished from an operation sound of the shutter being closed.

4. The shutter operation state monitoring method of claim 1 , further comprising:

the measured sound not matching the operation sound, and as a result, a state of the malfunction of the shutter being displayed by showing whether the malfunction of the shutter includes a malfunction in an open state or in a closed state of the shutter.

5. The shutter operation state monitoring method of claim 1 , further comprising:

determining that the malfunction of the shutter includes a malfunction in an open state of the shutter, and as a result, applying a previous correction offset value before the malfunction of the shutter to a current thermal image.

6. The shutter operation state monitoring method of claim 5 , wherein

the calculating the correction offset value, comprises calculating individual correction offset values for pixels included in the first thermal image,

the applying the correction offset value, comprises applying the individual correction offset values to pixels included in the second thermal image, and

positions of the pixels included in the second thermal image correspond to positions of the pixels included in the first thermal image.

7. A shutter operation state monitoring method performed in a thermal imaging camera, which includes a processor and a memory storing instructions that can be executed by the processor, by the instructions under the control of the processor, the shutter operating state monitoring method comprising:

measuring a sound with a microphone while controlling the opening and the closing of a shutter of the thermal imaging camera;

determining whether malfunction of the shutter has occurred by determining whether the measured sound matches an operation sound of the shutter;

determining that the malfunction of the shutter has occurred, and as a result, estimating a correction offset value with reference to a mapping table stored in a storage; and

correcting a captured thermal image with the estimated correction offset value.

8. The shutter operation state monitoring method of claim 7 , wherein the determining whether the malfunction of the shutter has occurred, comprises determining that the malfunction of the shutter has occurred by finding that a difference between characteristic values of the measured sound and the operation sound exceeds a reference value.

9. The shutter operation state monitoring method of claim 8 , wherein each of the characteristic values includes at least one of level and frequency.

10. The shutter operation state monitoring method of claim 9 , wherein the determining whether the malfunction of the shutter has occurred, further comprises determining that the malfunction of the shutter has occurred by finding that a difference between levels of the measured sound and the operation sound exceeds a first reference value and a difference between frequencies of the measured sound and the operation sound exceeds a second reference value.

11. The shutter operation state monitoring method of claim 7 , wherein the mapping table includes data pairs including temperature measurements provided by a temperature sensor and correction offset values paired one-to-one with the temperature measurements.

12. The shutter operation state monitoring method of claim 11 , wherein the estimating the correction offset value with reference to the mapping table, comprises, a correction offset value for a particular temperature not existing in the mapping table, and as a result, estimating the correction offset value for the particular temperature by performing interpolation based on the data pairs included in the mapping table.

13. The shutter operation state monitoring method of claim 11 , wherein the mapping table is generated by a pre-calibration process and is stored in the storage before shipment of the thermal imaging camera.

14. The shutter operation state monitoring method of claim 13 , wherein the estimating the correction offset value with reference to the mapping table, comprises a temperature measured by the temperature sensor satisfying a temperature variation condition of the measured temperature accounting for a larger fluctuation from an existing temperature than a reference value, and as a result, estimating the correction offset value with reference to the mapping table.

15. The shutter operation state monitoring method of claim 14 , wherein the temperature variation condition is checked at intervals of a predetermined period.

16. The shutter operation state monitoring method of claim 11 , further comprising:

a determination being made that the malfunction of the shutter has not occurred, and as a result, calculating a correction offset value through the opening and the closing of the shutter and storing the calculated correction offset value in the mapping table.

17. The shutter operation state monitoring method of claim 16 , wherein

the storing the calculated correction offset value in the mapping table, comprises storing the calculated correction offset value in the mapping table at intervals of a correction period, and

the correction period is applied differently to a first period, which is a period from the thermal imaging camera being powered on to a thermal imaging sensor being stabilized, in comparison to a second period, which is a period after the thermal imaging sensor reaches a stable state.

18. The shutter operation state monitoring method of claim 17 , wherein the correction period is shorter for the first period than for the second period.

19. The shutter operation state monitoring method of claim 7 , wherein the malfunction of the shutter includes a malfunction in which the shutter remains closed without being able to be open, and

the estimating the correction offset value with reference to the mapping table, comprises resetting the thermal imaging camera, controlling the shutter to remain open, measuring a temperature with a temperature sensor, and the measured temperature satisfying a temperature variation condition of the measured temperature accounting for a larger fluctuation from an existing temperature than a reference value, and as a result, estimating the correction offset value with reference to the mapping table.

20. The shutter operation state monitoring method of claim 19 , wherein the temperature variation condition is checked at intervals of a predetermined period.

Assignments (2)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2022
From: YUN, KI BONG; LIM, JI SOO
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 061504/0566 →
Priority Claims (1)
KR 10-2021-0144466 · Oct 27, 2021 · national
Continuity (1)
Related Publication 20230128886A1 · Apr 27, 2023