IP Library Granted Patent US 9,979,932
Granted Patent B2
US 9,979,932 · App. 13/895,702 · Granted May 22, 2018

Surveillance system control method and surveillance system adopting the method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,979,932
App. No.
13/895,702
Granted
May 22, 2018
Kind
B2
Abstract

A method of controlling a surveillance system having a visible imaging camera for obtaining a visible image of an object and a display apparatus, includes providing a color visible image, from the visible imaging camera, to the display apparatus and generating a color background image by extracting a background area from the color visible image when a current ambient illuminance belongs to a daytime illuminance range, and replacing a background area of a black and white visible image, from the visible imaging camera, with the color background image and providing a mixed image as a result of the replacement to the display apparatus when the current illuminance belongs to the nighttime illuminance range.

Claims (75)

1. A method of controlling a surveillance system having a visible imaging camera, which is a single lens camera, for obtaining a visible image of an object and a display apparatus, the method comprising:

when a current ambient illuminance belongs to a daytime illuminance range which is set to be greater than or equal to a first threshold illuminance, providing a color visible image of the object, obtained from the visible imaging camera, to the display apparatus, and generating a color background image, which is a still image, by extracting a background area from the color visible image;

when the current ambient illuminance belongs to a nighttime illuminance range which is set to be less than or equal to a second threshold illuminance:

obtaining a black and white visible image of the object from the visible imaging camera;

replacing a background area of the black and white visible image with the color background image generated when the current ambient illuminance range belongs to the daytime illuminance range; and

providing a mixed image of the object as a result of the replacement to the display apparatus.

2. The method of claim 1 , further comprising:

setting a medium illuminance range between the first threshold illuminance and the second threshold illuminance;

when the current ambient illuminance is changed from the medium illuminance range, where the color visible image is generated, to the nighttime illuminance range, generating the black and white visible image instead of the color visible image; and

when the current ambient illuminance is changed from the medium illuminance range, where the black and white visible image is generated, to the daytime illuminance range, generating the color visible image instead of the black and white visible image.

3. The method of claim 1 , wherein, when the mixed image is displayed at the display apparatus when the current ambient illuminance belongs to the nighttime illuminance range, a reduced image of the black and white visible image is displayed in at least one window in a picture-in-picture (PIP) format of the display apparatus.

4. The method of claim 1 , further comprising, when the current ambient illuminance belongs to the nighttime illuminance range:

comparing the color background image to the background area of the black and white visible image;

if, as a result of the comparing, the color background image and the background area of the black and white visible image spatially match each other, replacing the background area of the black and white visible image with the color background image, and providing the mixed image as a result of the replacement to the display apparatus; and

if, as the result of the comparing, the color background image and the background area of the black and white visible image do not spatially match each other, providing the black and white visible image without the replacing to the display apparatus.

5. The method of claim 2 , wherein a lower end and a higher end of the medium illumination range are variably set according to a frequency of the change to the nighttime illumination range and/or the change to the daytime illumination range.

6. A method of controlling a surveillance system having a visible imaging camera, which is a single lens camera, for obtaining a visible image of an object, a thermal imaging camera for obtaining a thermal image, and a display apparatus, the method comprising:

when a current ambient illuminance belongs to a daytime illuminance range which is set to be greater than or equal to a first threshold illuminance, generating a color background image, which is a still image, by extracting a background area from a color visible image of the object obtained from the visible imaging camera; and

when the current ambient illuminance belongs to a nighttime illuminance range which is set to be less than or equal to a second threshold illuminance:

obtaining a black and white visible image of the object from the visible imaging camera;

obtaining a thermal image of the object from the thermal imaging camera;

mixing the black and white visible image and the thermal image to generate a black and white mixed image;

replacing a background area of the black and white mixed image with the color background image generated when the current ambient illuminance belongs to the daytime illuminance range; and

providing a mixed image of the object as a result of the replacement to the display apparatus.

7. The method of claim 6 , wherein, when the current ambient illuminance belongs to the daytime illuminance range, the color visible image, from the visible imaging camera, and the thermal image, from the thermal imaging camera, are mixed with each other, and a color mixed image of the object as a result of the mixing is provided to the display apparatus.

8. The method of claim 6 , further comprising:

setting a medium illuminance range between the first threshold illuminance and the second threshold illuminance;

when the current ambient illuminance is changed from the medium illuminance range, where the color visible image is obtained, to the nighttime illuminance range, generating the black and white visible image instead of the color visible image; and

when the current ambient illuminance is changed from the medium illuminance range, where the black and white visible image is generated, to the daytime illuminance range, generating the color visible image instead of the black and white visible image.

9. The method of claim 6 , wherein, when the mixed image is displayed at the display apparatus when the current ambient illuminance belongs to the nighttime illuminance range, a reduced image of the black and white visible image is displayed in at least one window in a picture-in-picture (PIP) format of the display apparatus.

10. The method of claim 6 , further comprising, when the current ambient illuminance belongs to the nighttime illuminance range:

comparing the color background image to the background area of the black and white mixed image;

if, as a result of the comparing, the color background image and the background area of the black and white mixed image spatially match each other, replacing the background area of the black and white mixed image with the color background image, and providing the mixed image as a result of the replacement to the display apparatus; and

if, as the result of the comparing, the color background image and the background area of the black and white mixed image do not spatially match each other, providing the black and white mixed image without the replacing to the display apparatus.

11. The method of claim 8 , wherein a lower end and a higher end of the medium illumination range are variably set according to a frequency of the change to the nighttime illumination range and/or the change to the daytime illumination range.

12. A surveillance system, comprising:

a visible imaging camera which is a single lens camera obtaining a visible image;

a display apparatus; and

a control apparatus,

wherein, when a current ambient illuminance belongs to a daytime illuminance range which is set to be greater than or equal to a first threshold illuminance, the control apparatus provides a color visible image of an object, obtained from the visible imaging camera, to the display apparatus, and generate a color background image, which is a still image, by extracting a background area from the color visible image, and

wherein, when the current ambient illuminance belongs to a nighttime illuminance range which is set to be less than or equal to a second threshold illuminance, the control apparatus:

obtains a black and white visible image of the object from the visible imaging camera;

replaces a background area of the black and white visible image with the color background image generated when the current ambient illuminance belongs to the daytime illuminance range; and

provides a mixed image of the object as a result of the replacement to the display apparatus.

13. The surveillance system of claim 12 , wherein the system sets a medium illuminance range between the first threshold illuminance and the second threshold illuminance,

wherein the visible imaging camera comprises an optical sensor which indicates whether the current ambient illuminance belongs to the daytime illuminance range, the medium illuminance range, or the nighttime illuminance range,

wherein when the current ambient illuminance is changed from the medium illuminance range to the nighttime illuminance range while the visible imaging camera generates the color visible image, the visible imaging camera discontinues generation of the color visible image and generates the black and white visible image, and

wherein, when the current ambient illuminance is changed from the medium illuminance range to the daytime illuminance range while the visible imaging camera generates the black and white visible image, the visible imaging camera discontinues generation of the black and white visible image and generates the color visible image.

14. The surveillance system of claim 12 , wherein, when the control apparatus displays the mixed image at the display apparatus when the current ambient illuminance belongs to the nighttime illuminance range, the control apparatus displays a reduced image of the black and white visible image on the color background image of the mixed image in a picture-in-picture (PIP) format of the display apparatus.

15. The surveillance system of claim 12 , wherein when the current ambient illuminance belongs to the nighttime illuminance range, the control apparatus:

compares the color background image to the background area of the black and white mixed image;

if, as a result of the comparing, the color background image and the background area of the black and white mixed image spatially match each other, replaces the background area of the black and white mixed image with the color background image, and provides the mixed image as a result of the replacement to the display apparatus; and

if, as the result of the comparing, the color background image and the background area of the black and white mixed image do not spatially match each other, provides the black and white mixed image without the replacing to the display apparatus.

16. A surveillance system, comprising:

a visible imaging camera which is a single lens camera obtaining a color visible image of an object;

a thermal imaging camera which obtains a thermal image of the object;

a display apparatus; and

a control apparatus,

wherein, when a current ambient illuminance belongs to a daytime illuminance range which is set to be greater than or equal to a first threshold illuminance, the control apparatus generate a color background image, which is a still image, by extracting a background area from the color visible image obtained from the visible imaging camera, and

wherein, when the current ambient illuminance belongs to a nighttime illuminance range which is set to be less than or equal to a second threshold illuminance, the control apparatus:

obtains a black and white visible image of the object from the visible imaging camera;

obtains the thermal image from the thermal imaging camera;

mixes the black and white visible image and the thermal image to generate a black and white mixed image of the object;

replaces a background area of the black and white mixed image with the color background image generated when the current ambient illuminance belongs to the daytime illuminance range; and

provides a mixed image of the object as a result of the replacement to the display apparatus.

17. The surveillance system of claim 16 , wherein, when the current ambient illuminance belongs to the daytime illuminance range, the color visible image, from the visible imaging camera, and the thermal image, from the thermal imaging camera, are mixed with each other and a color mixed image of the object as a result of the mixing is provided to the display apparatus.

18. The surveillance system of claim 16 , wherein the system sets a medium illuminance range between the first threshold illuminance and the second threshold illuminance,

wherein the visible imaging camera comprises an optical sensor which indicates whether the current ambient illuminance belongs to the nighttime illuminance range, the medium illuminance range, or the nighttime illuminance range,

wherein, when the current ambient illuminance is changed from the medium illuminance range to the nighttime illuminance range while the visible imaging camera generates the color visible image, the visible imaging camera discontinues generation of the color visible image and generates the black and white visible image, and

wherein, when the current ambient illuminance is changed from the medium illuminance range to the daytime illuminance range while the visible imaging camera generates the black and white visible image, the visible imaging camera discontinues generation of the black and white visible image and generates the color visible image.

19. The surveillance system of claim 16 , wherein, when the control apparatus displays the mixed image at the display apparatus when the current ambient illuminance belongs to the nighttime illuminance range, the control apparatus displays a reduced image of the black and white visible image or a reduced image of the thermal image on the color background image of the mixed image in a picture-in-picture (PIP) format of the display apparatus.

20. The surveillance system of claim 16 , wherein when the current ambient illuminance belongs to the nighttime illuminance range, the control apparatus:

compares the color background image to the background area of the black and white mixed image;

if, as a result of the comparing, the color background image and the background area of the black and white mixed image spatially match each other, replaces the background area of the black and white mixed image with the color background image, and provides the mixed image as a result of the replacement to the display apparatus; and

if, as the result of the comparing, the color background image and the background area of the black and white mixed image do not spatially match each other, provides the black and white mixed image without the replacing to the display apparatus.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 24, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036254/0911 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2013
From: LEE, JOON-SUNG; KIM, JI-MAN; SHIN, DONG-HAK
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 030439/0617 →