IP Library Granted Patent US 11,295,589
Granted Patent B2
US 11,295,589 · App. 16/959,883 · Granted Apr 5, 2022

Image processing device and method for simultaneously transmitting a plurality of pieces of image data obtained from a plurality of camera modules

Inventors: Sung Bong Cho (Seongnam-si, KR); Il Hwang Cha (Seongnam-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
G08B13/19628G06F9/445G06F21/57G08B13/19654G08B13/19656G08B13/19693H04L49/25H04L61/2007H04N5/2258H04N5/23232H04N5/232061H04N5/247H04N7/0117H04N7/0806H04N7/181G06F21/575G06F21/577G08B13/19658H04N21/4432
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,295,589
App. No.
16/959,883
Granted
Apr 5, 2022
Kind
B2
Abstract

Provided is a surveillance system including a communication module configured to receive a plurality of pieces of image data obtained by a plurality of camera modules, receive a multiple image data request from a client terminal, and transmit a multiple image data response including multiple image data to the client terminal; and a processer configured to generate the multiple image data by scaling the plurality of pieces of image data in response to the multiple image data request and combining a plurality of pieces of scaled image data, wherein the plurality of camera modules share one internet protocol (IP) address.

Claims (57)

1. An image processing device of a host device comprising:

a communication module configured to

receive a plurality of pieces of image data obtained by a plurality of camera modules, wherein the plurality of camera modules constitute one network camera,

receive a multiple image data request from a client terminal, wherein the multiple image data request is a request for simultaneously receiving the plurality of pieces of image data by the one network camera, and

based on an operation error of the host device not being detected, transmit a multiple image data response comprising multiple image data to the client terminal; and

a processer configured to:

based on the operation error of the host device not being detected:

generate the multiple image data by scaling the plurality of pieces of image data in response to the multiple image data request and combining a plurality of pieces of scaled image data;

based on the operation error of the host device being detected:

select one camera module as a master camera module from among the plurality of camera modules;

enable the master camera module to perform a function of the communication module or a function of the processor in response to a network service provision request being received by the master camera module from the communication module; and

reboot the host device and provide a path to access the network camera after the network service provision request is transmitted to the master camera module,

wherein the plurality of camera modules share one internet protocol (IP) address.

2. The image processing device of claim 1 , wherein the communication module is further configured to:

receive the plurality of pieces of image data from the plurality of camera modules that are mounted in the one network camera and face in a plurality of different directions;

receive, from the client terminal, the multiple image data request that requests the one network camera to simultaneously transmit the plurality of pieces of image data that are obtained by capturing scenes in the plurality of different directions; and

in response to the multiple image data request, transmit the multiple image data comprising the plurality of pieces of image data, to the client terminal.

3. The image processing device of claim 1 , wherein the communication module receives the plurality of pieces of image data encoded by the plurality of camera modules from a network switch.

4. The image processing device of claim 3 , wherein the processor comprises:

a decoder configured to decode the plurality of pieces of image data;

a scaler configured to scale a plurality of pieces of decoded image data;

a multiplexer configured to generate the multiple image data by combining the plurality of pieces of scaled image data; and

an encoder configured to encode the multiple image data,

wherein the processor includes the multiple image data encoded by the encoder in the multiple image data response.

5. The image processing device of claim 4 , wherein the scaler scales the plurality of pieces of decoded image data, such that a sum of resolutions of the plurality of pieces of scaled image data is lower than or equal to a resolution required by the client terminal.

6. The image processing device of claim 1 , wherein when the processor detects the operation error of the host device,

the communication module transmits the network service provision request to the master camera module, and

the master camera module performs the function of the communication module of transmitting the multiple image data response to the client terminal and the function of the processor of generating the multiple image data by scaling the plurality of pieces of image data, in response to the network service provision request being received from the communication module.

7. The image processing device of claim 6 , wherein the processor selects a camera module of a predetermined highest priority from among the plurality of camera modules or a camera module with a least load from among the plurality of camera modules as the master camera module.

8. An image processing method performed by a host device comprising a processor and a communication module, the image processing method comprising:

receiving, by the communication module, a multiple image data request from a client terminal;

receiving, by the communication module, a plurality of pieces of image data obtained by a plurality of camera modules that are mounted in one network camera and face in a plurality of different directions;

based on an operation error of the host device not being detected:

scaling, by the processor, the plurality of pieces of image data in response to the multiple image data request; and

in response to the multiple image data request, which requests the one network camera to simultaneously transmit the plurality of pieces of image data obtained by the plurality of camera modules, generating, by the processor, multiple image data by combining a plurality of pieces of scaled image data; and

transmitting, by the communication module, a multiple image data response comprising the multiple image data to the client terminal,

based on the operation error of the host device being detected:

selecting one camera module as a master camera module from among the plurality of camera modules; and

enabling the master camera module to perform a function of the communication module or a function of the processor in response to a network service provision request being received by the master camera module from the communication module; and

rebooting the host device and providing a path to access the network camera after the network service provision request is transmitted to the master camera module,

wherein the plurality of camera modules share one internet protocol (IP) address.

9. The method of claim 8 , wherein the communication module receives, from a network switch, the plurality of pieces of image data encoded by the plurality of camera modules.

10. The method of claim 9 , wherein the scaling of the plurality of pieces of image data comprises:

decoding, by a decoder, the plurality of pieces of image data; and

scaling, by a scaler, a plurality of pieces of decoded image data, and

the generating of the multiple image data comprises:

generating, by a multiplexer, the multiple image data by combining the plurality of pieces of scaled image data; and

encoding, by an encoder, the multiple image data.

11. The method of claim 10 , wherein, in the scaling of the plurality of pieces of decoded image data, the plurality of pieces of decoded image data are scaled by the scaler, such that a sum of resolutions of the plurality of pieces of scaled image data is lower than or equal to a resolution required by the client terminal.

12. The method of claim 8 , wherein the communication module and the processor are included in the host device,

the method further comprises selecting the one camera module from among the plurality of camera modules as the master camera module when the processor detects the operation error of the host device; and

transmitting, through the communication module, the network service provision request to the master camera module, and

the master camera module performs the function of the communication module and the function of the processor in response to the network service provision request.

13. The method of claim 12 , wherein, in the selecting of the master camera module, the processor selects a camera module of a predetermined highest priority from among the plurality of camera modules or a camera module with a least load from among the plurality of camera modules as the master camera module.

14. The method of claim 8 , wherein the receiving of the multiple image data request and the transmitting of the multiple image data response are performed by the host device,

the receiving of the plurality of pieces of image data comprises receiving the plurality of pieces of image data as raw data prior to image processing, by a field programmable gate array (FPGA) device distinct from the host device, and

the scaling of the plurality of pieces of image data and the generating of the multiple image data are performed by the FPGA device based on the raw data.

Assignments (2)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: CHO, SUNG BONG; CHA, IL HWANG
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 053111/0563 →