IP Library Granted Patent US 12,225,323
Granted Patent B2
US 12,225,323 · App. 17/752,523 · Granted Feb 11, 2025

Event-oriented multi-channel video backup apparatus and method, and network surveillance camera system including the same

Inventors: Hyun Ho Kim (Seongnam-si, KR); Jaeyoung Shin (Seongnam-si, KR); Byoungki An (Seongnam-si, KR); Daehyun Gu (Seongnam-si, KR); Youngin Yun (Seongnam-si, KR); Ji-eun Kim (Seongnam-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
H04N5/91G06F11/1464G06F16/71G06F16/73G06T7/11G06V20/40G06V20/52H04N5/77H04N7/188G06F2201/84G06T2207/10016G06T2207/20132G06T2207/30232G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,323
App. No.
17/752,523
Granted
Feb 11, 2025
Kind
B2
Abstract

A network surveillance camera system includes a network surveillance camera system including: a video receiving and/or searching device connected to a plurality of cameras through a network, and configured to receive video information in real time from the plurality of cameras through multiple channels and perform a video search on the video information; and a video backup device configured to store event-oriented and channel-wise video backup information generated according to a result of the video search of the video receiving and/or searching device, and play back the event-oriented and channel-wise video backup information, wherein the video information is obtained by the plurality cameras configured to capture a plurality of surveillance areas, respectively, and wherein the event-oriented and channel-wise video backup information includes a video backup file generated for each channel and a video playback software player.

Claims (52)

1. A network surveillance camera system comprising:

a video receiving and/or searching device connected to a plurality of cameras through a network, and configured to receive video information and metadata in real time from the plurality of cameras through multiple channels and perform a video search on the video information; and

a video backup device configured to store event-oriented and channel-wise video backup information generated according to a result of the video search of the video receiving and/or searching device, and play back the event-oriented and channel-wise video backup information,

wherein the video information is obtained by the plurality of cameras configured to capture a plurality of surveillance areas, respectively,

wherein the event-oriented and channel-wise video backup information comprises a video backup file generated for each channel and a video playback software player,

wherein still images containing detected objects are obtained by cropping videos from the plurality of cameras,

wherein the received video information includes both the videos and the still images cropped from the videos and the received metadata includes time information when the objects are detected, and a chronological order or the same time at which at least two still images are played is determined based on the time information, and

wherein, when a user selects at least two still images from the still images and the chronological order is determined based on the time information, the selected at least two still images are listed in the chronological order in a section of a screen and the videos corresponding to the selected at least two still images are played in the chronological order in another section of the screen.

2. The network surveillance camera system of claim 1 , wherein the video receiving and/or searching device is configured to receive a still image from each camera of the plurality of cameras,

wherein the metadata is generated by each camera based on video analysis information corresponding to the a surveillance area, of the plurality of surveillance areas, and

wherein the still image is generated by each camera by cropping a video portion corresponding to an object detected within the surveillance area among the video analysis information.

3. The network surveillance camera system of claim 2 , wherein the metadata comprises detection information, identification information, location information, and time information of the object captured in the surveillance area.

4. The network surveillance camera system of claim 2 , wherein the still image is an image selected, among video data captured in the surveillance area, as an image suitable for recognizing a specific object.

5. The network surveillance camera system of claim 4 , wherein the still image comprises a Joint Photographic Experts Group (JPEG) image file.

6. The network surveillance camera system of claim 2 , wherein the video receiving and/or searching device comprises a search viewer application program configured to generate a thumbnail image using channel-wise still images transmitted from the plurality of cameras and perform the video search on the video information received through the multiple channels.

7. The network surveillance camera system of claim 6 , wherein the search viewer application program is configured to display object identification information of channel-wise metadata transmitted from the plurality of cameras, and display thumbnail images corresponding to the object identification information.

8. The network surveillance camera system of claim 7 , wherein video information associated with a predetermined thumbnail image selected from among the thumbnail images is generated as the event-oriented and channel-wise video backup information, and the generated video backup information is provided to the video backup device.

9. The network surveillance camera system of claim 1 , wherein the video backup file generated for each channel comprises one or more of a timeline database, a key frame index database, a video frame header and video data, an audio frame header and audio data, a metadata header and metadata, and a still image header and a still image file.

10. The network surveillance camera system of claim 1 , wherein the video playback software player is operated in a mode, among a plurality of modes, according to a user's selection, the plurality of modes comprising a sequential playback mode, a simultaneous playback mode, a same-period playback mode, and an individual-time playback mode.

11. An event-oriented multi-channel video backup method, comprising:

capturing, by using a plurality of cameras, a plurality of surveillance areas to acquire video information for the plurality of surveillance areas;

transmitting the video information for each of the plurality of surveillance areas through a corresponding one of multiple channels;

receiving the video information from the plurality of cameras and performing a video search on the video information received through the multiple channels;

backing up channel-wise video information generated according to a result of the video search; and

storing and playing back the backed-up information,

wherein the backing up the channel-wise video information comprises backing up metadata included in the video information for each of the plurality of surveillance areas, and the playing back the backed-up information is performed in an event-oriented and channel-wise manner based on the backed-up metadata,

the method further comprising:

obtaining still images containing detected objects by cropping videos from the plurality of cameras,

wherein the received video information includes both the videos and the still images cropped from the videos and the received metadata includes time information when the objects are detected, and a chronological order or the same time at which at least two still images are played is determined based on the time information,

the method further comprising:

when a user selects at least two still images from the still images and the chronological order is determined based on the time information, listing the selected at least two still images in the chronological order in a section of a screen and playing the videos corresponding to the selected at least two still images in the chronological order in another section of the screen.

12. The event-oriented multi-channel video backup method of claim 11 , wherein the video information comprises video analysis information for the video information for each surveillance area generated as metadata and a still image obtained by cropping a video portion corresponding to an object detected within a surveillance area.

13. The event-oriented multi-channel video backup method of claim 12 , wherein the performing the video search comprises:

generating a thumbnail image using channel-wise still images transmitted from the plurality of cameras;

displaying object identification information of channel-wise metadata transmitted from the plurality of cameras in a form of text and displaying thumbnail images corresponding to the object identification information; and

generating video information associated with predetermined thumbnail images selected from among the thumbnail images as video backup information.

14. The event-oriented multi-channel video backup method of claim 13 , wherein the video backup information comprises a video backup file generated for each channel and a video playback software player, and

wherein the metadata included in the video information is extracted based on the channel-wise video information being backed up, and is contained in the video backup file for each channel.

15. The event-oriented multi-channel video backup method of claim 14 , wherein the video backup file generated for each channel comprises one or more of a timeline database, a key frame index database, a video frame header and video data, an audio frame header and audio data, a metadata header and metadata, and a still image header and a still image file.

16. The event-oriented multi-channel video backup method of claim 14 , wherein the video playback software player is operated in a mode, among a plurality of modes, according to a user's selection, the plurality of modes comprising a sequential playback mode, a simultaneous playback mode, a same-period playback mode, and an individual-time playback mode.

17. A video backup device comprising:

an event-oriented channel-wise video backup file, generated according to a search result performed on channel-wise video information received from a surveillance camera; and

a video playback software player configured to play back an event-based video selected by combining one or more pieces of information included in the event-oriented channel-wise video backup file,

wherein the one or more pieces of information comprise a still image and metadata corresponding to the channel-wise video information,

wherein still images containing detected objects are obtained by cropping videos from the surveillance camera,

wherein the received video information includes both the videos and the still images cropped from the videos and the metadata includes time information when the objects are detected, and a chronological order or the same time at which at least two still images are played is determined based on the time information, and

wherein, when a user selects at least two still images from the still images and the chronological order is determined based on the time information, the selected at least two still images are listed in the chronological order in a section of a screen and the videos corresponding to the selected at least two still images are played in the chronological order in another section of the screen.

18. The video backup device of claim 17 , wherein the metadata comprises one or more of detection information, identification information, location information, and time information of an object captured by the surveillance camera, and the still image is selected as a still image suitable for a specific object in video data captured by the surveillance camera.

19. The video backup device of claim 17 , wherein the event-oriented channel-wise video backup file comprises:

basic information including one or more format version information, creator information, basic information of an original camera list, and start offset position information of recorded data in a file; and

detailed information including one or more of a timeline database, a key frame index database, a video frame header and video data, an audio frame header and audio data, a metadata header and metadata, and a still image header and a still image file.

20. The video backup device of claim 17 , wherein the video playback software player is operated in a mode, among a plurality of modes, according to a user's selection, the plurality of modes comprising a sequential playback mode, a simultaneous playback mode, a same-period playback mode, and an individual-time playback mode.

Assignments (2)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: KIM, HYUN HO; SHIN, JAEYOUNG; AN, BYOUNGKI; GU, DAEHYUN; YUN, YOUNGIN; KIM, JI-EUN
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 060005/0737 →
Priority Claims (1)
KR 10-2020-0015668 · Feb 10, 2020 · national
Continuity (3)
Continuation PCTKR2020014985 · Oct 30, 2020
Provisional Application 62940343 · Nov 26, 2019
Related Publication 20220286642A1 · Sep 8, 2022
References Cited (26)
US 20060034586A1 · Millar · 2006 [cited by examiner]
US 20060078047A1 · Shu · 2006 [cited by examiner]
US 20060170791A1 · Porter et al. · 2006 [cited by applicant]
US 20060279628A1 · Fleming · 2006 [cited by examiner]
US 20080018737A1 · Suzuki · 2008 [cited by examiner]
US 20080080743A1 · Schneiderman · 2008 [cited by examiner]
US 20090089845A1 · Akers · 2009 [cited by examiner]
US 20110128382A1 · Pennington · 2011 [cited by examiner]
US 20140333776A1 · Dedeoglu · 2014 [cited by examiner]
US 20150215583A1 · Chang · 2015 [cited by examiner]
US 20180113577A1 · Burns · 2018 [cited by examiner]
US 20180184049A1 · Moss et al. · 2018 [cited by applicant]
US 20180285633A1 · Alcock · 2018 [cited by examiner]
US 20180295428A1 · Bi et al. · 2018 [cited by applicant]
US 20190156665A1 · Watanabe · 2019 [cited by examiner]
US 20190180112A1 · Lee · 2019 [cited by examiner]
US 20190333542A1 · Qin · 2019 [cited by examiner]
US 20200234037A1 · Ogura · 2020 [cited by examiner]
JP 2012123460A · 2012 [cited by examiner]
KR 1020080035892A · 2008 [cited by applicant]
KR 1020140098959A · 2014 [cited by applicant]
KR 1020150084567A · 2015 [cited by applicant]
International Search Report (PCT/ISA/210) issued Jan. 29, 2021 by the International Searching Authority in counterpart International Application No. PCT/KR2020/014985. [cited by applicant]
Written Opinion (PCT/ISA/237) issued Jan. 29, 2021 by the International Searching Authority in counterpart International Application No. PCT/KR2020/014985. [cited by applicant]
Examination Report issued on Oct. 5, 2023 issued by the European Patent Office for EP Patent Application No. 20892795.4. [cited by applicant]
Office Action issued Nov. 4, 2024 by the Korean Patent Office for KR Patent Application No. 10-2020-0015668. [cited by applicant]