IP Library Granted Patent US 9,514,225
Granted Patent B2
US 9,514,225 · App. 14/823,180 · Granted Dec 6, 2016

Video recording apparatus supporting smart search and smart search method performed using video recording apparatus

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,514,225
App. No.
14/823,180
Granted
Dec 6, 2016
Kind
B2
Abstract

A video recording apparatus includes: an object classifier configured to classify an object which is included in an input video and related to a detected event, according to a type of the object; an object color extractor configured to extract a representative color of the object; and a search color storage configured to transform the representative color into a search color and store the search color as color information to be used for searching the object or the detected event from the input video.

Claims (28)

1. A video recording apparatus comprising:

an object classifier configured to classify an object which is included in an input video and related to a detected event, according to a type of the object;

an object color extractor configured to extract a representative color of the object; and

a search color storage configured to transform the representative color into a search color and store the search color as color information to be used for searching the object or the detected event from the input video.

2. The apparatus of claim 1 , further comprising an event information storage configured to store information about at least one of an area of the input video in which the event occurs, a time point when the event occurs, sensitivity about the event, and attribute of the object detected in the area in which the event occurs,

wherein the information about the attribute comprises identification, size, and location of the object.

3. The apparatus of claim 1 , wherein the search color storage is configured to select, as the search color, a color of which differences between red, green and blue (RGB) values and RGB values of the representative color are minimum, among a plurality of predetermined colors.

4. The apparatus of claim 1 , further comprising a search interface configured to receive input of searching for the object or the event based on the search color.

5. The apparatus of claim 4 , wherein the search interface supports or provides for a search to be performed by additionally setting at least one among a sensitivity of the event, time information about a time point when the event occurs, and area information about an area in which the event occurs.

6. The apparatus of claim 1 , wherein each image frame of the input video comprises a predetermined number of blocks and the event is detected by determining the object in a unit of block.

7. The apparatus of claim 6 , further comprising a metadata storage configured to store information about at least one of an attribute, the representative color and the search color of the object, per block of the predetermined number of blocks.

8. The apparatus of claim 7 , wherein the attribute of the object comprises the type of the object indicating whether the object is at least one of a human and a vehicle.

9. The apparatus of claim 8 , wherein the search color storage is configured to select, as the search color, a color of which differences between red, green and blue (RGB) values and RGB values of the representative color are minimum, among a plurality of predetermined colors.

10. The apparatus of claim 1 , wherein the representative color is extracted based on a histogram generated based on colors of some or all pixels of the object or based on a line sampled from the object.

11. The apparatus of claim 1 , wherein the representative color is extracted based on a color of a representative pixel of the object, and

wherein the representative pixel of the object comprises at least one of a corner pixel of the object, a central pixel of the object, and a pixel spaced a predetermined distance from a center of the object.

12. The apparatus of claim 1 , wherein the representative color is extracted based on a histogram generated with respect to a line sampled from the object.

13. The apparatus of claim 1 , wherein the search color storage is configured to select, as the search color, a color of which differences between red, green and blue (RGB) values and RGB values of the representative color are minimum, among a plurality of predetermined colors.

14. The apparatus of claim 13 , wherein the search color storage is further configured to generate a data structure from the input video based on a number of blocks constituting each image frame of the input video, the type of object related to the detected event, and a number of a predetermined colors from which the search color is selected.

15. A smart search method performed by a video recording apparatus, the method comprising:

classifying, by an object classifier, an object which is included in an input video and related to a detected event, according to a type of the object;

extracting, by an object color extractor, a representative color of the object; and

transforming, by a search color storage, the representative color into a search color and storing the search color as color information to be used for searching the object or the detected event from the input video.

16. The method of claim 15 , further comprising selecting, as the search color, a color of which differences between red, green and blue (RGB) values and RGB values of the representative color are minimum, among a plurality of predetermined colors.

17. The method of claim 16 , further comprising storing information about at least one of an attribute, the representative color and the search color of the object, per block of the predetermined number of blocks.

18. The method of claim 17 , further comprising generating a data structure from the input video based on a number of blocks constituting each image frame of the input video, the type of object related to the detected event, and a number of a predetermined colors from which the search color is selected.

19. The method of claim 15 , further comprising storing information about at least one of an attribute, the representative color and the search color of the object, per block of the predetermined number of blocks.

20. The method of claim 15 , further comprising generating a data structure from the input video based on a number of blocks constituting each image frame of the input video, the type of object related to the detected event, and a number of a predetermined colors from which the search color is selected.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 036298 FRAME: 0440. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 2, 2015
From: CHO, SUNGONG; CHOI, HANKI; IM, JINSU
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036527/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2015
From: CHO, SUNGBONG; CHOI, HANKI; IM, JINSU
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 036298/0440 →