IP Library Granted Patent US 9,542,405
Granted Patent B2
US 9,542,405 · App. 14/598,399 · Granted Jan 10, 2017

Image processing system and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,542,405
App. No.
14/598,399
Granted
Jan 10, 2017
Kind
B2
Abstract

An image processing system and an image processing method. The image processing system includes: an image analysis engine configured to analyze an input image and generate metadata about the input image; an indexing engine configured to structuralize and organize the metadata and generate index data based on the metadata; a search engine configured to extract index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and a browsing engine configured to generate a heatmap based on the extracted index data and image data and display the heatmap and an image matching the search condition on a screen.

Claims (44)

1. An image processing system comprising at least one hardware processor to implement:

an image analysis engine configured to analyze an input image and generate metadata about the input image;

an indexing engine configured to structuralize and organize the metadata and generate index data based on the metadata;

a search engine configured to extract index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

a browsing engine configured to generate a heatmap based on the extracted index data and image data and display the heatmap and an image matching the search condition on a screen,

wherein the image analysis engine is configured to classify objects included in the input image, analyze motions or lines of movement of the objects, and perform cumulative hashing on a result of analyzing the motions of the objects per unit time.

2. The image processing system of claim 1 , wherein the browsing engine is configured to divide a region of the input image matching the search condition into predetermined units, calculate an amount of motions in divided regions from the index data to establish priorities, allocate different indications according to the established priorities to generate the heatmap, and apply smoothing filtering to the heatmap to reconfigure the heatmap.

3. The image processing system of claim 2 , wherein the browsing engine is configured to generate the heatmap by connecting regions of the heatmap having a same indication and processing contour lines on the connected regions.

4. The image processing system of claim 2 , wherein the browsing engine is configured to perform overlapping one of the image matching the search condition and the reconfigured heatmap on the other.

5. The image processing system of claim 3 , wherein, if a point is selected on the reconfigured heatmap, the browsing engine is configured to provide a summarized image corresponding to the selected point.

6. The image processing system of claim 5 , wherein the browsing engine is configured to display the reconfigured heatmap, the image matching the search condition and the summarized image on different regions of the screen.

7. An image processing system comprising:

a heatmap generator, implemented by using at least one hardware processor, configured to divide a region of an image matching a search condition into predetermined units, calculate an amount of motions in divided regions from index data to establish priorities, allocate different indications according to the established priorities to generate a heatmap, and apply smoothing filtering to the heatmap to reconfigure the heatmap; and

a display configured to display the reconfigured heatmap and the image matching the search condition,

wherein the heatmap generator is further configured to classify objects included in the image, analyze motions or lines of movement of the objects, and perform cumulative hashing on a result of analyzing the motions of the objects per unit time, and

wherein the index data are generated based on a result of the cumulative hashing.

8. The image processing system of claim 7 , wherein the heatmap generator is configured to generate the heatmap by connecting regions of the heatmap having a same indication and process contour lines on the connected regions.

9. The image processing system of claim 7 , wherein the heatmap generator comprises an overlapper, implemented by using the at least one hardware processor, configured to overlap one of the image matching the search condition and the reconfigured heatmap on the other.

10. The image processing system of 7 , wherein the heatmap generator comprises: a summarized image generator, implemented by using the at least one hardware processor, if a point is selected on the reconfigured heatmap, configured to generate a summarized image corresponding to the selected point.

11. The image processing system of claim 10 , wherein the display is configured to display the reconfigured heatmap, the image matching the search condition and the summarized image, on different regions of the screen.

12. An image processing method comprising:

analyzing an input image and generating metadata about the input image;

structuralizing and organizing the metadata and generating index data based on the metadata;

extracting index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

generating a heatmap based on the extracted index data and image data, and displaying the heatmap and an image matching the search condition on a screen,

wherein the analyzing comprises:

classifying objects included in the input image and analyzing motions or lines of movement of the objects; and

performing cumulative hashing on a result of analyzing motions of the objects per unit time.

13. The image processing method of claim 12 , wherein the generating of the heatmap comprises:

dividing a region of an image matching a search condition into predetermined units;

calculating an amount of motions in the divided regions from index data to establish priorities;

allocating different indications according to the established priorities to generate a heatmap; and

applying smoothing filtering to the heatmap to reconfigure the heatmap.

14. The image processing method of claim 13 , further comprising generating the heatmap by connecting regions of the heatmap having a same indication and processing contour lines on the connected regions.

15. The image processing method of claim 13 , further comprising overlapping one of the image matching the search condition and the reconfigured heatmap on the other.

16. The image processing method of claim 13 , further comprising, if a point is selected on the reconfigured heatmap, generating a summarized image corresponding to the selected point.

17. A non-transitory computer-readable recording medium having recorded thereon a computer program for executing an image processing method, the image processing method comprising:

analyzing an input image and generating metadata about the input image;

structuralizing and organizing the metadata and generating index data based on the metadata;

extracting index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

generating a heatmap based on the extracted index data and image data, and displaying the heatmap and an image matching the search condition on a screen,

wherein the analyzing comprises:

classifying objects included in the input image and analyzing motions or lines of movement of the objects; and

performing cumulative hashing on a result of analyzing motions of the objects per unit time.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 30, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036233/0327 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2015
From: PARK, DONGJUN; PARK, JOONYOUNG; RYU, YEONGEOL; SHIN, HAKCHUL
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 034735/0007 →