IP Library Granted Patent US 10,733,774
Granted Patent B2
US 10,733,774 · App. 14/790,224 · Granted Aug 4, 2020

Device and method of displaying heat map on perspective drawing

Inventors: Soon Min Bae (Changwon-si, KR); Yeon Geol Ryu (Changwon-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
G06T11/206G06K9/00362G06T7/292G06T15/205H04N7/181G06T2207/10021G06T2207/30196G06T2207/30232G06T2207/30241G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,733,774
App. No.
14/790,224
Granted
Aug 4, 2020
Kind
B2
Abstract

An apparatus for displaying a heat map on a perspective drawing includes an object detector configured to detect an object via at least one camera, a horizontal distance calculator configured to calculate a horizontal distance between the detected object and the at least one camera, an object display configured to display the detected object on the perspective drawing based on the calculated horizontal distance, and a heat-map display configured to display the heat map according to a trace density of the object displayed on the perspective drawing.

Claims (55)

1. An apparatus for displaying a heat map on a perspective drawing, the apparatus comprising:

at least one processor configured to:

detect an object from images captured by a plurality of cameras having different orientations; and

calculate a horizontal distance between the detected object and each of the cameras;

an object display configured to display the detected object on the perspective drawing based on the calculated horizontal distance; and

a heat-map display configured to display the heat map according to a trace density of at least one object including the object displayed on the perspective drawing,

wherein the at least one processor is further configured to adjust a size of the detected object using the horizontal distance, and generate the perspective drawing on which the detected object, of which the size is adjusted, is shown,

wherein the at least one processor is further configured to calculate a horizontal distance between the detected object and a camera among the cameras based on a height of the detected object on a ground surface, a height of the detected object in an image captured by the camera and a focal length of the camera,

wherein an optical axis of the camera is parallel with the ground surface,

wherein the perspective drawing highlights a dead zone which is included in a particular area but is not included in photographing areas of the cameras, and

wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

2. The apparatus of claim 1 , wherein the perspective drawing comprises preset information about a map indicating the particular area, and

wherein the cameras are installed at the particular area, and the perspective drawing further displays placement of the cameras.

3. The apparatus of claim 2 , wherein the perspective drawing indicates a photographing range of each of the cameras, and

wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

4. The apparatus of claim 1 , wherein the perspective drawing is two-dimensional or three-dimensional.

5. The apparatus of claim 2 , wherein, if the perspective drawing is three-dimensional, a height of the object is indicated on the perspective drawing based on the calculated horizontal distance.

6. The apparatus of claim 1 , the at least one processor further configured to:

track eyes or hands of the detected object; and

generate the perspective drawing based on the images captured by the cameras,

wherein the heat-map display is further configured to display on the perspective drawing a path via which eye or hand tracking is performed on the detected object, or the heat map according to a trace density of the detected object which is obtained by performing the eye or hand tracking.

7. The apparatus of claim 6 , wherein the cameras are configured to exchange information with one another via a wired or wireless communication.

8. The apparatus of claim 6 , the heat-map display is further configured to display on the perspective drawing the heat map indicating the trace density of the detected object.

9. The apparatus of claim 6 , wherein the perspective drawing indicates information about the cameras.

10. The apparatus of claim 9 , wherein the perspective view indicates a photographing range of each of the cameras, and

wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

11. An apparatus for displaying a heat map on a perspective drawing, the apparatus comprising:

at least one processor configured to:

detect an object from images captured by a plurality of cameras having different orientations; and

calculate a horizontal distance between the detected object and each of the cameras;

an object display configured to display the detected object on the perspective drawing based on the calculated horizontal distance; and

a heat-map display configured to display the heat map according to a trace density of at least one object including the object displayed on the perspective drawing,

wherein the at least one processor is further configured to adjust a size of the detected object using the horizontal distance, and generate the perspective drawing on which the detected object, of which the size is adjusted, is shown, and configured to calculate a horizontal distance between the detected object and a camera among the cameras based on a height of a center of a lens of the camera on a ground surface and an angle between a virtual line connecting a bottommost end of the detected object and the center of the lens of the camera and an optical axis of the camera,

wherein the optical axis of the camera is not parallel with the ground surface, and

wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

12. A method of displaying a heat map on a perspective drawing, the method comprising:

detecting an object from images captured by a plurality of cameras having different orientations;

calculating a horizontal distance between the detected object and each of the cameras;

displaying the detected object on the perspective drawing based on the calculated horizontal distance; and

displaying the heat map according to a trace density of at least one object including the object displayed on the perspective drawing,

wherein the displaying the detected object comprises adjusting a size of the detected object using the horizontal distance, and generating the perspective drawing on which the detected object, of which the size is adjusted, is shown,

wherein the horizontal distance between the detected object and a camera among the cameras is calculated based on a height of a center of a lens of the camera on a ground surface and an angle between a virtual line connecting a bottommost end of the detected object and the center of the lens of the camera and an optical axis of the camera, and

wherein the optical axis of the camera is not parallel with the ground surface, and

wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

13. The method of claim 12 , wherein the perspective drawing indicates a particular area where the cameras are installed, and the perspective drawing comprises information about the cameras.

14. The apparatus of claim 13 , wherein the perspective drawing indicates a photographing range of each of the cameras,

wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area, and

wherein the perspective drawing indicates a dead zone which is included in the particular area but is not included in photographing areas of the cameras.

15. The method of claim 12 further comprising:

tracking eyes or hands of the detected object;

generating the perspective drawing based on the images captured by the cameras; and

displaying on the perspective drawing a path via which eye or hand tracking is performed on the detected object, or displaying the heat map according to a trace density of the detected object which is obtained by performing the eye or hand tracking.

16. The method of claim 15 , wherein the perspective view shows a photographing area of the cameras,

wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

17. A non-transitory computer readable recording medium having recorded thereon a program for executing the method of claim 12 .

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 30, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036233/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: BAE, SOON MIN; RYU, YEON GEOL
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 035970/0163 →
Cited By (1)
US 12,681,563