IP Library Granted Patent US 9,781,339
Granted Patent B2
US 9,781,339 · App. 14/053,732 · Granted Oct 3, 2017

Method and apparatus for counting number of person using plurality of cameras

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,781,339
App. No.
14/053,732
Granted
Oct 3, 2017
Kind
B2
Abstract

A person counting device generates a single panorama image by using a plurality of images respectively captured by a plurality of cameras, inserts an imaginary line to the single panorama image; and counts the number of persons that pass the imaginary line. To this end, identification numbers are allocated to respective persons in the plurality of images, the single panorama image including the imaginary line is restored to a plurality of images including same imaginary line information, the number of persons that pass a new imaginary line in each of the plurality of restored images is determined, and the number of duplicate-counted persons is ruled out.

Claims (50)

1. A person counting device comprising at least one processor to implement:

a single panorama image generator configured to match a plurality of images respectively captured by a plurality of cameras and generate a single panorama image;

a line inserter configured to insert an imaginary line to the single panorama image;

a person counter configured to allocate identification numbers to respective persons in the single panorama image and count the number of persons that pass the imaginary line; and

a duplication remover configured to rule out a number of duplicate-counted persons by using the identification numbers allocated to the respective persons in a plurality of images which are restored from the single panorama image, information regarding overlapping regions between the plurality of images, and imaginary line information,

wherein the person counter, in the restored plurality of images, allocates a same identification number to a person in the overlapping regions between the plurality of images.

2. The person counting device of claim 1 , wherein the single panorama image generator is configured to generate the single panorama image by using a homography method or an image stitching method, and

the generated single panorama image is displayed on a display screen.

3. The person counting device of claim 1 , wherein the single panorama image generator is configured to generate the single panorama image in real-time by reflecting changes of parameters of each of the plurality of cameras in real-time,

the generated single panorama image is displayed on a display screen in real-time, and

the parameters comprise data regarding panning, tilting, and zooming.

4. The person counting device of claim 1 , wherein the line inserter is further configured to receive an input of the imaginary line from a user via a display screen.

5. The person counting device of claim 1 , further comprising:

a count statistic unit configured to generate and manage statistical data regarding the number of persons counted by the person counting unit; and

a transmitter configured to transmit the information regarding the number of persons counted by the person counter or the statistical data.

6. The person counting device of claim 1 , further comprising a count displayer configured to display the number of persons counted by the person counting unit on a display screen in real-time.

7. The person counting device of claim 1 , further comprising a storage configured to store and manage the statistical data from the count statistic unit.

8. The person counting device of claim 1 , wherein the person counter further comprises an object detector configured to detect persons in images respectively captured by a plurality of cameras.

9. A method of counting a number of persons, the method comprising:

matching a plurality of images respectively captured by a plurality of cameras and generating a single panorama image;

inserting an imaginary line into the single panorama image;

allocating identification numbers to respective persons in the single panorama image and counting the number of persons that pass the imaginary line; and

ruling out a number of duplicate-counted persons by using the identification numbers allocated to the respective persons in a plurality of images which are restored from the single panorama image, information regarding overlapping regions between the plurality of images, and imaginary line information,

wherein the counting comprises allocating, in the restored plurality of images, a same identification number to a person in the overlapping regions between the plurality of images.

10. The method of claim 9 , wherein, in response to the single panorama image being generated, generating the single panorama image by using a homography method or an image stitching method, and

displaying the generated single panorama image on a display screen.

11. The method of claim 9 , wherein the single panorama image is generated in real-time by reflecting changes of parameters of each of the plurality of cameras in real-time,

the generated single panorama image is displayed on a display screen in real-time, and

the parameters comprise data regarding panning, tilting, and zooming.

12. The method of claim 9 , wherein, in response to the imaginary line being inserted into the single panorama image, imputing the imaginary line from a user via a display screen.

13. The method of claim 9 , wherein the allocating and counting further comprises:

generating and managing statistical data regarding the number of persons counted; and

transmitting the information regarding the number of persons counted or statistical data.

14. The method of claim 9 , further comprising displaying the number of persons counted on a display screen in real-time.

15. A method of counting a number of persons with a system including a plurality of cameras, the method comprising:

generating a single panorama image based on a plurality of images captured by the respective plurality of cameras;

inserting an imaginary line into the single panorama image;

restoring the single panorama image including the imaginary line into a plurality of sub-images including same imaginary line information;

inserting an imaginary line into each of the plurality of sub-images;

counting the number of persons that pass each imaginary line in each of the plurality of sub-images; and

adjusting the counted number of persons by subtracting a number of duplicate counted persons by using information regarding overlapping regions between the plurality of images and imaginary line information,

wherein the adjusting comprises allocating, in the restored plurality of sub-images, a same identification number to a person in the overlapping regions between the plurality of images.

16. The method of claim 15 , wherein each of the plurality of images overlaps with at least one other image of the plurality of images.

17. The method of claim 15 , wherein the adjusting comprises:

identifying a number of persons in the single panorama image;

allocating a different identification number to each of the identified persons; and

determining if the identification number of an identified person is counted more than once.

18. The method of claim 15 , wherein the inserting the imaginary line into the single panorama image comprises inserting an imaginary line input by a user via a display screen.

19. The method of claim 15 , wherein the generating comprises:

generating the single panorama image by using a homography method or an image stitching method.

Assignments (6)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
CHANGE OF NAME Recorded Jul 24, 2015
From: SAMSUNG TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036254/0911 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2013
From: LIM, JEONG-EUN; NOH, SEUNG-IN; HONG, HA-NA
To: SAMSUNG TECHWIN CO., LTD.
Reel/Frame 031403/0973 →