IP Library Granted Patent US 10,248,870
Granted Patent B2
US 10,248,870 · App. 15/205,236 · Granted Apr 2, 2019

Traffic-counting system and method thereof

Inventors: Dajun Ding (Shanghai, CN); Lili Zhao (Shanghai, CN)
Assignee: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
G06K9/00785G06K9/00335G06K9/4652G06K9/4661G06K9/4671G06T7/0079G06T7/2033G06K2009/4666G06T2207/20144G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,248,870
App. No.
15/205,236
Granted
Apr 2, 2019
Kind
B2
Abstract

Traffic-counting methods and apparatus are disclosed. The methods may include, in a view of traffic comprising moving objects, identifying first and second regions of interest (ROIs). The methods may also include obtaining first and second image data respectively representing the first and second ROIs. The methods may also include analyzing the first and second image data over time. The methods may further include, based on the analyses of the first and second image data, counting the moving objects and determining moving directions of the moving objects.

Claims (96)

1. A traffic-counting method performed by a processor in communication with an imaging device, comprising:

in a view of traffic comprising moving objects, identifying first and second regions of interest (ROIs);

obtaining, from the imaging device, first and second image data respectively representing the first and second ROIs;

analyzing the first and second image data over time; and

based on the analyses of the first and second image data:

counting the moving objects; and

determining moving directions of the moving objects,

wherein the counting and determining comprise:

detecting that a first foreground begins to appear in the first ROI:

when detecting that a second foreground begins to appear in the second ROI within a first amount of time after the first foreground begins to appear, determining whether a color of the first foreground is consistent with a color of the second foreground; and

when it is determined that the colors of the first and second foregrounds are consistent, concluding that one or more moving objects are moving from the first ROI to the second ROI.

2. The method of claim 1 , wherein the first and second ROIs correspond to different portions of an area where the traffic occurs.

3. The method of claim 1 , wherein identifying the first and second ROIs further comprises:

setting sizes of the first and second ROIs based on volume of the traffic.

4. The method of claim 1 , wherein:

the analyzing comprises comparing, over time, a value of a property of the first ROI with a value of the property of the second ROI; and

the counting and determining comprise counting the moving objects and determining the moving directions of the moving objects, based on a result of the comparison.

5. The method of claim 4 , wherein the property comprises at least one of:

a brightness of the respective ROI; or

a color of the respective ROI.

6. The method of claim 1 , further comprising:

when detecting that the color of the first foreground changes N times, concluding that (N+1) moving objects are moving from the first ROI to the second ROI, N being an integer greater than or equal to zero.

7. The method of claim 1 further comprising:

determining the first amount of time based on a distance separating the first and second ROIs.

8. The method of claim 1 , wherein detecting the first foreground further comprises:

obtaining reference data representing the first ROI in a time when no moving objects are present in the first ROI;

determining a difference between the first image data and the reference data; and

when the difference exceeds a predetermined data threshold, determining the difference as the first foreground.

9. The method of claim 8 , further comprising:

when the difference does not exceed the data threshold, updating the reference data based on the first image data.

10. The method of claim 8 , further comprising:

when determining that the first foreground has appeared for longer than a second amount of time, updating the reference data based on the first image data.

11. The method of claim 10 , wherein:

the first image data represents a plurality of image frames; and

determining that the first foreground has appeared for longer than a second amount of time comprises:

determining that a number of consecutive image frames containing the first foreground exceeds a predetermined number.

12. The method of claim 1 , wherein determining that the colors of the first and second foregrounds are consistent comprises:

determining a first color value indicative of the color of the first foreground when the first foreground begins to appear;

determining a second color value indicative of the color of the second foreground when the second foreground begins to appear; and

when determining that the first and second color values differ by less than a predetermined color threshold, determining that the colors of the first and second foregrounds are consistent.

13. The method of claim 1 , wherein counting the moving objects and determining moving directions of the moving objects comprise:

determining a feature of the traffic based on a result of the counting and the determined moving directions.

14. The method of claim 13 , wherein:

the traffic occurs on a pathway towards a place of interest; and

determining the feature of the traffic comprises:

counting, after a predetermined point in time, a first number of moving objects moving in a first direction and a second number of moving objects moving in a second direction; and

when the first number reaches a predetermined value earlier than the second number, determining that the moving objects moving in the first direction are moving toward the place of interest.

15. A traffic-counting device, comprising:

a memory storing instructions; and

a processor in communication with an imaging device, the processor being configured to execute the instructions to:

in a view of traffic comprising moving objects, identify first and second regions of interest (ROIs);

obtain, from the imaging device, first and second image data respectively representing the first and second ROIs;

analyze the first and second image data over time; and

based on the analyses of the first and second image data:

count the moving objects; and

determine moving directions of the moving objects,

wherein in counting the moving objects and determining the moving directions of the moving objects, the processor is further configured to execute the instructions to:

determine that a first foreground begins to appear in the first ROI:

determine whether a second foreground begins to appear in the second ROI within a first amount of time after the first foreground begins to appear;

when the second foreground begins to appear within the first amount of time, determine whether a color of the first foreground is consistent with a color of the second foreground; and

when the colors of the first and second foregrounds are consistent, conclude that one or more moving objects are moving from the first ROI to the second ROI.

16. The device of claim 15 , wherein the first and second ROIs correspond to different portions of an area where the traffic occurs.

17. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

set sizes of the first and second ROIs based on volume of the traffic.

18. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

determine whether the color of the first foreground changes; and

when determining that the color of the first foreground changes N times, conclude that (N+1) moving objects are moving from the first ROI to the second ROI, N being an integer greater than or equal to zero.

19. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

determine the first amount of time based on a distance separating the first and second ROIs.

20. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

obtain reference data representing the first ROI in a time when no moving objects are present in the first ROI;

determine a difference between the first image data and the reference data; and

when the difference exceeds a predetermined data threshold, determine the difference as the first foreground.

21. The device of claim 20 , wherein the processor is further configured to execute the instructions to:

when the difference does not exceed the data threshold, update the reference data based on the first image data.

22. The device of claim 20 , wherein the processor is further configured to execute the instructions to:

determine whether the first foreground appears for longer than a second amount of time;

when the first foreground appears for longer than the second amount of time, update the reference data based on the first image data.

23. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

determine a first color value indicative of the color of the first foreground when the first foreground begins to appear;

determine a second color value indicative of the color of the second foreground when the second foreground begins to appear;

compare the first and second color values; and

when a difference of the first and second color values is less than a predetermined color threshold, determine that the colors of the first and second foregrounds are consistent.

24. The device of claim 15 , wherein the processor is further configured to execute the instructions to:

determine a feature of the traffic based on a result of the counting and the determined moving directions.

25. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor of a device in communication with an imaging device, cause the device to perform a traffic-counting method, the method comprising:

in a view of traffic comprising moving objects, identifying first and second regions of interest (ROIs);

obtaining, from the imaging device, first and second image data respectively representing the first and second ROIs;

analyzing the first and second image data over time; and

based on the analyses of the first and second image data:

counting the moving objects; and

determining moving directions of the moving objects,

wherein the counting and determining comprise:

detecting that a first foreground begins to appear in the first ROI;

when detecting that a second foreground begins to appear in the second ROI within a first amount of time after the first foreground begins to appear, determining whether a color of the first foreground is consistent with a color of the second foreground; and

when it is determined that the colors of the first and second foregrounds are consistent, concluding that one or more moving objects are moving from the first ROI to the second ROI.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2024
From: EAST WEST BANK
To: KAMI VISION INCORPORATED
Reel/Frame 070792/0551 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 28, 2022
From: KAMI VISION INCORPORATED
To: EAST WEST BANK
Reel/Frame 059512/0101 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
To: KAMI VISION INC.
Reel/Frame 059275/0652 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME PREVIOUSLY RECORDED AT REEL: 039110 FRAME: 0028. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jan 31, 2018
From: DING, DAJUN; ZHAO, LILI
To: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 045203/0683 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2016
From: DING, DAJUN; ZHAO, LILI
To: XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 039110/0028 →
Priority Claims (1)
CN 2016 1 0496591 · Jun 29, 2016 · national
Continuity (1)
Related Publication 20180005048A1 · Jan 4, 2018
Cited By (1)
US 12,675,032