IP Library › Granted Patent US 11,151,389
Granted Patent B2
US 11,151,389 · App. 16/498,949 · Granted Oct 19, 2021

Information processing apparatus, control method, and program

Inventor: Takuya Ogawa (Tokyo, JP)
Assignee: NEC CORPORATION
G06K9/00778G06K9/00335G06K9/00711G06K9/2054
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,151,389
App. No.
16/498,949
Granted
Oct 19, 2021
Kind
B2
Abstract

An information processing apparatus of the present invention detects a queue ( 20 ) of objects from video data ( 12 ). Further, the information processing apparatus of the present invention generates element information using a video frame ( 14 ) in which the queue ( 20 ) of objects is detected. The element information is information in which an object area ( 24 ) in the video frame ( 14 ) occupied by the object ( 22 ) included in the queue ( 20 ) of objects is associated with an attribute of the object ( 22 ). Furthermore, the information processing apparatus of the present invention detects a change in the queue ( 20 ) of objects based on the element information and the detection result of the object to video frame ( 14 ) generated after the video frame ( 14 ) in which the element information is generated. Then, the information processing apparatus of the present invention generates element information for the queue ( 20 ) of objects in which a change is detected to update the element information used later.

Claims (36)

1. An information processing apparatus comprising:

at least one hardware processor configured to implement:

detecting a queue of objects from video data;

generating element information that associate an object area with an attribute of an object of the objects using a video frame in which the queue is detected, the object area being an area in the video frame occupied by the object included in the queue; and

detecting a change in the queue based on the element information and a detection result of the objects with respect to a video frame generated after the video frame for which the element information is generated,

wherein the element information is generated for the queue in which the change is detected to update the element information,

wherein the attribute of the object indicated by the element information includes a position of the object in the queue, and

wherein the at least one hardware processor is further configured to detect that a first object leaves a head of the queue in a case where the first object is not detected from the object area of the first object and it is detected that a second object enters the object area of the first object, the first object having been positioned at the head of the queue, the second object having been positioned right behind the first object.

2. The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to implement:

computing a staying time at an end of the queue for the object being positioned at the end, and computes a time obtained by multiplying the computed time by a length of the queue as a waiting time of the queue.

3. The information processing apparatus according to claim 2 ,

wherein the at least one hardware processor is further configured to compute, as a staying time of the object at the end of the queue, a time between when the object leaves the end of the queue and when another object subsequently leaves the end of the queue.

4. The information processing apparatus according to claim 1 ,

wherein the at least one hardware processor is further configured to detect that the first object leaves the tail of the queue in a case where the first object is not detected from the object area of the first object and it is detected that the second object is stationary, the first object having been positioned at the tail of the queue, the second object having been positioned right before the first object.

5. The information processing apparatus according to claim 1 ,

wherein the at least one hardware processor is further configured to detect that the first object leaves the queue in a case where the first object is not detected from the object area of the first object, it is detected that the second object enters into the object area of the first object, and it is detected that a third object is stationary, the first object having not been at ends of the queue, the second object having been at right behind the first object, the third object having been right before the first object.

6. The information processing apparatus according to claim 1 ,

wherein the at least one hardware processor is further configured to implement detecting that the first object joins the queue in a case where it is detected that a distance between the first object and the second object is less than or equal to a predetermined distance and it is detected that the first object is stationary, the first object having not been included in the queue, the second object having been at the tail of the queue.

7. A control method executed by a computer, comprising:

detecting a queue of objects from video data;

generating element information that associate an object area with an attribute of an object of the objects using a video frame in which the queue is detected, the object area being an area in the video frame occupied by the object included in the queue; and

detecting a change in the queue based on the element information and a detection result of the objects with respect to a video frame generated after the video frame for which the element information is generated,

wherein the element information is generated for the queue in which a change is detected to update the element information,

wherein the attribute of the object indicated by the element information includes a position of the object in the queue, and

wherein the control method further comprises detecting that a first object leaves a head of the queue in a case where the first object is not detected from the object area of the first object and it is detected that a second object enters the object area of the first object, the first object having been positioned at the head of the queue, the second object having been positioned right behind the first object.

8. The control method according to claim 7 , further comprising:

computing a staying time at an end of the queue for the object being positioned at the end, and computing a time obtained by multiplying the computed time by a length of the queue as a waiting time of the queue.

9. The control method according to claim 8 , further comprising:

as a staying time of the object at the end of the queue, computing a time between when the object leaves the end of the queue and when another object subsequently leaves the end of the queue.

10. The control method according to claim 7 ,

further comprising detecting that the first object leaves a tail of the queue in a case where the first object is not detected from the object area of the first object and it is detected that the second object is stationary, the first object having been positioned at the tail of the queue, the second object having been positioned right before the first object.

11. The control method according to claim 7 ,

further comprising detecting that the first object leaves the queue in a case where the first object is not detected from the object area of the first object, it is detected that the second object enters into the object area of the first object, and it is detected that a third object is stationary, the first object having not been at ends of the queue, the second object having been at right behind the first object, the third object having been right before the first object.

12. The control method according to claim 7 ,

further comprising detecting that the first object joins the queue in a case where it is detected that a distance between the first object and the second object is less than or equal to a predetermined distance and it is detected that the first object is stationary, the first object having not been included in the queue, the second object having been at the tail of the queue.

13. A non-transitory computer readable storage medium storing a program causing a computer to execute each operation of the control method according to claim 7 .

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY ADDRESS PREVIOUSLY RECORDED ON REEL 050522 FRAME 0984. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTED ASSIGNMENT. Recorded Nov 8, 2019
From: OGAWA, TAKUYA
To: NEC CORPORATION
Reel/Frame 050969/0294 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2019
From: OGAWA, TAKUYA
To: NEC CORPORATION
Reel/Frame 050522/0984 →
Priority Claims (1)
JP JP2017-070824 · Mar 31, 2017 · national
Continuity (1)
Related Publication 20210110167A1 · Apr 15, 2021