IP Library › Granted Patent US 11,120,838
Granted Patent B2
US 11,120,838 · App. 16/634,443 · Granted Sep 14, 2021

Information processing apparatus, control method, and program

Inventors: Ryoma Oami (Tokyo, JP); Tetsuaki Suzuki (Tokyo, JP); Yusuke Takahashi (Singapore, SG)
Assignees: NEC CORPORATION; NEC Solution Innovators, Ltd.
G11B27/19G06K9/00744G11B27/005G06K9/00771
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,838
App. No.
16/634,443
Granted
Sep 14, 2021
Kind
B2
Abstract

An information processing apparatus ( 2100 ) detects a left-behind object from video data ( 12 ). In addition, the information processing apparatus ( 2100 ) estimates a time-point at which the left-behind object is left behind. Furthermore, the information processing apparatus ( 2100 ) acquires video data near an estimated left-behind time-point (estimated left-behind time-point), controls the acquired video data based on the estimated left-behind time-point, and then presents at least a part of the acquired video data to a user.

Claims (46)

1. An information processing apparatus comprising:

at least one of a circuit and a processor configured to execute:

a left-behind object detection unit detecting a left-behind object from video data;

a left-behind time-point estimation unit estimating a left-behind time-point at which the left-behind object is placed; and

a presentation control unit acquiring video data near the estimated left-behind time-point, and presenting at least a part of the acquired video data by controlling a method of presenting the acquired video data based on the estimated left-behind time-point,

wherein

_the presentation control unit extracts one or more video frames included in the acquired video data and displays the extracted video frames side by side, and

wherein the number of video frames extracted from each of a plurality of parts in the acquired video data is determined based on the estimated left-behind time-point.

2. The information processing apparatus according to claim 1 , wherein the left-behind object detection unit includes:

a person detection unit executing person detection processing of detecting a person in the vicinity of a target object for each of a first video frame and a second video frame, the target object being an object detected as a stationary object, the first video frame including the target object, the second video frame including the target object and being generated after the first video frame; and

a left-behind state determination unit determining a left-behind state by comparing results of the person detection processing for each of the first video frame and the second video frame, and

wherein it is determined that the left-behind object is detected in a case where the object is determined to be in a state of being left behind by the left-behind state determination unit.

3. The information processing apparatus according to claim 1 , wherein the presentation control unit determines a playback speed of each of a plurality of parts included in the acquired video data based on the estimated left-behind time-point.

4. The information processing apparatus according to claim 3 , wherein the presentation control unit performs a playback for the acquired video data in a reverse direction and causes the playback speed of the part near the estimated left-behind time-point in the acquired video data to be slower than a playback speed of another part.

5. The information processing apparatus according to claim 1 , wherein the presentation control unit sets the number of video frames extracted from the video data near the estimated left-behind time-point per unit time to be greater than the number of video frames extracted from video data in another period per unit time.

6. The information processing apparatus according to claim 1 , wherein the presentation control unit presents information on the detected left-behind object together with at least a part of the acquired video data.

7. An information processing apparatus comprising:

at least one of a circuit and a processor configured to execute:

a left-behind object detection unit detecting a left-behind object from video data;

a left-behind time-point estimation unit estimating a left-behind time-point at which the left-behind object is placed; and

a presentation control unit acquiring video data near the estimated left-behind time-point, and presenting at least a part of the acquired video data by controlling a method of presenting the acquired video data based on the estimated left-behind time-point,

wherein the presentation control unit extracts one or more video frames included in the acquired video data and switches and displays the extracted video frames sequentially, and

wherein the number of video frames extracted from each of a plurality of parts in the acquired video data per unit time is determined based on the estimated left-behind time-point.

8. The information processing apparatus according to claim 7 , wherein the presentation control unit displays the extracted video frames in an order from a latest generation time-point.

9. A control method causing a computer to execute:

detecting a left-behind object from video data;

estimating a left-behind time-point at which the left-behind object is placed; and

acquiring video data near the estimated left-behind time-point, and presenting at least part of the acquired video data by controlling a method of presenting the acquired video data based on the estimated left-behind time-point,

wherein one or more video frames included in the acquired video data are extracted and the extracted video frames are displayed side by side, and

wherein the number of video frames extracted from each of a plurality of parts in the acquired video data is determined based on the estimated left-behind time-point.

10. The control method according to claim 9 , further comprising:

executing person detection processing of detecting a person in the vicinity of a target object for each of a first video frame and a second video frame, the target object being an object detected as a stationary object, the first video frame including the target object, the second video frame including the target object and being generated after the first video frame; and

determining a left-behind state by comparing results of the person detection processing for each of the first video frame and the second video frame, and

wherein it is determined that the left-behind object is detected in a case where the object is determined to be in a state of being left behind.

11. The control method according to claim 9 , wherein a playback speed of each of a plurality of parts included in the acquired video data is determined based on the estimated left-behind time-point.

12. The control method according to claim 11 , wherein a playback for the acquired video data is performed in a reverse direction and the playback speed of the part near the estimated left-behind time-point in the acquired video data is slower than a playback speed of another part.

13. The control method according to claim 9 , wherein the number of video frames extracted from the video data near the estimated left-behind time-point per unit time is set to be greater than the number of video frames extracted from video data in another period per unit time.

14. The control method according to claim 9 , wherein information on the detected left-behind object is presented together with at least a part of the acquired video data.

15. A non-transitory computer-readable medium storing a program causing a computer to execute the control method according to claim 9 .

16. A control method causing a computer to execute:

detecting a left-behind object from video data;

estimating a left-behind time-point at which the left-behind object is placed; and

acquiring video data near the estimated left-behind time-point, and presenting at least part of the acquired video data by controlling a method of presenting the acquired video data based on the estimated left-behind time-point,

wherein one or more video frames included in the acquired video data are extracted and the extracted video frames are switched and displayed sequentially, and

wherein the number of video frames extracted from each of a plurality of parts in the acquired video data per unit time is determined based on the estimated left-behind time-point.

17. The control method according to claim 16 , wherein the extracted video frames are displayed in an order from a latest generation time-point.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE 1ST INVENTOR'S ZIP CODE PREVIOUSLY RECORDED AT REEL: 51720 FRAME: 955. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 17, 2020
From: OAMI, RYOMA; SUZUKI, TETSUAKI; TAKAHASHI, YUSUKE
To: NEC CORPORATION; NEC SOLUTION INNOVATORS, LTD.
Reel/Frame 052433/0072 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: OAMI, RYOMA; SUZUKI, TETSUAKI; TAKAHASHI, YUSUKE
To: NEC CORPORATION; NEC SOLUTION INNOVATORS, LTD.
Reel/Frame 051720/0955 →
Priority Claims (1)
JP JP2017-146636 · Jul 28, 2017 · national
Continuity (1)
Related Publication 20210090611A1 · Mar 25, 2021