Granted Patent B2

US 12,423,985 · App. 19/096,187 · Granted Sep 23, 2025

Inventor: Ryoma Oami (Tokyo, JP)

Assignee: NEC Corporation

G06V20/52G06V20/40G06V40/23G08B21/24H04N7/181G06V20/44G06V2201/07

Abstract

Claims (92)

1. An information processing method executed by one or more processors, the information processing method comprising:

detecting a target object in a first video segment;

selecting a first video frame from the first video segment, wherein the first video frame includes at least a part of the target object;

outputting a first image based on the first video frame, wherein the first image includes at least a part of the target object;

detecting a person in a second video segment, wherein the person is within a vicinity region;

selecting a second video frame from the second video segment, wherein the second video frame includes at least a part of the target object and at least a part of the person; and

outputting a second image based on the second video frame, wherein the second image includes at least a part of the target object and at least a part of the person,

wherein the second video segment occurs chronologically after the first video segment.

2. The information processing method of claim 1 , further comprising:

generating a first message that identifies the target object;

displaying on a display the first image and the first message;

determining the vicinity region based at least in part on a location of the target object in the first video segment;

generating a second message that identifies the person; and

displaying on the display the second image and the second message.

3. The information processing method of claim 1 , wherein the vicinity region is a region that is within a predetermined area relative to the target object.

4. The information processing method of claim 1 , further comprising:

executing, using a camera, a tracking process to track a movement of the person in response to detecting that the person is within the vicinity region;

generating frames of image data based on the tracking process; and

displaying the frames of image data corresponding to the tracked movement of the person.

5. The information processing method of claim 1 , further comprising:

detecting the person includes distinguishing between a first person and a second person, wherein the target object is a stationary object that has been left behind by the first person, the detected person in the second video segment is the second person; and

transmitting to a user device when it is detected that the second person is different from the first person that left behind the stationary object.

6. An information processing system comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

detecting a target object in a first video segment;

selecting a first video frame from the first video segment, wherein the first video frame includes at least a part of the target object;

outputting a first image based on the first video frame, wherein the first image includes at least a part of the target object;

detecting a person in a second video segment, wherein the person is within a vicinity region;

selecting a second video frame from the second video segment, wherein the second video frame includes at least a part of the target object and at least a part of the person; and

outputting a second image based on the second video frame, wherein the second image includes at least a part of the target object and at least a part of the person,

wherein the second video segment occurs chronologically after the first video segment.

7. The information processing system of claim 6 , wherein the operations further comprise:

generating a first message that identifies the target object;

displaying on a display the first image and the first message;

determining the vicinity region based at least in part on the location of the target object in the first video segment;

generating a second message that identifies the person; and

displaying on the display the second image and the second message.

8. The information processing system of claim 6 , wherein the vicinity region is a region that is within a predetermined area relative to the target object.

9. The information processing system of claim 6 , wherein the operations further comprise:

executing, using a camera, a tracking process to track a movement of the person in response to detecting that the person is within the vicinity region;

generating frames of image data based on the tracking process; and

displaying the frames of image data corresponding to the tracked movement of the person.

10. The information processing system of claim 6 , wherein the operations further comprise:

detecting the person includes distinguishing between a first person and a second person, wherein the target object is a stationary object that has been left behind by the first person, the detected person in the second video segment is the second person; and

transmitting to a user when it is detected that the second person is different from the first person that left behind the stationary object.

11. An information processing method for a security system executed by one or more processors, the information processing method comprising:

detecting a person with a device;

detecting an object with the device;

classifying the detected object as a target object;

processing video data and identifying a first video frame and a second video frame, the first video frame including images collected by the device before the images included in the second video frame;

wherein the first video frame includes an image of the target object and the second video frame includes an image of the target object and a person detected in a predetermined detection zone that includes the target object;

outputting first information corresponding to the first video frame; and

outputting second information corresponding to the second video frame when a person is detected in the predetermined detection zone that includes the target object.

12. The information processing method of claim 11 , wherein the first video frame includes the image of the target object, the target object being placed on a ground.

13. The information processing method of claim 11 , wherein

processing the video data includes identifying a third video frame, the third video frame being generated chronologically before the first video frame, the third video frame including at least a part of the person.

14. The information processing method of claim 11 , further comprising

outputting person information, the person information being the person in the predetermined detection zone around the target object in the first video frame.

15. The information processing method of claim 11 , further comprising

acquiring the predetermined detection zone from a storage medium, the predetermined detection zone is a predetermined shape defined by a plurality of vertices.

16. The information processing method of claim 11 , further comprising:

estimating a type of the target object, and

determining process based on the type of the target object.

17. The information processing method of claim 11 , wherein the target object is in a state where a change in the position of the target object is equal to or less than a predetermined threshold.

18. The information processing method of claim 11 , further comprising initiating an alarm from the device after detecting a person.

19. The information processing method of claim 11 , further comprising classifying the target object as a piece of luggage.

20. The information processing method of claim 11 , further comprising classifying the target object as a package.

21. An information processing system comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

detecting a person with a device;

detecting an object with the device;

classifying the detected object as a target object;

processing video data and identifying a first video frame and a second video frame, the first video frame including images collected by the device before the images included in the second video frame;

wherein the first video frame includes an image of the target object and the second video frame includes an image of the target object and a person detected in a predetermined detection zone that includes the target object;

outputting first information corresponding to the first video frame; and

outputting second information corresponding to the second video frame when a person is detected in the predetermined detection zone that includes the target object.

22. The information processing system of claim 21 wherein the first video frame includes the image of the target object, the target object being placed on a ground.

23. The information processing system of claim 21 , wherein

processing the video data includes identifying a third video frame, the third video frame being generated chronologically before the first video frame, the third video frame including at least a part of the person.

24. The information processing system of claim 21 , wherein the operations further comprise

outputting person information, the person information being information on the person in the predetermined detection zone around the target object in the first video frame.

25. The information processing system of claim 21 , wherein the operations further comprise:

acquiring the predetermined detection zone from a storage medium, the predetermined detection zone is a predetermined shape defined by a plurality of vertices.

26. The information processing system of claim 21 , further comprising:

estimating a type of the target object, and

determining process based on the type of the target object.

27. The information processing system of claim 21 , wherein the target object is in a state where a change in the position of the target object is equal to or less than a predetermined threshold.

28. The information processing system of claim 21 , wherein the operations further comprise initiating an alarm from the device after detecting a person.

29. The information processing system of claim 21 , wherein the operations further comprise classifying the target object as a piece of luggage.

30. The information processing system of claim 21 , wherein the operations further comprise classifying the target object as a package.

Continuity (6)

References Cited (93)