IP Library › Granted Patent US 11,533,436
Granted Patent B2
US 11,533,436 · App. 17/108,063 · Granted Dec 20, 2022

Monitoring system, monitoring method, and monitoring program

Inventor: Tomoya Kouno (Tokyo, JP)
Assignee: NEC CORPORATION
H04N5/23296G06F3/14G06T7/70G06V10/44G08B13/19608G08B25/00G08B25/08H04M11/00H04N5/247H04N7/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,533,436
App. No.
17/108,063
Granted
Dec 20, 2022
Kind
B2
Abstract

In a monitoring system, the management device causes a display device to display an image generated by capturing by the camera whose direction has been controlled; accepts designation of at least one tracking target, the at least one tracking target being designated from among moving objects in the displayed image by an operator; and performs tracking control comprising controlling a photographing range of the camera in such a way that the designated at least one tracking target is kept captured by the camera.

Claims (61)

1. A monitoring system comprising:

a mobile terminal held by a security guard; and

a management device configured to communicate with the mobile terminal,

wherein the mobile terminal includes at least one processor configured to:

transmit a request for switching a mode of control of a camera to the management device when a predetermined action performed by the security guard is detected using an acceleration of the mobile terminal; and

wherein the management device includes at least one processor configured to:

switch, when the request is received, the mode of control of the camera to a tracking mode;

perform tracking control comprising controlling a photographing range of the camera in such a way that at least one tracking target designated by an operator, that is extracted from among moving objects in a displayed image, is kept captured by the camera; and

extract the security guard appearing in the displayed image and determine the security guard as a provisional tracking target.

2. The monitoring system according to claim 1 , wherein the mobile terminal further comprises an acceleration sensor,

wherein the at least one processor in the mobile terminal is further configured to:

acquire an acceleration of the mobile terminal from the acceleration sensor; and

transmit the acquired acceleration of the mobile terminal to the management device, and

wherein the at least one processor in the management device is further configured to:

receive the acceleration;

calculate a current position of the mobile terminal by using the received acceleration; and

control the direction of the camera in such a way that the camera is directed to the calculated current position.

3. The monitoring system according to claim 1 , wherein the mobile terminal further comprises an acceleration sensor, and

wherein the at least one processor in the mobile terminal is further configured to:

acquire an acceleration of the mobile terminal from the acceleration sensor;

determine whether the acceleration is equal to or higher than a predetermined value; and

determine that the predetermined action is performed by the security guard when the acceleration is determined to be equal to or higher than the predetermined value.

4. Monitoring system according to claim 1 , wherein the mobile terminal performs photographing in response to an operation by the security guard, and

wherein the at least one processor in the mobile terminal is further configured to transmit the image generated by the photographing to the management device together with position information and the request.

5. The monitoring system according to claim 1 , wherein the at least one processor in the management device is further configured to accept designation of the at least one tracking target while tracking the provisional tracking target.

6. The monitoring system according to claim 1 , wherein the at least one processor in the mobile terminal is further configured to transmit position information of the mobile terminal to the management device, and

wherein the at least one processor in the management device is further configured to switch, when the request is received, the mode of control of the camera to a tracking mode in which the at least one processor in the management device controls a direction of the camera using the position information in such a way that the camera is directed to a place indicated by the position information.

7. The monitoring system according to claim 1 , wherein the at least one processor in the management device is further configured to:

cause a display device to display an image generated by capturing by the camera whose direction has been controlled; and

accept designation of at least one tracking target, the at least one tracking target being designated from among moving objects in the displayed image by an operator.

8. A monitoring method executed in a system including a mobile terminal held by a security guard and a management device configured to communicate with the mobile terminal,

wherein the mobile terminal performs a process of transmitting a request for switching a mode of control of a camera to the management device when a predetermined action performed by the security guard is detected using an acceleration of the mobile terminal, and

wherein the management device performs processes comprising:

switching, when the request is received, the mode of control of the camera to a tracking mode;

performing tracking control comprising controlling a photographing range of the camera in such a way that at least one tracking target designated by an operator, that is extracted from among moving objects in a displayed image, is kept captured by the camera; and

extracting the security guard appearing in the displayed image and determining the security guard as a provisional tracking target.

9. The monitoring method according to claim 8 , wherein the mobile terminal further performs processes comprising:

acquiring an acceleration of the mobile terminal from the acceleration sensor; and

transmitting the acquired acceleration of the mobile terminal to the management device, and

wherein the management device further performs processes of:

receiving an acceleration;

calculating a current position of the mobile terminal by using the received acceleration; and

controlling the direction of the camera in such a way that the camera is directed to the calculated current position.

10. The monitoring method according to claim 8 , wherein the mobile terminal further performs processes comprising:

acquiring an acceleration of the mobile terminal from the acceleration sensor;

determining whether the acceleration is equal to or higher than a predetermined value; and

determining that the predetermined action is performed by the security guard when the acceleration is determined to be equal to or higher than the predetermined value.

11. The monitoring method according to claim 8 , wherein the mobile terminal further performs a process of transmitting the image generated by the photographing to the management device together with position information and the request.

12. The monitoring method according to claim 8 , wherein the management device further performs a process of accepting designation of the at least one tracking target while tracking the provisional tracking target.

13. The monitoring method according to claim 8 , wherein the mobile terminal further performs a process of transmitting position information of the mobile terminal to the management device, and

wherein the management device further performs a process of switching, when the request is received, the mode of control of the camera to a tracking mode in which the at least one processor in the management device controls a direction of the camera using the position information in such a way that the camera is directed to a place indicated by the position information.

14. The monitoring method according to claim 8 , wherein the management device further performs processes comprising:

causing a display device to display an image generated by capturing by the camera whose direction has been controlled; and

accepting designation of at least one tracking target, the at least one tracking target being designated from among moving objects in the displayed image by an operator.

15. A non-transitory computer-readable storage medium storing a program that, when executed, causes a computer to execute operations comprising:

receiving a request for switching a mode of control of a camera to from a mobile terminal, the mobile terminal being configured to transmit the request to the management device when a predetermined action performed by the security guard is detected using an acceleration of the mobile terminal;

switching, when the request is received, the mode of control of the camera to a tracking mode;

performing tracking control comprising controlling a photographing range of the camera in such a way that at least one tracking target designated by an operator, that is extracted from among moving objects in a displayed image, is kept captured by the camera; and

extracting the security guard appearing in the displayed image and determining the security guard as a provisional tracking target.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein the program further causes the computer to execute operations comprising:

accepting designation of the at least one tracking target while tracking the provisional tracking target.

Priority Claims (1)
JP 2015-052795 · Mar 17, 2015 · national
Continuity (3)
Continuation 16401624 · May 2, 2019
Continuation 15558643
Related Publication 20210105409A1 · Apr 8, 2021
Cited By (1)
US 12,383,916