IP Library Granted Patent US 10,516,858
Granted Patent B2
US 10,516,858 · App. 15/832,629 · Granted Dec 24, 2019

Monitoring system, monitoring method, and program

Inventors: Masao Watanabe (Fukuoka, JP); Takahiro Yoshimura (Fukuoka, JP); Akihiro Nawata (Fukuoka, JP)
Assignee: Panasonic Intellectual Property Management Co., Ltd.
H04N7/188B64C39/024G08B13/19602G08B13/19621G08B13/19656G08B25/08G08G1/04G08G1/205G08G5/0078H04N5/23206H04N5/247H04N7/181B64C2201/127B64C2201/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,516,858
App. No.
15/832,629
Granted
Dec 24, 2019
Kind
B2
Abstract

A plurality of fixed cameras installed in a driving area on a highway and a server device are connected via a network NW. The server device displays the captured images of the fixed cameras on the fixed camera monitor and requests camera position information and zooming position information to respective fixed cameras in response to occurrence of a traffic accident or the like in the driving area. In response to this request, the fixed cameras transmit the camera position information and the zooming position information to the server device. Based on camera position information and zooming position information, the server device derives the occurrence position of a traffic accident or the like, instructs a predetermined drone to capture the image around the occurrence position such as a traffic accident, and displays the captured image transmitted from the drone on a drone monitor.

Claims (64)

1. A monitoring system comprising:

a camera that is installed in an imaging area; and

a server that communicates with the camera via a network,

wherein the server, in operation, displays an image of the imaging area captured by the camera on a display, and transmits to the camera a request for camera information in response to an occurrence of an incident in the imaging area,

wherein the camera, in operation, transmits the camera information to the server in response to the request, the camera information including camera position information of the camera and zooming position information of the camera, and

wherein the server, in operation,

derives an occurrence position of the incident based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera,

selects a lighting device based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera,

issues a lighting instruction to the lighting device selected based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera, the lighting instruction instructing the lighting device to adjust a brightness of light emitted by the lighting device,

issues an on-site check instruction to an unmanned aerial vehicle, the on-site check instruction instructing the unmanned aerial vehicle to capture an image of a vicinity of the occurrence position of the incident derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera,

acquires the image of the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicle; and

displays the image of the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicle on the display.

2. The monitoring system of claim 1 ,

wherein the camera information transmitted by the camera includes feature information of a subject within an angle of view of the camera.

3. The monitoring system of claim 1 ,

wherein the feature information of the subject within the angle of view of the camera transmitted by the camera includes color information.

4. The monitoring system of claim 1 , further comprising:

a plurality of lighting devices including the lighting device selected by the server,

wherein the server, in operation, selects the lighting device from among the plurality of lighting devices based on the position information of the camera indicating proximity to the occurrence position of the incident.

5. The monitoring system of claim 1 ,

wherein the server, in operation, recognizes the occurrence of the incident and transmits the request for camera information to the camera in response to a predetermined button operation.

6. A monitoring method in a monitoring system which includes a camera that is installed in an imaging area and a server that communicates with the cameras via a network, the method comprising:

displaying an image of an imaging area captured by the camera on a display;

transmitting from the server to the camera a request for camera information in response to an occurrence of an incident in the imaging area;

transmitting from the camera to the server the camera information in response to the request transmitted from the server, the camera information including camera position information of the camera and zooming position information of the camera;

deriving an occurrence position of the incident based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

selecting a lighting device based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

issuing a lighting instruction to the lighting device selected based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera, the lighting instruction instructing the lighting device to adjust a brightness of light emitted by the lighting device;

issuing an on-site check instruction to an unmanned aerial vehicle, the on-site check instruction instructing the unmanned aerial vehicle to capture an image of a vicinity of the occurrence position of the incident derived based on the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

acquiring the image of the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicles; and

displaying the image of the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicle on the display.

7. A non-transitory computer readable medium storing a program that causes a computer server, which communicates with a camera installed in an imaging area via a network, to:

display an image of the imaging area captured by the camera on a display;

transmit to the camera a request for camera information in response to an occurrence of an incident in the imaging area;

receive from the camera the camera information in response to the request, the camera information including camera position information of the camera and zooming position information of the camera;

derive an occurrence position of the incident based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera in response to receiving the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

select a lighting device based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

issue a lighting instruction to the lighting device selected based on the occurrence position derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera, the lighting instruction instructing the lighting device to adjust a brightness of light emitted by the lighting device,

issues an on-site check instruction to an unmanned aerial vehicle, the on-site check instruction instructing the unmanned aerial vehicle to capture an image of a vicinity of the occurrence position of the incident derived based on the image of the imaging area captured by the camera and the camera information including the camera position information of the camera and the zooming position information of the camera transmitted from the camera;

acquire the image of the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicle; and

display the image captured in the vicinity of the occurrence position of the incident captured by the unmanned aerial vehicle on the display.

8. The computer readable medium of claim 7 ,

wherein the camera information transmitted by the camera includes feature information of a subject within an angle of view of the camera.

9. The computer readable medium of claim 8 ,

wherein the feature information of the subject within the angle of view of the camera transmitted by the camera includes color information.

10. The computer readable medium of claim 7 ,

wherein the program causes the server to select the lighting device from among a plurality of lighting devices based on the position information of the camera indicating proximity to the occurrence position of the incident.

11. The computer readable medium of claim 7 ,

wherein the program causes the server to recognize the occurrence of the incident and transmit the request for camera information to the camera in response to a predetermined button operation.

12. The computer readable medium of claim 7 ,

wherein the program causes the server to recognize the occurrence of the incident based on the image of the imaging area captured by the camera.

13. The monitoring method of claim 6 ,

wherein the camera information transmitted by the camera includes feature information of a subject within an angle of view of the camera.

14. The monitoring method of claim 13 ,

wherein the feature information of the subject within the angle of view of the camera transmitted by the camera includes color information.

15. The monitoring system of claim 6 ,

wherein the selecting includes selecting the lighting device from among a plurality of lighting devices based on the position information of the camera indicating proximity to the occurrence position of the incident.

16. The monitoring system of claim 6 , further comprising:

recognizing, by the server, the occurrence of the incident in response to a predetermined button operation,

wherein the transmitting of the request for camera information to the camera is in response to the predetermined button operation.

17. The monitoring system of claim 6 , further comprising:

recognizing, by the server, the occurrence of the incident based on the image of the imaging area captured by the camera.

18. The monitoring system of claim 1 ,

wherein the server, in operation, recognizes the occurrence of the based on the image of the imaging area captured by the camera.

Assignments (8)
CHANGE OF NAME Recorded Mar 16, 2023
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063101/0966 →
CHANGE OF ADDRESS Recorded Mar 16, 2023
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063102/0075 →
CHANGE OF NAME Recorded Dec 31, 2020
From: PSP HOLDINGS CO., LTD
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0234 →
MERGER Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PSP HOLDINGS CO., LTD
Reel/Frame 054883/0201 →
CHANGE OF ADDRESS Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0248 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTED DATE PREVIOUSLY RECORDED AT REEL: 051249 FRAME: 0136. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 13, 2020
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 051580/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2019
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 051249/0136 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2018
From: WATANABE, MASAO; YOSHIMURA, TAKAHIRO; NAWATA, AKIHIRO
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 044877/0081 →
Priority Claims (1)
JP 2016-256845 · Dec 28, 2016 · national
Continuity (1)
Related Publication 20180184051A1 · Jun 28, 2018