IP Library Granted Patent US 8,368,754
Granted Patent B2
US 8,368,754 · App. 12/402,626 · Granted Feb 5, 2013

Video pattern recognition for automating emergency service incident awareness and response

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,368,754
App. No.
12/402,626
Granted
Feb 5, 2013
Kind
B2
Abstract

Video analysis capabilities can be integrated into an emergency response system and/or a video operations center (VOC) monitoring for emergency incidents. At least one computer program driven response action involving detecting patterns in video streams that comprise video of an incident can be performed. This response action can be directed to VOC personnel and/or to emergency response system personnel. Further, the response action can result in an automated responses to an emergency incident and/or to an alerting of humans monitoring video to focus on a particular video stream/incident. One such response action, which increases video capture activity at a geographic location of the incident, can occur responsive to a receipt of an emergency call by the emergency response system. Another response action can analyze at least one video stream of the geographic location and can automatically dispatch (in approximately real time) an emergency responder to the geographic location. Still another action can analyze the video stream of a geographic location, can determine a high likelihood of an emergency incident, and can provide an alert in a user interface of the emergency response system or a VOC. Video of the incident can also be provided in the user interface.

Claims (45)

1. An emergency response method comprising:

integrating video analysis capabilities into at least one of an emergency response system and a video operations center (VOC) monitoring for emergency incidents; and

performing at least one computer program driven response action involving detecting patterns in video streams that comprise video of an incident, wherein the response action comprises:

analyzing at least one video stream of a geographic location and automatically dispatching an emergency responder to the geographic location based upon results of analyzing the at least one video stream, wherein the analyzing and the automatic dispatching occur in at least one of real-time and near real-time;

aggregating results of analyzing the at least one video stream of the geographic location with data input into the emergency response system based upon real-time voice communications involving emergency response system personnel;

determining a likelihood of an emergency incident based upon the aggregated results of analyzing the video stream and the data input based upon real time voice communications; and

automatically dispatching the emergency responder only when the determined likelihood of the emergency incident exceeds a previously established threshold.

2. The method of claim 1 , further comprising:

equipping responders with at least a video capture device and a video display device that are communicatively linked to at least one of the emergency response system and the video operations center (VOC), wherein video from said video capture device is routed to at least one of the emergency response system and the video operations center (VOC) where the routed video is programmatically analyzed for patterns detection purposes, and wherein video from at least one of the emergency response system and video operations center (VOC) is selectively presented upon the video display device.

3. The method of claim 1 , wherein the video analysis engine is configured to recognize patterns in video streams, to compare these patterns against a data store of previously established patterns that are associated with defined incidents to determine occurrences of instances depicted in the video stream, and wherein the emergency response system is configured to dispatch emergency personnel to a site of an incident in response to an occurrence of an incident, and is configured to receive emergency calls alerting personnel of an emergency requiring a dispatch of emergency personnel.

4. The method of claim 1 , further comprising:

granting control of at least one video source proximate to the geographic location to at least one of the emergency response system and the video operations center (VOC), wherein the control permits adjustments to be remotely made to the video source, which alter a video stream acquired from the video source, said altered video stream being routed to at least one of the emergency response system and the video operations center (VOC), whereby control comprises one of video source angle, video source focal point, video source contrast, and zoom.

5. The method of claim 1 , further comprising dynamically adjusting video coverage during the incident in real-time based upon results of pattern detection to ensure a maximization of video related to the incident is captured and available to at least one of the emergency response system and the video operations center (VOC), wherein the pattern detection from the video analysis in conjunction with an ability to control video captured by remotely located video sources proximate to the geographic location ensures that important entities, which are identified based upon the video analysis, and that are involved in the incident are tracked by video routed to at least one of the emergency response system and the video operations center (VOC).

6. A computer program product for emergency response comprising a non-transitory computer readable storage medium that is a physical storage medium having computer usable program code embodied therewith, said computer usable program code being configured to be utilized by a processor, the computer program product comprising:

computer usable program code configured to integrate video analysis capabilities into at least one of an emergency response system and a video operations center (VOC) monitoring for emergency incidents; and

computer usable program code configured to perform at least one computer program driven response action involving detecting patterns in video streams that comprise video of an incident, wherein the response action comprises:

analyzing at least one video stream of a geographic location and automatically dispatching an emergency responder to the geographic location based upon results of analyzing the at least one video stream, wherein the analyzing and automatic dispatching occur in at least one of real-time and near real-time;

aggregating results of analyzing the at least one video stream of the geographic location with data input into the emergency response system based upon real-time voice communications involving emergency response system personnel;

determining a likelihood of an emergency incident based upon the aggregated results of analyzing the video stream and the data input based upon real time voice communications; and

automatically dispatching the emergency responder only when the determined likelihood of the emergency incident exceeds a previously established threshold.

7. The computer program product of claim 6 , wherein the video analysis engine is configured to recognize patterns in video streams, to compare these patterns against a data store of previously established patterns that are associated with defined incidents to determine occurrences of instances depicted in the video stream, and wherein the emergency response system is configured to dispatch emergency personnel to a site of an incident in response to an occurrence of an incident, and is configured to receive emergency calls alerting personnel of an emergency requiring a dispatch of emergency personnel.

8. The computer program product of claim 6 , wherein responders are equipped with at least a video capture device and a video display device that are communicatively linked to at least one of the emergency response system and the video operations center (VOC), further comprising:

computer usable program code configured to route video from said video capture device to at least one of the emergency response system and the video operations center (VOC) where the routed video is programmatically analyzed for patterns detection purposes, and wherein video from at least one of the emergency response system and video operations center (VOC) is selectively presented upon the video display device.

9. The computer program product of claim 6 , wherein the video analysis engine is configured to recognize patterns in video streams, to compare these patterns against a data store of previously established patterns that are associated with defined incidents to determine occurrences of instances depicted in the video stream, and wherein the emergency response system is configured to dispatch emergency personnel to a site of an incident in response to an occurrence of an incident, and is configured to receive emergency calls alerting personnel of an emergency requiring a dispatch of emergency personnel.

10. The computer program product of claim 6 , further comprising:

computer usable program code configured to grant control of at least one video source proximate to the geographic location to at least one of the emergency response system and the video operations center (VOC), wherein the control permits adjustments to be remotely made to the video source, which alter a video stream acquired from the video source, said altered video stream being routed to at least one of the emergency response system and the video operations center (VOC), whereby control comprises one of video source angle, video source focal point, video source contrast, and zoom.

11. The computer program product of claim 6 , further comprising:

computer usable program code configured to dynamically adjust video coverage during the incident in real-time based upon results of pattern detection to ensure a maximization of video related to the incident is captured and available to at least one of the emergency response system and the video operations center (VOC), wherein the pattern detection from the video analysis in conjunction with an ability to control video captured by remotely located video sources proximate to the geographic location ensures that important entities, which are identified based upon the video analysis, and that are involved in the incident are tracked by video routed to at least one of the emergency response system and the video operations center (VOC).

12. A system for emergency response comprising:

one or more one processors; and

a non-transitory computer readable storage medium that is a physical storage medium having computer usable program code embodied therewith, said computer usable program code being configured to be utilized by at least one of the one or more processors, the computer program product comprising:

computer usable program code configured to integrate video analysis capabilities into at least one of an emergency response system and a video operations center (VOC) monitoring for emergency incidents; and

computer usable program code configured to perform at least one computer program driven response action involving detecting patterns in video streams that comprise video of an incident, wherein the response action comprises:

analyzing at least one video stream of a geographic location and automatically dispatching an emergency responder to the geographic location based upon results of analyzing the at least one video stream, wherein the analyzing and automatic dispatching occur in at least one of real-time and near real-time;

aggregating results of analyzing the at least one video stream of the geographic location with data input into the emergency response system based upon real-time voice communications involving emergency response system personnel;

determining a likelihood of an emergency incident based upon the aggregated results of analyzing the video stream and the data input based upon real time voice communications; and

automatically dispatching the emergency responder only when the determined likelihood of the emergency incident exceeds a previously established threshold.

13. The system of claim 12 , wherein the video analysis engine is configured to recognize patterns in video streams, to compare these patterns against a data store of previously established patterns that are associated with defined incidents to determine occurrences of instances depicted in the video stream, and wherein the emergency response system is configured to dispatch emergency personnel to a site of an incident in response to an occurrence of an incident, and is configured to receive emergency calls alerting personnel of an emergency requiring a dispatch of emergency personnel.

14. The system of claim 12 , wherein responders are equipped with at least a video capture device and a video display device that are communicatively linked to at least one of the emergency response system and the video operations center (VOC), further comprising:

computer usable program code configured to route video from said video capture device to at least one of the emergency response system and the video operations center (VOC) where the routed video is programmatically analyzed for patterns detection purposes, and wherein video from at least one of the emergency response system and video operations center (VOC) is selectively presented upon the video display device.

15. The system of claim 12 , wherein the video analysis engine is configured to recognize patterns in video streams, to compare these patterns against a data store of previously established patterns that are associated with defined incidents to determine occurrences of instances depicted in the video stream, and wherein the emergency response system is configured to dispatch emergency personnel to a site of an incident in response to an occurrence of an incident, and is configured to receive emergency calls alerting personnel of an emergency requiring a dispatch of emergency personnel.

16. The system of claim 12 , further comprising:

computer usable program code configured to grant control of at least one video source proximate to the geographic location to at least one of the emergency response system and the video operations center (VOC), wherein the control permits adjustments to be remotely made to the video source, which alter a video stream acquired from the video source, said altered video stream being routed to at least one of the emergency response system and the video operations center (VOC), whereby control comprises one of video source angle, video source focal point, video source contrast, and zoom.

17. The system of claim 12 , further comprising:

computer usable program code configured to dynamically adjust video coverage during the incident in real-time based upon results of pattern detection to ensure a maximization of video related to the incident is captured and available to at least one of the emergency response system and the video operations center (VOC), wherein the pattern detection from the video analysis in conjunction with an ability to control video captured by remotely located video sources proximate to the geographic location ensures that important entities, which are identified based upon the video analysis, and that are involved in the incident are tracked by video routed to at least one of the emergency response system and the video operations center (VOC).

Assignments (20)
SECURITY INTEREST Recorded Sep 19, 2022
From: GENERAC POWER SYSTEMS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061476/0745 →
AMALGAMATION Recorded Jul 25, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 060907/0090 →
CONTINUED - CHANGE OF JURISDICTION Recorded Apr 26, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 059805/0101 →
CHANGE OF NAME Recorded Apr 26, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 059825/0668 →
AMALGAMATION Recorded Apr 26, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 059825/0888 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 059713/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 059713/0799 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058568 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 8, 2022
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE INC.
Reel/Frame 058965/0106 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058521 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 7, 2022
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE INC.
Reel/Frame 059205/0822 →
CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 058907/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 058917/0069 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 058917/0161 →
MERGER AND CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 061001/0949 →
CHANGE OF NAME Recorded Jan 31, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 058905/0211 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE, INC.
Reel/Frame 058568/0001 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE, INC.
Reel/Frame 058521/0001 →
SECURITY INTEREST Recorded May 19, 2020
From: ECOBEE INC.
To: AST TRUST COMPANY (CANADA)
Reel/Frame 052704/0656 →
SECURITY INTEREST Recorded May 15, 2020
From: INC., ECOBEE
To: STRUCTURED ALPHA LP
Reel/Frame 052678/0864 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: ECOBEE INC.
Reel/Frame 048573/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2009
From: FLORES, ROMELIA H.; GIVENS, CHARLET N.; KWAN, HUNG T.; MATHAI, SHIJU
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 022383/0584 →