IP Library Granted Patent US 12,610,009
Granted Patent B2
US 12,610,009 · App. 18/236,175 · Granted Apr 21, 2026

Method/system to identify, extract, and convey key words, phrases, and meanings in service of emergency communications (e.g., voice, text, and video)

Inventors: Adan K. Pope (Riverside, IL); Michel Brkovic (St-Eustache, CA)
Assignee: Intrado Life & Safety, Inc.
H04M3/42348G06V10/40G06V10/95G06V20/52G06V20/70G10L15/1815G10L15/22G10L15/30H04M3/5116H04N7/183H04N7/188H04N23/61H04W64/006G10L2015/088H04M2201/40H04M2201/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,610,009
App. No.
18/236,175
Granted
Apr 21, 2026
Kind
B2
Abstract

A method includes receiving visual content of a physical location, the visual content identified by a content timestamp, the physical location identified by a spatial identifier; receiving audio content of a call; performing voice recognition on the call to extract a first audio symbol; receiving a first timestamp of the call, the first timestamp indicating a time at which the call was initiated or a time extracted from the call by voice recognition; and determining a feature in the visual content, at least in part based on the first audio symbol, the feature defined by a person, object, or situation.

Claims (47)

1 . A method, comprising:

receiving visual content of a physical location, the visual content identified by a content timestamp, the physical location identified by a spatial identifier;

receiving audio content of a call;

performing voice recognition on the call to extract a first audio symbol;

receiving a first timestamp of the call, the first timestamp indicating a time at which the call was initiated or a time extracted from the call by voice recognition; and

determining a feature in the visual content, at least in part based on the first audio symbol, the feature defined by a person, object, or situation.

2 . The method of claim 1 , further comprising:

receiving a location of the call, the location being a GPS location of a device that initiated the call or a location identified in the call by voice recognition.

3 . The method of claim 2 , further comprising:

identifying the visual content, based on the location of the call, the GPS location of the visual content, the content timestamp, and the first timestamp of the call.

4 . The method of claim 1 , further comprising:

determining a relationship between the first audio symbol and a second audio symbol, the second audio symbol extracted from the call by voice recognition.

5 . The method of claim 1 , further comprising:

annotating the visual content with an identifier of the feature to produce an annotation; and

transmitting the visual content and the annotation to an emergency system.

6 . The method of claim 1 , further comprising:

receiving the spatial identifier, the spatial identifier including GPS coordinates of the physical location.

7 . The method of claim 1 , further comprising:

receiving a second timestamp of the call, the second timestamp identifying the other of the time at which the call was initiated or the time extracted from the call.

8 . An apparatus, comprising:

a network interface that receives visual content of a physical location and audio content of a call, the visual content identified by a content timestamp, the physical location identified by a spatial identifier; and

a processor configured to perform voice recognition on the call to extract a first audio symbol, wherein

a first timestamp of the call is received, the first timestamp indicating a time at which the call was initiated or a time extracted from the call by voice recognition, and

the processor further is configured to determine a feature in the visual content, at least in part based on the first audio symbol, the feature defined by a person, object, or situation.

9 . The apparatus of claim 8 , wherein the network interface receives a location of the call, the location being a GPS location of a device that initiated the call or a location identified in the call by voice recognition.

10 . The apparatus of claim 9 , wherein the processor further is configured to identify the visual content, based on the location of the call, the GPS location of the visual content, the content timestamp, and the first timestamp of the call.

11 . The apparatus of claim 8 , wherein the processor further is configured to determine a relationship between the first audio symbol and a second audio symbol, the second audio symbol extracted from the call by voice recognition.

12 . The apparatus of claim 8 , wherein the processor further is configured to annotate the visual content with an identifier of the feature to produce an annotation, and the network interface transmits the visual content and the annotation to an emergency system.

13 . The apparatus of claim 8 , wherein the network interface receives the spatial identifier, the spatial identifier including GPS coordinates of the physical location.

14 . The apparatus of claim 8 , wherein the network interface receives a second timestamp of the call, the second timestamp identifying the other of the time at which the call was initiated or the time extracted from the call.

15 . A non-transitory computer-readable medium including instructions that, when executed by a processor, perform operations comprising:

receiving visual content of a physical location, the visual content identified by a content timestamp, the physical location identified by a spatial identifier;

receiving audio content of a call;

performing voice recognition on the call to extract a first audio symbol;

receiving a first timestamp of the call, the first timestamp indicating a time at which the call was initiated or a time extracted from the call by voice recognition; and

determining a feature in the visual content, at least in part based on the first audio symbol, the feature defined by a person, object, or situation.

16 . The medium of claim 15 , the operations further comprising:

receiving a location of the call, the location being a GPS location of a device that initiated the call or a location identified in the call by voice recognition.

17 . The medium of claim 16 , the operations further comprising:

identifying the visual content, based on the location of the call, the GPS location of the visual content, the content timestamp, and the first timestamp of the call.

18 . The medium of claim 15 , the operations further comprising:

determining a relationship between the first audio symbol and a second audio symbol, the second audio symbol extracted from the call by voice recognition.

19 . The medium of claim 15 , the operations further comprising:

annotating the visual content with an identifier of the feature to produce an annotation; and

transmitting the visual content and the annotation to an emergency system.

20 . The medium of claim 15 , the operations further comprising:

receiving the spatial identifier, the spatial identifier including GPS coordinates of the physical location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: POPE, ADAN K.; BRKOVIC, MICHEL
To: INTRADO LIFE & SAFETY, INC.
Reel/Frame 067156/0350 →
SECURITY INTEREST Recorded Oct 24, 2023
From: INTRADO LIFE & SAFETY, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 065322/0333 →
Continuity (1)
Related Publication 20250071203A1 · Feb 27, 2025
References Cited (10)
US 9094615B2 · Aman et al. · 2015 [cited by applicant]
US 10127908B1 · Deller · 2018 [cited by examiner]
US 10170114B2 · Printz · 2019 [cited by applicant]
US 11922930B1 · Leeds et al. · 2024 [cited by applicant]
US 20110117878A1 · Barash · 2011 [cited by examiner]
US 20140337733A1 · Rodriguez · 2014 [cited by examiner]
US 20200175961A1 · Thomson · 2020 [cited by examiner]
US 20220028390A1 · Poznanski · 2022 [cited by examiner]
US 20240070251A1 · Maizels et al. · 2024 [cited by applicant]
Non-Final Office Action in U.S. Appl. No. 18/236,284 dated Feb. 12, 2025, 15 pages. [cited by applicant]