Contextualized augmented reality display system
Systems and methods for an emergency response system (ERS) to provide an augmented reality overlay on a real-world scene through the heads-up display (HUD) of an emergency responder. In addition to displaying information known to the ERS, an emergency responder terminal of the ERS can detect propagated signals from devices not registered with the ERS. The source and location of the propagated signal can be determined, and a generic display object can be generated representing the location of the propagated signal. The generic display object can be displayed on the HUD when the location of the source of the propagated signal falls within the field of view of a camera component of the emergency responder terminal.
1 . A method, comprising:
detecting, by a detector circuit of an emergency response system, a propagated signal from a device;
determining, by a processor, a location of a source of the propagated signal;
comparing, by the processor, the location of the source of the propagated signal with one or more known real-time locations of registered non-responder terminals of the emergency response system;
generating, by the processor of the emergency response system and in response to a determination that the device is not a registered non-responder terminal of the emergency response system, a generic display object representing the source of the propagated signal, wherein the determination that the device is not a registered non-responder terminal of the emergency response system is based on a distance between the source of the propagated signal and at least one of the registered non-responder terminals exceeding a threshold;
capturing, by a camera component of the emergency response system, a live real-world scene;
displaying, on a display of an emergency responder terminal, the live real-world scene captured by the camera component; and
displaying, on the display when the source of the propagated signal falls within a field of view of the camera component, the generic display object representing the source of the propagated signal, wherein a size and position of the generic display object displayed on the display is based on its distance from and orientation relative to the location of the source and orientation of the emergency responder terminal, and wherein the generic display object comprises an icon overlaid onto the captured live real-world scene, wherein the icon is different from icons used to illustrate other landmarks.
2 . The method of claim 1 , wherein generating the generic display object comprises generating the generic display object such that the generic display object provides a color coded indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.
3 . The method of claim 2 , further comprising: providing, based on a selection of the generic display object, situational status information.
4 . The method of claim 1 , further comprising determining, by the processor, if the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.
5 . The method of claim 4 , further comprising ignoring the propagated signal when the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.
6 . The method of claim 1 , wherein determining the location of the source of the propagated signal is based on a signal strength of the propagated signal.
7 . The method of claim 1 , wherein determining the location of the source of the propagated signal comprises:
obtaining, from a plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and
analyzing, by the processor, the obtained signal strength values of the plurality of non-terminal identification components;
wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.
8 . The method of claim 1 , wherein the processor is one or more processors of the emergency responder terminal.
9 . The method of claim 1 , wherein the processor is one or more processors of an emergency response system entity.
10 . An emergency response system, comprising:
an emergency responder terminal;
a display communicatively coupled to the emergency responder terminal; and
a non-transitory machine readable medium storing machine readable instructions that, when executed by a processor, cause the emergency response system to:
detect, by a detector circuit of the emergency response system, a propagated signal from a device;
determine, by the processor, a location of a source of the propagated signal;
compare, by the processor, the location of the source of the propagated signal with one or more known real-time locations of registered non-responder terminals of the emergency response system;
generate, by the processor of the emergency response system and in response to a determination that the device is not a registered non-responder terminal of the emergency response system, a generic display object representing the source of the propagated signal, wherein the determination that the device is not a registered non-responder terminal of the emergency response system is based on a distance between the source of the propagated signal and at least one of the registered non-responder terminals exceeding a threshold;
capture, by a camera component of the emergency response system, a live real-world scene;
display, on the display of the emergency responder terminal, the live real-world scene captured by the camera component; and
display, on the display when the source of the propagated signal falls within a field of view of the camera component, the generic display object representing the source of the propagated signal, wherein a size and position of the generic display object displayed on the display is based on its distance from and orientation relative to the real-time location and orientation of the emergency responder terminal, and wherein the generic display object comprises an icon overlaid onto the captured live real-world scene, wherein the icon is different from icons used to illustrate other landmarks.
11 . The emergency response system of claim 10 , wherein the instruction to generate the generic display object further includes sub-instructions to generate the generic display object such that the generic display object provides a color-coded indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.
12 . The emergency response system of claim 11 , wherein the non-transitory machine readable medium further stores machine readable instructions that, when executed by a processor, cause the emergency response system to: provide, based on a selection of the generic display object, situational status information.
13 . The emergency response system of claim 10 , further comprising a plurality of non-terminal identification components, and the non-transitory machine readable medium storing machine readable instructions that, when executor by the processor, cause the emergency response system to further:
obtain, from the plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and
analyze, by the processor, the obtained signal strength values of the plurality of non-terminal identification components;
wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.
14 . The emergency response system of claim 10 , the non-transitory machine readable medium storing machine readable instructions that, when executor by the processor, cause the emergency response system to further:
determine, by the processor, if the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.
15 . The emergency response system of claim 10 , wherein the camera component is affixed to a piece of emergency responder equipment such that the field of view of the camera component changes as an emergency responder changes a field of view of the emergency responder, the camera component being communicatively coupled to the emergency responder terminal.
16 . A method, comprising:
determine, by one or more processors of an emergency response system, a location of a non-responder terminal within a structure;
compare, by the processor, the location of the non-responder terminal with one or more known real-time locations of registered non-responder terminals of the emergency response system;
generate, by the processor of the emergency response system and in response to a determination that a device corresponding to a source of a propagated signal is not a registered non-responder terminal of the emergency response system, a generic display object representing the source of the propagated signal, the determination that the device is not a registered non-responder terminal of the emergency response system being based on a distance between the source of the propagated signal and at least one of the registered non-responder terminals exceeding a threshold;
generate, by the one or more processors of the emergency response system and in response to a determination that the non-responder terminal is not a registered non-responder terminal of the emergency response system, a generic display object representing a source of a propagated signal, wherein the generic display object comprises an icon overlaid onto a captured live real-world image of the location, wherein the icon is different from icons used to illustrate other landmarks;
obtain, by one or more processors, sensor data from a plurality of non-terminal identification components within the structure;
identify, by the one or more processors, an environmental status within a vicinity of each of the plurality of non-terminal identification components;
determine, by the one or more processors, a safe route based on one or more identified environmental statuses, a safe route comprising a path for a user associated with the non-responder terminal to travel to safety; and
display, by the one or more processors, a safe route display object on a display of the non-responder terminal.