IP Library › Granted Patent US 11,032,515
Granted Patent B2
US 11,032,515 · App. 16/988,865 · Granted Jun 8, 2021

Biosensor-triggered collaboration

Inventors: Joseph R. Mazzarella (Tolland, CT); Michael S. Wengrovitz (Concord, MA)
Assignee: Mutualink, Inc.
H04N7/147H04L65/102H04L65/403H04L67/12H04N5/772H04N7/185H04N7/188H04W76/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,032,515
App. No.
16/988,865
Filed
Aug 10, 2020
Granted
Jun 8, 2021
Kind
B2
Art Unit
2651
USPC
348/14.03
Abstract

Embodiments include a computer program product for using a biosensor worn by a user to trigger an event and activate a camera worn by the user to begin streaming and/or recording video data. The biosensor trigger also initiates a real time multimedia collaboration session with the user wearing the biosensor and one or more designated parties. Through an interoperability gateway device, a voice communications device of the user is bridged with voice communications devices of the designated parties, and the video data is electronically transmitted to the designated parties. Thus, the designated parties may have real time voice communications among each other and with the user, and the designated parties may also view the video data in real time. Embodiments also determine when an event has ended and deactivates the camera worn by the user.

Claims (47)

1. A system, comprising:

a transceiver; and

one or more processors coupled to the transceiver, wherein the one or more processors are configured to:

transmit, via the transceiver, an activation message to a camera device worn by a user to begin recording and transmitting video data;

transmit, via the transceiver, an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;

receive, via the transceiver, a first biometric signal from a biosensor worn by the user; determine, using the first biometric signal, that an event has ceased; and transmit, via the transceiver, a deactivation message to the camera device.

2. The system of claim 1 , wherein the one or more processors are further configured to:

receive, via the transceiver, video data from the camera device; and

transmit, via the transceiver, the video data to the biosensor-triggered multimedia collaboration session.

3. The system of claim 1 , wherein the one or more processors are further configured to:

receive, via the transceiver, a second biometric signal from the biosensor;

based on the second biometric signal, determine that an event occurs; and

generate the event alert.

4. The system of claim 3 , wherein to determine that the event occurs, the one or more processors are configured to:

compare the second biometric signal with a trigger threshold; and

determine that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

5. The system of claim 4 , wherein the trigger threshold further comprises: a change in a value over time, a rate of change of the value over time, correlations with data from a different biosensor sensor, correlations with data from an environmental sensor, correlations with data from a GPS system, a health or a fitness condition of the user wearing the biosensor, a condition of other personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

6. The system of claim 3 , wherein the second biometric signal comprises: a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

7. The system of claim 1 , wherein the one or more processors are further configured to: electronically transmit an audio or visual message to the user wearing the biosensor based on: a second biometric signal, an environmental sensor signal, a third biometric signal from another biosensor, or a change in a trigger threshold.

8. The system of claim 1 , wherein the one or more processors are further configured to: receive an environmental condition signal from an environmental sensor in proximity to the biosensor comprising: an ambient temperature, a wind chill, a dew point, a radiation level, a chemical level, a biological agent, a sound, a pressure, a humidity level, a precipitation level, an air pollutant level, a lightning strike, a terrain, an altitude, a location, an air quality level, or a change in any of the above.

9. The system of claim 1 , wherein the one or more processors are further configured to: receive input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

10. The system of claim 1 , wherein the one or more processors are further configured to: based on the determination that the event has ceased, transmit, via the transceiver, an event-ended message to the IWS.

11. The system of claim 1 , wherein the transceiver is configured to perform interoperability gateway functions among protocols, comprising: 3G/4G LTE network protocols, IP, push to talk (PTT) communications, emergency voice channel, Bluetooth, WiFi, Zigbee, or other wireless protocol.

12. The system of claim 1 , wherein the voice communication device is configured to operate in Very High Frequency (VHF) or Ultra High Frequency (UHF) communications channels.

13. A method, comprising:

transmitting an activation message to a camera device worn by a user to begin recording and transmitting video data;

transmitting an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;

receiving a first biometric signal from a biosensor worn by the user;

determining, using the first biometric signal, that an event has ceased; and

transmitting a deactivation message to the camera device.

14. The method of claim 13 , further comprising:

receiving video data from the camera device; and

transmitting the video data to the biosensor-triggered multimedia collaboration session.

15. The method of claim 13 , further comprising:

receiving a second biometric signal from the biosensor;

based on the second biometric signal, determining that an event occurs; and

generating the event alert.

16. The method of claim 15 , wherein the determining that the event occurs further comprises:

comparing the second biometric signal with a trigger threshold; and

determining that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

17. The method of claim 15 , wherein the second biometric signal comprises: a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

18. The method of claim 13 , further comprising: electronically transmitting an audio or visual message to the user wearing the biosensor based on: a second biometric signal, an environmental sensor signal, a third biometric signal from another biosensor, or a change in a trigger threshold.

19. The method of claim 13 , further comprising: receiving input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

20. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform operations, the operations comprising:

transmitting an activation message to a camera device worn by a user to begin recording and transmitting video data;

transmitting an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;

receiving a first biometric signal from a biosensor worn by the user; determining, using the first biometric signal, that an event has ceased; and transmitting a deactivation message to the camera device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2020
From: MAZZARELLA, JOSEPH R.; WENGROVITZ, MICHAEL S.
To: MUTUALINK, INC.
Reel/Frame 053445/0485 →
Continuity (5)
Continuation 16557617 · Aug 30, 2019
Continuation 16049590 · Jul 30, 2018
Continuation 15242792 · Aug 22, 2016
Continuation 14642325 · Mar 9, 2015
Related Publication 20200374487A1 · Nov 26, 2020
Cited By (8)
US 12,299,557 US 12,392,583 US 12,567,282 US 12,602,971 US 12,635,744 US 12,700,296 US 12,722,816 US 12,726,795