IP Library Granted Patent US 10,958,868
Granted Patent B2
US 10,958,868 · App. 16/677,545 · Granted Mar 23, 2021

Portable recording device multimedia classification system

Inventors: Thomas Guzik (Edina, MN); Muhammad Adeel (Edina, MN)
Assignees: GETAC TECHNOLOGY CORPORATION; WHP WORKFLOW SOLUTIONS, INC.
H04N5/91H04L63/30H04N5/38H04N5/77H04N5/772H04N7/18H04N7/185H04N9/8205H04W12/06G06Q50/26H04L63/0876H04N21/4367H04N21/43622
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,958,868
App. No.
16/677,545
Granted
Mar 23, 2021
Kind
B2
Abstract

This disclosure describes an apparatus and system for classifying audio and video data captured by a portable recording device. The portable recording device may comprise a camera system enclosure that captures audio and video data that reflects a user's point-of-view perception of their surroundings. The video and/or audio data may be transmitted in real-time, or near real-time, to a Central Multimedia Management (CMM) System at a Network Operations Center, or one or more mobile computing devices, via one or more networks. Alternatively, or additionally, the video and/or audio data may be stored within memory of the portable recording device. This disclosure further describes a CMM system that may act as a central repository of multimedia data from one or more portable recording device(s). The CMM system may further generate and assign incident report forms for each individual instance of real-time data that is recorded by a portable recording device.

Claims (76)

1. A system, comprising:

a low-energy transceiver;

a high-energy transceiver;

one or more processors;

memory coupled to the one or more processors, the memory including one or more modules that are executable by the one or more processors to:

receive, via a low-energy communication connection, authentication data associated with a portable recording device;

establish, a high-energy communication connection with the portable recording device, based at least in part on authenticating the authentication data;

retrieve, via from the portable recording device, at least one multimedia data packet via the high-energy communication connection, the at least one multimedia data packet including at least a stream of real-time data and a category identifier associated with the stream of real-time data; and

generate an incident report form that corresponds to the stream of real-time data, the incident report form including at least the category identifier, and a selectable option to access a recording of the stream of real-time data.

2. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

detect a heartbeat signal that is broadcast by the portable recording device; and

transmit an acknowledgment message to the portable recording device in response to the heartbeat signal, and

wherein, to receive the authentication data via the low-energy communication connection is based at least in part on transmission of the acknowledgment message.

3. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

transmit a secure connection setting data packet to the portable recording device that includes an access point identifier, a security encryption scheme type, and an access point password, and

wherein to establish the high-energy communication connection is based at least in part on the secure connection setting data packet, the high-energy communication connection to be initiated by the portable recording device.

4. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

determine that a secure connection setting data packet has been sent to the portable recording device, the secure connection setting data packet including computer-executable instructions that automatically associate establishing a secure connection with a connectivity wake-up button of the portable recording device; and

transmit a signal to the portable recording device to activate the connectivity wake-up button, wherein to activate the connectivity wake-up button causes the portable recording device to establish the high-energy communication connection.

5. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

establish the low-energy communication connection between a Radio Frequency Identification (RFID) tag associated with the portable recording device and an RFID reader, based at least in part on the portable recording device being within a predetermined distance of the RFID reader.

6. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

analyze the multimedia data packet to extract metadata;

determine that the metadata includes one or more milestone indicators that correspond points in time during the stream of real-time data that have been identified by an operator of the portable recording device; and

generate one or more segmented portions of the stream of real-time data that correlate with the one or more milestone indicators, and

wherein to generate the incident report form further includes incorporating the one or more segmented portions of the stream of real-time data.

7. The system of claim 6 , wherein the one or more modules are further executable by the one or more processors to:

generate individual links to individual ones of the one or more segmented portions of the stream of real-time data; and

merge the individual links to the incident report form.

8. The system of claim 1 , wherein the one or more modules are further executable by the one or more processors to:

retrieve a plurality of multimedia data packets from the portable recording device; and

generate a plurality of incident report forms, based at least in part on the plurality of multimedia data packets, wherein an individual incident report form of the plurality of incident report forms corresponds to an individual multimedia data packet of the plurality of multimedia data packets.

9. The system of claim 1 , wherein the multimedia data packet further includes an assignment identifier that corresponds to a particular user authorized to operate the portable recording device, and wherein the one or more modules are further executable by the one or more processors to:

determine that the portable recording device is assigned to the particular user, based at least in part on the assignment identifier; and

provide, a computing device associated with the particular user, access to a read-writable version of the incident report form.

10. The system of claim 1 , wherein the at least one multimedia data packet further includes a milestone indicator and a timestamp associated with the milestone indicator, the timestamp corresponding to a point in time within the stream of real-time data, and

wherein generating the incident report form further includes generating a portion of the incident report form that selectively enables a particular user to include an audio annotation or a text annotation, the portion of the incident report form further including the selectable option to access the stream of real-time data at the point in time that corresponds to the timestamp.

11. The system of claim 1 , wherein the authentication data includes at least one of a device identifier, an electronic serial number, a globally unique identifier, or an integrated circuit card identifier.

12. A computer-implemented method, comprising:

under control of one or more processors:

establishing a low-energy communication connection with a portable recording device;

receiving, via the low-energy communication connection, authentication data associated with the portable recording device;

in response to verifying the authentication data, transmitting a signal to the portable recording device to activate a connectivity wake-up button that causes the portable recording device to establish a high-energy communication connection;

retrieving, the high-energy communication connection, a plurality of multimedia data packets; and

generating, individual incident report forms for individual ones of the plurality of multimedia data packets.

13. The computer-implemented method of claim 12 , further comprising:

transmitting a secure connection setting data packet to the portable recording device, and

wherein, the high-energy communication connection is established by the portable recording device based at least in part on the secure connection setting data packet.

14. The computer-implemented method of claim 12 , further comprising:

analyzing a particular multimedia data packet of the plurality of multimedia data packets, the particular multimedia data packet including a stream of real-time data and a category identifier associated with the stream of real-time data;

extracting, from the particular multimedia data packet, metadata associated with the stream of real-time data;

identifying milestone indicators that correspond to point in time during the stream of real-time data that have been identified by an operator of the portable recording device;

generating, one or more segmented portions of the stream of real-time data based at least in part on the milestone indicators; and

merging individual links to the one or more segmented portions of the stream of real-time data into a corresponding incident report form of the individual incident report forms.

15. The computer-implemented method of claim 12 , further comprising:

analyzing a particular multimedia data packet of the plurality of multimedia data packets to identify an assignment identifier that corresponds to a particular user authorized to operate the portable recording device; and

providing, a computing device associated with the particular user, access to a read-writable version of a corresponding incident report form of the individual incident report forms that is associated with the particular multimedia data packet.

16. The computer-implemented method of claim 12 , further comprising:

analyzing a particular multimedia data packet of the plurality of multimedia data packets to identify a timestamp associated with a corresponding stream of real-time data;

analyzing an assignment table to identify a particular user that was assigned the portable recording device during a time interval that is inclusive of the timestamp; and

providing, a computing device associated with the particular user, access to a read-writable version of a corresponding incident report form of the individual incident report forms that is associated with the particular multimedia data packet.

17. One or more non-transitory computer-readable media of storing computer-executable instructions that when executed on one or more processors, cause the one or more processors to perform acts comprising:

detecting a heartbeat signal that is broadcast by a portable recording device;

establishing a high-energy communication connection with the portable recording device, based at least in part on the heartbeat signal;

retrieving, via the high-energy communication connection, a multimedia data packet that includes a stream of real-time data and corresponding metadata;

generating an incident report form that corresponds to the stream of real-time data;

identifying a particular user that was assigned the portable recording device at a point in time that the stream of real-time data was captured; and

providing, a computing device associated with the particular user, access to a read-writable version of the incident report form.

18. The one or more non-transitory computer-readable media of claim 17 , further comprising:

in response to detecting the heartbeat signal, transmitting an acknowledgment message to the portable recording device;

receiving, via a low-energy communication connection, authentication data associated with the portable recording device; and

in response to verifying the authentication data, transmitting a secure connection setting data packet to the portable recording device, and

wherein, establishing the high-energy communication connection is based at least in part on the secure connection setting data packet, the high-energy communication connection to be initiated by the portable recording device.

19. The one or more non-transitory computer-readable media of claim 17 , wherein the corresponding metadata includes an assignment identifier that is associated with the particular user that is assigned to use the portable recording device, and

wherein, identifying the particular user that was assigned the portable recording device is based at least in part on the assignment identifier.

20. The one or more non-transitory computer-readable media of claim 17 , wherein the corresponding metadata includes at least one of a category classification of the stream of real-time data, a sub-category classification of the stream of real-time data, an assignment identifier, and one or more milestone indicators that correspond to points in time that have been identified during the stream of real-time data that an operator of the portable recording device.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY/ ASSIGNEE FROM GETAC TECHNOLOGY CORPORATION TO BOTH WHP WORKFLOW SOLUTIONS, INC. & GETAC TECHNOLOGY CORPORATION PREVIOUSLY RECORDED ON REEL 051705 FRAME 0960. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AGREEMENT. Recorded May 27, 2020
From: WHP WORKFLOW SOLUTIONS, INC.
To: GETAC TECHNOLOGY CORPORATION; WHP WORKFLOW SOLUTIONS, INC.
Reel/Frame 053780/0265 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S ENTITY DESIGNATION FROM LLC TO INC. PREVIOUSLY RECORDED ON REEL 051705 FRAME 0935. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST. Recorded Mar 2, 2020
From: GUZIK, THOMAS; ADEEL, MUHAMMAD
To: WHP WORKFLOW SOLUTIONS, INC.
Reel/Frame 052143/0907 →
ENTITY CONVERSION Recorded Feb 17, 2020
From: WHP WORKFLOW SOLUTIONS, LLC
To: WHP WORKFLOW SOLUTIONS, INC.
Reel/Frame 051982/0707 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2020
From: GUZIK, THOMAS; ADEEL, MUHAMMAD
To: WHP WORKFLOW SOLUTIONS, LLC
Reel/Frame 051705/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2020
From: WHP WORKFLOW SOLUTIONS, INC.
To: GETAC TECHNOLOGY CORPORATION
Reel/Frame 051705/0960 →
Continuity (3)
Division 15686142 · Aug 24, 2017
Provisional Application 62379212 · Aug 24, 2016
Related Publication 20200077044A1 · Mar 5, 2020
Cited By (1)
US 12,238,347