Distributed multisensor system to record spatially diverse events
A distributed multisensory system to record spatially diverse events configures a group of sensors searching sensed events utilizing random access search. The system utilizes presence and co-location detection to identify objects or people in an area. The system then processes audio signals utilizing a multimodal network and machine learning tiered with obfuscated text indexing to provide high-speed, high accuracy searching of stored data. In addition, the obfuscated text allows the system to not have to store an audio transcript, increasing the security of the system. The system utilizes beamforming to merge resultant audio streams for the recorded event.
1. A method of recording spatially diverse events comprising:
configuring a plurality of sensors to periodically influence an event processor with a plurality of raw event controls;
transforming the raw event controls into a composite control and configuring an event log with the composite control;
configuring the event log with a timestamp;
transforming the composite control into a recorded control in machine memory;
searching sensed events in machine memory comprising:
configuring detection logic to transform the recorded control into a region control;
configuring the event log with the region control to transmit an event to the detection logic;
configuring a time mask with a time to generate a weight;
configuring the detection logic with the weight to generate an event and tag combination; and
configuring a correlator with the event and tag combination to generate a probability and transmit the probability to the detection logic; and
merging audio streams comprising:
transmitting a child stream to a stream combiner;
transmitting a master stream to the stream combiner;
transforming the child stream and the master stream into a combined stream;
transforming the combined stream into aligned segments; and
transforming the aligned segments into a merged stream and transmitting the merged stream to a stream transmitter.
2. The method of claim 1 wherein the stream transmitter is a web site.
3. The method of claim 1 wherein a source of at least one of the child stream and the master stream is a mobile device app.
4. The method of claim 3 wherein the mobile device app requests to join a meeting from the stream transmitter.
5. The method of claim 1 , wherein the correlator utilizes random access audio search and obfuscated text indexing.
6. A computing apparatus, the apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to:
configure a plurality of sensors to periodically transmit a plurality of raw event controls to at least one event processor;
operate the event processor to transform the raw event signals into a composite control and configuring an event log with the composite control;
operate a timer to configure the event log with a timestamp and transform the composite control into a recorded control in the memory;
search sensed events in the memory comprising:
configure detection logic to transform the recorded control into a region control;
configure the event log with the region control to transmit an event to the detection logic;
operate the detection logic to configure a time mask with a time to generate a weight;
configure the detection logic with the weight to generate an event and tag combination; and
configure a correlator with the event and tag combination to generate a probability and transmit the probability to the detection logic; and
merge audio streams comprising:
operate a child stream device transmit a child stream to a stream combiner;
operate a master stream device to transmit a master stream to the stream combiner;
operate the stream combiner to receive the child stream and the master stream and to transform the child stream and the master stream into a combined stream;
operate a segmenter/aligner to receive the combined stream from the stream combiner and transform the combined stream into aligned segments; and
operate the stream combiner to receive the aligned segments from the segmenter/aligner, transform the aligned segments into a merged stream and transmit the merged stream to a stream transmitter.
7. The computing apparatus of claim 6 wherein the stream transmitter is a web site.
8. The computing apparatus of claim 6 wherein at least one of the master stream device and the child stream device is a mobile device app.
9. The computing apparatus of claim 8 wherein the mobile device app requests to join a meeting from the stream transmitter.
10. The computing apparatus of claim 6 , wherein the correlator utilizes random access audio search.