Security surveillance via three-dimensional audio space presentation
Embodiments are directed to using a three-dimensional sound space to analyze security surveillance information. According to one embodiment, the three-dimensional sound space can comprise part of a security surveillance system in which sound sources related to security surveillance information can be presented and a user can efficiently navigate even a large number of sound sources in the three-dimensional sound space. Effective audio surveillance relies on the ability of the surveillance personnel to efficiently identify calls that need further analysis and calls that need no further analysis without introducing too many false negative or false positive conditions. Utilization of three-dimensional space described herein can increase the ease with which security analysts review audio content and identify relevant audio content that requires further analysis.
1. A method comprising:
collecting, by a processor, security surveillance information from one or more data sources, the security surveillance information comprising at least in part audio data from at least one of the one or more data sources;
processing, by the processor, the collected security surveillance information into a plurality of sound sources based on one or more attributes of the security surveillance information;
presenting, by the processor, the plurality of sound sources in a three-dimensional sound space having the plurality of sound sources playing at a same time, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location;
receiving, by the processor, an input from the user to navigate the user to a new location in the three-dimensional sound space; and
based on the input, changing, by the processor, the current location of the user in the three-dimensional sound space relative to each respective location of the plurality of sound sources in the three-dimensional sound space.
2. The method of claim 1 , wherein the security surveillance information further comprises non-audio data from at least one or the one or more data sources and wherein processing the collected security surveillance information into a plurality of sound sources further comprises converting the non-audio data to audio data.
3. The method of claim 1 , wherein processing the collected security surveillance information into a plurality of sound sources further comprises selecting sound sources from at least a portion of the security surveillance information based on the one or more attributes of the security surveillance information.
4. The method of claim 3 , wherein processing the collected security surveillance information into a plurality of sound sources further comprises grouping the selected sound sources based on the one or more attributes of the security surveillance information.
5. The method of claim 4 , wherein processing the collected security surveillance information into a plurality of sound sources further comprises assigning the grouped sound sources to the respective location in the three-dimensional sound space relative to one another based on the one or more attributes of the security surveillance information.
6. The method of claim 1 , wherein the attributes comprise information related to one or more of a keyword in the security surveillance information, a phrase in the security surveillance information, a sentiment expressed in in the security surveillance information, a context of a conversation in the security surveillance information, a location from which the security surveillance information was obtained, or a time at which the security surveillance information was obtained.
7. The method of claim 1 , wherein the attributes comprise information related to one or more of identity of speakers in the security surveillance information, identity of a dominant speaker in the security surveillance information, an amount of turn taking occurring in a conversation in the security surveillance information, timing of a conversation in the security surveillance information, location of parties to a conversation in the security surveillance information, or recent or current events.
8. The method of claim 2 , wherein the non-audio data comprises the attributes of the security surveillance information.
9. The method of claim 8 , wherein presenting the plurality of sound sources in a three-dimensional sound space comprises presenting the converted attributes for the sound source or a group of sound sources.
10. A system comprising:
a processor; and
a memory coupled with the processor and storing a set of instructions which, when executed by the processor, causes the processor to:
collect security surveillance information from one or more data sources, the security surveillance information comprising at least in part audio data from at least one of the one or more data sources,
process the collected security surveillance information into a plurality of sound sources based on one or more attributes of the security surveillance information,
present the plurality of sound sources in a three-dimensional sound space having the plurality of sound sources playing at a same time, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location,
receive an input from the user to navigate the user to a new location in the three-dimensional sound space, and
based on the input, change the current location of the user in the three-dimensional sound space relative to each respective location of the plurality of sound sources in the three-dimensional sound space.
11. The system of claim 10 , wherein the security surveillance information further comprises non-audio data from at least one or the one or more data sources and wherein processing the collected security surveillance information into a plurality of sound sources further comprises converting the non-audio data to audio data.
12. The system of claim 10 , wherein processing the collected security surveillance information into a plurality of sound sources further comprises:
selecting sound sources from at least a portion of the security surveillance information based on the one or more attributes of the security surveillance information;
grouping the selected sound sources based on the one or more attributes of the security surveillance information; and
assigning the grouped sound sources to the respective location in the three-dimensional sound space relative to one another based on the one or more attributes of the security surveillance information.
13. The system of claim 10 , wherein the attributes comprise information related to one or more of a keyword in the security surveillance information, a phrase in the security surveillance information, a sentiment expressed in in the security surveillance information, a context of a conversation in the security surveillance information, a location from which the security surveillance information was obtained, a time at which the security surveillance information was obtained, identity of speakers in the security surveillance information, identity of a dominant speaker in the security surveillance information, an amount of turn taking occurring in a conversation in the security surveillance information, timing of a conversation in the security surveillance information, location of parties to a conversation in the security surveillance information, or recent or current events.
14. The system of claim 11 , wherein the non-audio data comprises the attributes of the security surveillance information and wherein presenting the plurality of sound sources in a three-dimensional sound space comprises presenting the converted attributes for the sound source or a group of sound sources.
15. The system of claim 11 , wherein the non-audio data comprises the attributes of the security surveillance information and wherein presenting the plurality of sound sources in a three-dimensional sound space comprises presenting the converted attributes for the sound source or a group of sound sources.
16. A non-transitory computer-readable medium comprising a set of instruction stored therein which, when executed by a processor, causes the processor to:
collect security surveillance information from one or more data sources, the security surveillance information comprising at least in part audio data from at least one of the one or more data sources;
process the collected security surveillance information into a plurality of sound sources based on one or more attributes of the security surveillance information;
present the plurality of sound sources in a three-dimensional sound space having the plurality of sound sources playing at a same time, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location;
receiving an input from the user to navigate to a new location in the three-dimensional sound space; and
based on the input, changing the current location of the user in the three-dimensional sound space relative to each respective location of the plurality of sound sources in the three-dimensional sound space.
17. The non-transitory computer-readable medium of claim 16 , wherein the security surveillance information further comprises non-audio data from at least one or the one or more data sources and wherein processing the collected security surveillance information into a plurality of sound sources further comprises converting the non-audio data to audio data.
18. The non-transitory computer-readable medium of claim 16 , wherein processing the collected security surveillance information into a plurality of sound sources further comprises:
selecting sound sources from at least a portion of the security surveillance information based on the one or more attributes of the security surveillance information;
grouping the selected sound sources based on the one or more attributes of the security surveillance information; and
assigning the grouped sound sources to the respective location in the three-dimensional sound space relative to one another based on the one or more attributes of the security surveillance information.