Systems and methods for composition of audio content from multi-object audio
Embodiments are related to processing of one or more input audio feeds for generation of a target audio stream that includes at least one object of interest to a listener. In some embodiments, the target audio stream may exclusively or primarily include the sound of the object of interest to the listener, without including other persons. This allows a listener to focus on an object of his or her interest and not necessarily have to listen to the performances of other objects in the input audio feed. Some embodiments contemplate multiple audio feeds and/or with multiple objects of interest.
1. A method for composition of audio content comprising:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed;
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.
2. The method of claim 1 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.
3. The method of claim 1 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.
4. The method of claim 1 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.
5. The method of claim 1 , wherein the user selects the object of interest from the timeline.
6. A non-transitory computer-readable storage medium storing instructions configured for composition of audio content to perform a method comprising:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed;
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.
7. The computer-readable storage medium of claim 6 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.
8. The computer-readable storage medium of claim 6 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.
9. The computer-readable storage medium of claim 6 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.
10. The computer-readable storage medium of claim 6 , wherein the user selects the object of interest from the timeline.
11. An apparatus for composition of audio content comprising:
a memory;
one or more processors electronically coupled to the memory and configured for:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed; and
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.
12. The apparatus of claim 11 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.
13. The apparatus of claim 11 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.
14. The apparatus of claim 11 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.
15. The apparatus of claim 11 , wherein the user selects the object of interest from the timeline.