Stem separation systems and devices
A device is configurable to cause playback of an input audio signal and, after detecting user input directed to activating a stem separation mode: (i) cause cessation of playback of the input audio signal; and (ii) until a stop condition is satisfied, iteratively: (a) identify a set of one or more segments of the input audio signal; (b) process the set of one or more segments using a stem separation module to generate a set of stem-separated segments, the set of stem-separated segments comprising a plurality of audio stems corresponding to different audio sources represented in the set of one or more segments; and (c) cause playback of at least one audio stem from the plurality of audio stems.
1. A device, comprising:
one or more processing units; and
one or more computer-readable recording media that store instructions that are executable by the one or more processing units to configure the device to:
access an input audio signal;
identify a first set of one or more segments of the input audio signal;
process the first set of one or more segments of the input audio signal using a stem separation module to generate a first set of one or more stem-separated segments, the first set of one or more stem-separated segments comprising a first plurality of audio stems corresponding to different audio sources represented in the first set of one or more segments;
cause playback of at least one of the first plurality of audio stems;
during processing of the first set of one or more segments of the input audio signal using the stem separation module or during playback of the at least one of the first plurality of audio stems:
identify a second set of one or more segments of the input audio signal, wherein the first set of one or more segments and the second set of one or more segments of the input audio signal are temporally adjacent or temporally overlapping; and
initiate processing of the second set of one or more segments of the input audio signal using the stem separation module to generate a second set of one or more stem-separated segments, the second set of one or more stem-separated segments comprising a second plurality of audio stems corresponding to different audio sources represented in the second set of one or more segments; and
after playback of the at least one of the first plurality of audio stems, cause playback of at least one of the second plurality of audio stems.
2. The device of claim 1 , wherein the input audio signal comprises a digital audio signal associated with a digital audio file or a digital audio transmission.
3. The device of claim 1 , wherein the input audio signal comprises a digital audio signal generated based on an input analog audio signal associated with an analog audio transmission.
4. The device of claim 1 , wherein playback of the at least one of the first plurality of audio stems comprises refraining from playing one or more remaining audio stems of the first plurality of audio stems.
5. The device of claim 1 , wherein causing playback of the at least one of the first plurality of audio stems comprises transmitting a stem-separated audio signal corresponding to the at least one of the first plurality of audio stems to one or more playback devices.
6. The device of claim 1 , wherein the device comprises one or more speakers, and wherein causing playback of the at least one of the first plurality of audio stems comprises causing the one or more speakers to play a stem-separated audio signal corresponding to the at least one of the first plurality of audio stems.
7. The device of claim 1 , wherein the at least one of the second plurality of audio stems comprises the same audio source(s) as the at least one of the first plurality of audio stems.
8. The device of claim 1 , wherein the input audio signal is associated with an input video signal.
9. The device of claim 8 , wherein the instructions are executable by the one or more processing units to configure the device to:
cause delayed playback of the input video signal such that playback of the input video signal is temporally synchronized with playback of the at least one of the first plurality of audio stems and with playback of the at least one of the second plurality of audio stems.
10. A device, comprising:
one or more processing units; and
one or more computer-readable recording media that store instructions that are executable by the one or more processing units to configure the device to:
cause playback of an input audio signal; and
after detecting user input directed to activating a stem separation mode:
cause cessation of playback of the input audio signal; and
until a stop condition is satisfied, iteratively:
identify a set of one or more segments of the input audio signal;
process the set of one or more segments using a stem separation module to generate a set of stem-separated segments, the set of stem-separated segments comprising a plurality of audio stems corresponding to different audio sources represented in the set of one or more segments; and
cause playback of at least one audio stem from the plurality of audio stems.
11. The device of claim 10 , wherein the input audio signal comprises a digital audio signal associated with a digital audio file or a digital audio transmission.
12. The device of claim 10 , wherein the input audio signal comprises a digital audio signal generated based on an input analog audio signal associated with an analog audio transmission.
13. The device of claim 10 , wherein the stop condition comprises performance of a predetermined number of iterations.
14. The device of claim 10 , wherein the stop condition comprises detecting user input directed to deactivating the stem separation mode.
15. The device of claim 10 , wherein the instructions are executable by the one or more processing units to configure the device to:
after the stop condition is satisfied, cause playback of the input audio signal.
16. The device of claim 10 , wherein playback of the at least one audio stem from the plurality of audio stems comprises refraining from playing one or more remaining audio stems of the plurality of audio stems.
17. The device of claim 10 , wherein the instructions are executable by the one more processing units to configure the device to (i) identify the set of one or more segments of the input audio signal or (ii) process the set of one or more segments using the stem separation module to generate the set of stem-separated segments during (a) processing of a preceding set of one or more segments of the input audio signal using the stem separation module to generate a preceding set of stem-separated segments comprising a plurality of preceding audio stems corresponding to different audio sources represented in the preceding set of one or more segments or (b) playback of at least one preceding audio stem from the plurality of preceding audio stems.
18. The device of claim 17 , wherein the preceding set of one or more segments is identified after detecting user input directed to activating the stem separation mode in a previous iteration.
19. The device of claim 10 , wherein the stem separation module is selected based on (i) user input selecting the stem separation module or (ii) pre-processing of the input audio signal to select the stem separation module.
20. A method, comprising:
accessing an input audio signal;
identifying a first set of one or more segments of the input audio signal;
processing the first set of one or more segments of the input audio signal using a stem separation module to generate a first set of one or more stem-separated segments, the first set of one or more stem-separated segments comprising a first plurality of audio stems corresponding to different audio sources represented in the first set of one or more segments;
causing playback of at least one of the first plurality of audio stems;
during processing of the first set of one or more segments of the input audio signal using the stem separation module or during playback of the at least one of the first plurality of audio stems:
identifying a second set of one or more segments of the input audio signal, wherein the first set of one or more segments and the second set of one or more segments of the input audio signal are temporally adjacent or temporally overlapping; and
initiating processing of the second set of one or more segments of the input audio signal using the stem separation module to generate a second set of one or more stem-separated segments, the second set of one or more stem-separated segments comprising a second plurality of audio stems corresponding to different audio sources represented in the second set of one or more segments; and
after playback of the at least one of the first plurality of audio stems, causing playback of at least one of the second plurality of audio stems.