Systems and methods for implementing cross-fading, interstitials and other effects downstream
Systems and methods are presented for cross-fading (or other multiple clip processing) of information streams on a user or client device, such as a telephone, tablet, computer or MP3 player, or any consumer device with audio playback. Multiple clip processing can be accomplished at a client end according to directions sent from a service provider that specify a combination of (i) the clips involved; (ii) the device on which the cross-fade or other processing is to occur and its parameters; and (iii) the service provider system. For example, a consumer device with only one decoder, can utilize that decoder (typically hardware) to decompress one or more elements that are involved in a cross-fade at faster than real time, thus pre-fetching the next element(s) to be played in the cross-fade at the end of the currently being played element. The next elements(s) can, for example, be stored in an input buffer, then decoded and stored in a decoded sample buffer, all prior to the required presentation time of the multiple element effect. At the requisite time, a client device component can access the respective samples of the decoded audio clips as it performs the cross-fade, mix or other effect. Such exemplary embodiments use a single decoder and thus do not require synchronized simultaneous decodes.
1. A system for audio playback, the system comprising:
an input buffer;
a decoder connected to the input buffer;
a decoded audio buffer connected to the decoder;
a playout controller; and
a device performance agent,
wherein the decoder decodes audio clips stored at the input buffer;
wherein the decoded audio buffer configures to store the decoded audio clips;
wherein the playout controller downloads audio clips to be stored by the input buffer, and plays back the decoded audio clips stored in the decoded audio buffer with at least one fade or transition effect at a boundary between successive audio clips; and
wherein the device performance agent determines network conditions and performance of hardware of the audio playback device, and adjusts timing of audio clip downloads utilizing the playout controller based on the determined network conditions and hardware performance.
2. The system of claim 1 , wherein the device performance agent causes the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a device profile.
3. The system of claim 2 , wherein the device profile includes information regarding a number of decoders included in the audio playback system.
4. The system of claim 2 , wherein the device profile includes information regarding a time required for the decoder to decode an audio frame.
5. The system of claim 1 , wherein the device performance agent causes the playout controller to playback the decoded audio clips with the at least one fade or transition effect based on a user profile.
6. The system of claim 1 , wherein the device performance agent causes the playout controller to playback the decoded audio clips with the at least one fade or transition effect based on a genre profile.
7. The system of claim 1 , wherein the device performance agent adjusts the timing of audio clip downloads by the playout controller based on a bandwidth restriction.
8. The system of claim 1 , wherein the device performance agent adjusts the timing of audio clip downloads by the playout controller based on a latency condition.