Server side crossfading for progressive download media
In exemplary embodiments of the present invention systems and methods are provided to implement and facilitate cross-fading, interstitials and other effects/processing of two or more media elements in a personalized media delivery service so that each client or user has a consistent high quality experience. The effects or crossfade processing can occur on the broadcast, publisher or server-side, but can still be personalized to a specific user, thus still allowing a personalized experience for each individual user, in a manner where the processing burden is minimized on the downstream side or client device. This approach enables a consistent user experience, independent of client device capabilities, both static and dynamic. The cross-fade can be implemented after decoding the relevant chunks of each component clip, processing, recoding and rechunking, or, in a preferred embodiment, the cross-fade or other effect can be implemented on the relevant chunks to the effect in the compressed domain, thus obviating any loss of quality by re-encoding. A large scale personalized content delivery service can be implemented by limiting the processing to essentially the first and last chunks of any file, since there is no need to processing the full clip. In exemplary embodiments of the present invention this type of processing can easily be accommodated in cloud computing technology, where the first and last files may be conveniently extracted and processed within the cloud to meet the required load. Processing may also be done locally, for example, by the broadcaster, with sufficient processing power to manage peak load.
1. A system comprising:
at least one processor; and
memory containing instruction that, when executed, cause the at least one processor to:
identify a plurality of media clips to use in an effect;
determine, for each of the plurality of clips, multiple chunks to process for the effect;
receive the multiple chunks at a compressed crossfade module; and
combine compressed data from each of the multiple chunks to generate a revised chunk containing the compressed data;
wherein the revised chunk is equal in quality to the plurality of media clips.
2. The system of claim 1 , wherein the processing further includes creating a new index file for the revised chunk.
3. The system of claim 1 , wherein the determining is performed via an algorithm that assesses the number of chunks to process for the effect.
4. The system of claim 3 , wherein the algorithm inputs at least one of the following parameters: (I) intra and outro information of each of the plurality of clips, (ii) type of the effect, and (iii) audio trajectory of the effect.
5. A system for implementing server side crossfade or other transitional effect using chunked media, the system comprising:
at least one processor; and
memory containing instruction that, when executed, cause the at least one processor to:
identify a plurality of media clips to use in the effect;
determine, for each of the plurality of clips, beginning and end chunks to process for the effect and core chunks to be excluded from the effect;
process the beginning and end chunks of a first one of the plurality of clips in compressed format by time aligning and combining the beginning and end chunks of the first clip with one or more chunks of at least one other clip of the plurality of clips; and
transmit core chunks and the processed beginning and end chunks of the first clip to a plurality of client devices, each corresponding to a respective user, wherein the processing is personalized such that the beginning and end chunks of the first clip are processed differently for each respective user.
6. The system of claim 5 , wherein the processing further includes creating a new index file for the first clip.
7. The system of claim 5 , wherein the determining is performed via an algorithm that assesses the number of chunks to process for the effect.
8. The system of claim 7 , wherein the algorithm inputs at least one of the following parameters: (i) intra and outro information of each of the plurality of clip, (ii) type of the effect, and (iii) audio trajectory of the effect.
9. The system of claim 5 , wherein the processing is personalized such that the custom chunks of the first clip are processed differently for each respective user, and the core chunks of the first clip are provided to each respective user without additional modifications.
10. The system of claim 5 , wherein the processing further includes receiving data from the client device used to generate inferences from behavior of the respective user on the client device, wherein the processing is personalized based on the received data.