Content-adaptive digital content adjustment method and system
View Patent ↗Disclosed herein is a content-adaptive digital media content adjustment system, method and architecture. Playback rate of a media content item comprising audio and video content can be increased by removing a portion of the content item's audio content and a corresponding portion of the content item's video content. An increased playback rate of a multimedia content item is accomplished by decreasing the length of the multimedia content item by removing portions of the multimedia content item's audio and video content.
1. A method comprising:
increasing, by a computing device, a multimedia content item's playback rate, the increasing comprising:
identifying a time allocation score for each of a plurality of audio segments of audio content of the multimedia content item, the time allocation score for an audio segment being inversely related to its tempo, a silent audio segment being assigned a slower tempo than a non-silent audio segment;
selecting a number of audio segments using the time allocation score assigned to each audio segment of the plurality, the selecting comprising selecting each silent audio segment having a higher allocation score, determined based on its assigned slower tempo, than each non-silent audio segment;
determining, for each selected audio segment of the number, an adjusted length of the selected audio segment, the adjusted length being shorter than an original length of the selected audio segment;
modifying each selected audio segment of the number in accordance with the determined adjusted length of the audio segment; and
synchronizing, for each selected audio segment of the number, a video segment of the multimedia content item corresponding to the selected audio segment, the synchronized video segment having an adjusted length matching the adjusted length of the audio segment.
2. The method of claim 1 , synchronizing the video segment corresponding to the selected audio segment is performed separate from modification of the selected audio segment.
3. The method of claim 1 , modifying a selected audio segment in accordance with the determined adjusted length further comprising:
adjusting the length of the selected audio segment to the determined adjusted length of the selected audio segment by removing a portion of the audio content of the selected audio segment.
4. The method of claim 1 , synchronizing the video segment corresponding to the selected audio segment further comprising:
adjusting the length of the corresponding video segment by removing a portion of the corresponding video segment, such that, after synchronization, the adjusted length of the corresponding video segment matches the adjusted length of the selected audio segment.
5. The method of claim 1 , each selected audio segment of the number having a higher time allocation score than each unselected audio segment of the plurality of audio segments.
6. The method of claim 1 , each selected audio segment of the number having a higher time allocation score and a slower tempo than each unselected audio segment of the plurality of audio segments.
7. The method of claim 1 , time allocation identification further comprising:
determining the slower tempo for each silent audio segment based on the tempo of each non-silent audio segment.
8. The method of claim 7 , the tempo of a non-silent audio segment is determined based on its audio content.
9. The method of claim 1 , the slower tempo identified for each silent audio segment is a pre-defined default tempo.
10. The method of claim 1 , determination of the adjusted length of each audio segment of the selected number of audio segments is based on a desired playback rate.
11. The method of claim 1 , the increased playback rate is determined using a desired playback length.
12. The method of claim 11 , the desired playback length is expressed in temporal units.
13. The method of claim 1 , each silent audio segment is differentiated from any non-silent audio segment by a slower tempo and a higher time allocation score.
14. The method of claim 1 , removing a portion of the content of the selected audio segment in accordance with the determined adjusted length of the selected audio segment further comprising:
identifying a number of insignificant portions of the selected audio segment; and
removing each identified insignificant portion of the selected audio segment.
15. The method of claim 14 , an insignificant portion of the number comprising a word gap.
16. The method of claim 1 , determining the adjusted length of a selected audio segment using a tempo adjustment for the selected audio segment.
17. The method of claim 16 , the tempo adjustment is an increase in tempo for the selected audio segment.
18. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions that when executed by a processor associated with a computing device perform a method comprising:
increasing a multimedia content item's playback rate, the increasing comprising:
identifying a time allocation score for each of a plurality of audio segments of audio content of the multimedia content item, the time allocation score for an audio segment being inversely related to its tempo, a silent audio segment being assigned a slower tempo than a non-silent audio segment;
selecting a number of audio segments using the time allocation score assigned to each audio segment of the plurality, the selecting comprising selecting each silent audio segment having a higher allocation score, determined based on its assigned slower tempo, than each non-silent audio segment;
determining, for each selected audio segment of the number, an adjusted length of the selected audio segment, the adjusted length being shorter than an original length of the selected audio segment;
modifying each selected audio segment of the number in accordance with the determined adjusted length of the audio segment; and
synchronizing, for each selected audio segment of the number, a video segment of the multimedia content item corresponding to the selected audio segment, the synchronized video segment having an adjusted length matching the adjusted length of the audio segment.
19. The non-transitory computer-readable storage medium of claim 18 , synchronizing the video segment corresponding to the selected audio segment is performed separate from modification of the selected audio segment.
20. A computing device comprising:
a processor;
a non-transitory storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:
increasing logic executed by the processor for increasing a multimedia content item's playback rate, the increasing comprising:
identifying logic executed by the processor for identifying a time allocation score for each of a plurality of audio segments of audio content of the multimedia content item, the time allocation score for an audio segment being inversely related to its tempo, a silent audio segment being assigned a slower tempo than a non-silent audio segment;
selecting logic executed by the processor for selecting a number of audio segments using the time allocation score assigned to each audio segment of the plurality, the selecting comprising selecting each silent audio segment having a higher allocation score, determined based on its assigned slower tempo, than each non-silent audio segment;
determining logic executed by the processor for determining, for each selected audio segment of the number, an adjusted length of the selected audio segment, the adjusted length being shorter than an original length of the selected audio segment;
modifying logic executed by the processor for modifying each selected audio segment of the number in accordance with the determined adjusted length of the audio segment; and
synchronizing logic executed by the processor for synchronizing, for each selected audio segment of the number, a video segment of the multimedia content item corresponding to the selected audio segment, the synchronized video segment having an adjusted length matching the adjusted length of the audio segment.