Automatically processing content streams for insertion points
A video packaging and origination service can process requests for content segments from requesting user devices. The video packaging and origination service can processing video attributes, audio attributes and social media feeds to dynamically determine insertion points for supplemental content. Additionally, the video packaging and origination service can identify supplemental content utilizing the same attribute information.
1. A system to transmit content comprising:
one or more computing devices associated with a video packaging and origination service, wherein the video packaging and origination service is configured to:
encode received content into a set of encoded content segments, the received content including markers that correspond to manually determined insertion points for insertion of supplemental content;
receive content requests from a user device;
determine video and audio attributes of sequential segments of the encoded content segments;
characterize one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments, wherein the transitions are indicative of locations in the set of encoded content for insertion of supplemental content;
dynamically determine insertion points for insertion of the supplemental content in the set of encoded content segments based on the transitions;
form a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually determined insertion point;
render the encoded content segments;
identify a subset of a plurality of detectable objects based on processing the set of encoded content segments using a machine-learning algorithm to detect specific objects within the set of encoded content segments, the identified objects associated with the supplemental content; and
prioritize, in the set of insertion points, the insertions points that can be matched with the identified objects associated with the supplemental content over the insertion points that do not match with the identified objects associated with the supplemental content.
2. The system of claim 1 , wherein the video packaging and origination service is further configured to train the machine learning algorithms to identify the plurality of detectable objects.
3. The system of claim 1 , wherein the dynamically determined insertion points are different from the manually determined insertion points.
4. The system of claim 1 , wherein the video packaging and origination service is further configured to generate content manifest that identifies a first portion of content corresponding to the requested content and a second portion of content corresponding to the supplemental content.
5. The system of claim 1 , wherein the video attribute corresponds to a determination of a scene change associated with a sequence of the encoded content segments and the audio attribute corresponds to a determination of an expression of sentiment based on detected keywords.
6. A computer-implemented method to manage delivery of encoded content segments comprising:
receiving content requests for encoded content from one or more computing devices, the encoded content including manually configured markers for insertion of supplemental content;
determining video and audio attributes of sequential segments of the encoded content segments;
characterizing one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments, wherein dynamically determined insertion points are based on the transitions, and are indicative of locations in the set of encoded content for insertion of the supplemental content;
forming a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually configured marker;
rendering the encoded content segments;
utilizing machine learning algorithms to identify objects in the rendered encoded content segments, the identified objects associated with the supplemental content; and
prioritizing, in the set of insertion points, the insertions points that can be matched with the identified objects associated with the supplemental content over the insertion points that do not match with the identified objects associated with the supplemental content.
7. The computer-implemented method of claim 6 further comprising dynamically modifying a frequency of occurrence of insertion points based at least in part on at least one of content type, user request, and content provider criteria.
8. The computer-implemented method of claim 7 , wherein dynamically modifying the frequency of occurrence of insertion points is further based on social media information.
9. The computer-implemented method of claim 6 further comprising generating a content manifest that identifies a first portion of content corresponding to the requested content and a second portion of content corresponding to the supplemental content.
10. The computer-implemented method of claim 6 further comprising generating a content manifest that identifies a listing of available encoding bitrates or bitrate/format combinations for a first encoded segment of the requested content.
11. The computer-implemented method of claim 6 further comprising generating a content manifest for transmission to the one or more computing devices.
12. The computer-implemented method of claim 11 , wherein a first portion of the content manifest corresponds to the requested content.
13. The computer-implemented method of claim 11 , wherein a second portion of the content manifest corresponds to the supplemental content.
14. The computer-implemented method of claim 6 , wherein dynamically determining insertion points includes bypassing a manually inserted insertion point.
15. The computer-implemented method of claim 6 , wherein the dynamically determined insertion points are further based on at least one social media input.
16. The computer-implemented method of claim 6 , wherein audio attributes include a closed caption feed.
17. A computer-implemented method to manage delivery of encoded content segments comprising:
receiving content requests for encoded content from one or more computing devices, the encoded content including markers that correspond to manually determined insertion points for insertion of supplemental content;
determining video and audio attributes of sequential segments of the encoded content segments;
characterizing one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments;
dynamically determining insertion points for insertion of the supplemental content in the set of encoded content segments based on the transitions
forming a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually determined insertion point;
rendering the encoded content segments;
utilizing machine learning algorithms to detect objects in the rendered encoded content segments, wherein the machine learning algorithms are trained to identify a subset of the detectable objects, wherein the subset of detectable objects are associated with the supplemental content; and
prioritizing, in the set of insertion points, the insertions points that can be matched with the subset of detectable objects associated with the supplemental content over the insertion points that do not match with the subset of detectable objects associated with the supplemental content.
18. The computer-implemented method of claim 17 , wherein the learning algorithm include templates.
19. The computer-implemented method of claim 17 further comprising dynamically modifying a frequency of occurrence of insertion points based at least in part on at least one of content type, user request, and content provider criteria.
20. The computer-implemented method of claim 17 further comprising generating a content manifest that identifies a listing of available encoding bitrates or bitrate/format combinations for a first encoded segment of the requested content.