IP Library Granted Patent US 11,825,176
Granted Patent B2
US 11,825,176 · App. 17/583,011 · Granted Nov 21, 2023

Automatically processing content streams for insertion points

Inventors: Varun Ram (Portland, OR); Ki Myung Han (Happy Valley, OR); Meera Jindal (Portland, OR); Viriya Ratanasangpunth (Portland, OR); Chris Price (Portland, OR)
Assignee: Amazon Technologies, Inc.
H04N21/8455H04N21/2393H04N21/23106H04N21/23614H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,825,176
App. No.
17/583,011
Granted
Nov 21, 2023
Kind
B2
Abstract

A video packaging and origination service can process requests for content segments from requesting user devices. The video packaging and origination service can processing video attributes, audio attributes and social media feeds to dynamically determine insertion points for supplemental content. Additionally, the video packaging and origination service can identify supplemental content utilizing the same attribute information.

Claims (49)

1. A system to transmit content comprising:

one or more computing devices associated with a video packaging and origination service, wherein the video packaging and origination service is configured to:

encode received content into a set of encoded content segments, the received content including markers that correspond to manually determined insertion points for insertion of supplemental content;

store the plurality of encoded segments in a data store;

receive content requests from a user device;

determine video and audio attributes of sequential segments of the encoded content segments;

characterize one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments, wherein the transitions are indicative of locations in the set of encoded content for insertion of supplemental content;

dynamically determine insertion points for insertion of the supplemental content in the set of encoded content segments based on the transitions;

form a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually determined insertion point;

prioritize, in the set of insertion points, the insertion points that are indicative of scene transitions over the insertion points that are not indicative of scene transitions;

prioritize, in the set of insertion points, the insertions points that can be matched with a subject matter of the supplemental content over the insertion points that do not match with the subject matter of the supplemental content;

generate a content manifest that identifies a listing of available encoding bitrates or bitrate/format combinations for content, wherein the content manifest identifies a first portion corresponding to the requested content and a second portion corresponding to the supplemental content; and

transmit the content manifest to the user device.

2. The system of claim 1 , wherein the dynamically determined insertion points are different from the manually determined insertion points.

3. The system of claim 1 , wherein the video packaging and origination service utilizes machine-learning algorithms to identify objects in the requested content associated with the supplemental content.

4. The system of claim 1 , wherein the video attribute corresponds to a determination of a scene change associated with a sequence of the encoded content segments and the audio attribute corresponds to a determination of an expression of sentiment based on detected keywords.

5. A computer-implemented method to manage delivery of encoded content segments comprising:

receiving content requests for encoded content from one or more computing devices, the encoded content including manually configured markers for insertion of supplemental content;

determining video and audio attributes of sequential segments of the encoded content segments;

characterizing one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments, wherein dynamically determined insertion points are based on the transitions, and are indicative of locations in the set of encoded content for insertion of the supplemental content;

forming a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually configured marker;

prioritizing, in the set of insertion points, the insertion points that are indicative of scene transitions over the insertion points that are not indicative of scene transitions;

prioritizing, in the set of insertion points, the insertions points that can be matched with a subject matter of the supplemental content over the insertion points that do not match with the subject matter of the supplemental content;

dynamically modifying a frequency of occurrence of insertion points based at least in part on at least one of content type, user request, and content provider criteria; and

generating a content manifest that identifies a first portion of content corresponding to the requested content and a second portion of content corresponding to the supplemental content.

6. The computer-implemented method of claim 5 further comprising generating a content manifest for transmission to the one or more computing devices.

7. The computer-implemented method of claim 6 , wherein a first portion of the content manifest corresponds to the requested content.

8. The computer-implemented method of claim 6 , wherein a second portion of the content manifest corresponds to the supplemental content.

9. The computer-implemented method of claim 5 further comprising utilizing learning algorithms to identify objects associated with the supplemental content.

10. The computer-implemented method of claim 5 , wherein dynamically determining insertion points includes bypassing a manually inserted insertion point.

11. The computer-implemented method of claim 5 , wherein the dynamically determined insertion points are further based on at least one social media input.

12. The computer-implemented method of claim 5 , wherein audio attributes include a closed caption feed.

13. The computer-implemented method of claim 5 , wherein dynamically modifying the frequency of occurrence of insertion points is further based on social media information.

14. The computer-implemented method of claim 5 further comprising generating a content manifest that identifies a listing of available encoding bitrates or bitrate/format combinations for a first encoded segment of the requested content.

15. A computer-implemented method to manage delivery of encoded content segments comprising:

receiving content requests for encoded content from one or more computing devices, the encoded content including markers that correspond to manually determined insertion points for insertion of supplemental content;

determining video and audio attributes of sequential segments of the encoded content segments;

characterizing one or more segments of the sequential segments as indicative of a transition based on differences between the determined video and audio attributes of the sequential segments;

dynamically determining insertion points for insertion of the supplemental content in the set of encoded content segments based on the transitions;

forming a set of insertion points for the insertion of the supplemental content, wherein the set of insertion points includes at least one dynamically determined insertion point and at least one manually determined insertion point;

prioritizing, in the set of insertion points, the insertion points that are indicative of scene transitions over the insertion points that are not indicative of scene transitions;

prioritizing, in the set of insertion points, the insertions points that can be matched with a subject matter of the supplemental content over the insertion points that do not match with the subject matter of the supplemental content;

dynamically determining a frequency of occurrence of insertion points based at least in part on at least one of the transitions; and

inserting, responsive to the dynamically determined frequency of occurrence, the supplemental content into the encoded segments at the set of insertion points.

16. The computer-implemented method of claim 15 , wherein the dynamically determined insertion points are different from the manually determined insertion points.

17. The computer-implemented method of claim 15 further comprising generating a content manifest for transmission to the one or more computing devices.

18. The computer-implemented method of claim 15 further comprising utilizing a machine learning algorithm to identify at least one object in the requested content that is associated with the supplemental content.

19. The computer-implemented method of claim 15 further comprising dynamically modifying the determined frequency of occurrence based on at least one of content type, user request, and content provider criteria.

20. The computer-implemented method of claim 15 further comprising selecting supplemental content based at least in part on social media information.

Continuity (2)
Continuation 16121514 · Sep 4, 2018
Related Publication 20220224992A1 · Jul 14, 2022
Cited By (1)
US 12,192,595