IP Library › Granted Patent US 12,361,973
Granted Patent B2
US 12,361,973 · App. 17/937,163 · Granted Jul 15, 2025

Seamless insertion of modified media content

Inventors: Yongjun Wu (Bellevue, WA); Hyo In James Moon (Bothell, WA); Abhishek Kumar (Bothell, WA); Ahmed Aly Saad Ahmed (Bothell, WA); Sitaraman Ganapathy (Issaquah, WA); Steven James Cox (Mill Creek, WA); Yash Chaturvedi (Issaquah, WA)
Assignee: AMAZON TECHNOLOGIES, INC.
G11B27/036H04N21/23424
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,973
App. No.
17/937,163
Filed
Sep 30, 2022
Granted
Jul 15, 2025
Kind
B2
Art Unit
2481
USPC
386/241
Abstract

Disclosed are various embodiments for seamless insertion of modified media content. In one embodiment, a modified portion of video content is received. The modified portion has a start cue point and an end cue point that are set relative to a modification to the video content to indicate respectively when the modification approximately begins and ends compared to the video content. A video coding associated with the video content is identified. The start cue point and/or the end cue point are dynamically adjusted to align the modified portion with the video content based at least in part on the video coding.

Claims (44)

1. A system, comprising:

at least one computing device; and

instructions executable in the at least one computing device, wherein when executed the instructions cause the at least one computing device to at least:

receive a modified portion of video content, the modified portion having a start cue point and an end cue point that are set relative to a modification to the video content to indicate respectively when the modification approximately begins and ends compared to the video content;

identify a video coding used in transcoding the video content;

identify an audio coding associated with an audio track of the video content;

dynamically adjust at least one of the start cue point or the end cue point to align the modified portion with the video content based at least in part on the video coding and the audio coding, thereby expanding the modified portion to include at least one of: a first unmodified portion of the video content at a beginning of the modified portion or a second unmodified portion of the video content at an end of the modified portion; and

package a video stream incorporating the modified portion seamlessly into the video content between the start cue point and the end cue point, the modified portion replacing an unmodified portion of the video content between the start cue point and the end cue point such that the unmodified portion of the video content is removed from the video stream.

2. The system of claim 1 , wherein the modification corresponds to a virtual product placement in the modified portion.

3. The system of claim 1 , wherein the modification includes modified closed captioning data pertaining to the modified portion, and the video stream includes the modified closed captioning data for the modified portion.

4. The system of claim 1 , wherein the video stream includes one or more modified thumbnail images for the modified portion.

5. The system of claim 1 , wherein the instructions further cause the at least one computing device to at least select the modified portion from a plurality of alternative versions of the modified portion based at least in part on one or more user characteristics.

6. The system of claim 1 , wherein the start cue point is adjusted to align with a first key video frame in the modified portion, and the end cue point is adjusted to align with a second key video frame in the video content.

7. The system of claim 1 , wherein at least one of the start cue point or the end cue point is adjusted to align with an audio frame boundary for the audio track of the video content.

8. The system of claim 1 , wherein at least one of the start cue point or the end cue point are adjusted to align with a key video frame at a time location determined by a constant multiplier of time, the constant multiplier of time being determined based at least in part on the video coding and the audio coding.

9. A computer-implemented method, comprising:

receiving a modified portion of video content, the modified portion having a start cue point and an end cue point that are set relative to a modification to the video content to indicate respectively when the modification approximately begins and ends compared to the video content;

identifying a video coding associated with the video content;

dynamically adjusting at least one of the start cue point or the end cue point to align the modified portion with the video content based at least in part on the video coding, which further comprises at least one of:

dynamically adjusting the start cue point to be earlier in time so that the modified portion includes a first unmodified portion before the modification; or

dynamically adjusting the end cue point to be later in time so that the modified portion includes a second unmodified portion after the modification; and

replacing an unmodified portion of the video content with the modified portion such that the unmodified portion of the video content is removed from the video content.

10. The computer-implemented method of claim 9 , further comprising packaging a video stream incorporating the modified portion seamlessly into the video content between the start cue point and the end cue point.

11. The computer-implemented method of claim 9 , further comprising transcoding the video content and the modified portion using a plurality of video codings.

12. The computer-implemented method of claim 9 , wherein dynamically adjusting the at least one of the start cue point or the end cue point to align the modified portion with the video content based at least in part on the video coding further comprises aligning the at least one of the start cue point or the end cue point with a key video frame.

13. The computer-implemented method of claim 9 , wherein dynamically adjusting the at least one of the start cue point or the end cue point to align the modified portion with the video content based at least in part on the video coding further comprises aligning the at least one of the start cue point or the end cue point with an audio frame boundary for an audio track of the video content.

14. The computer-implemented method of claim 9 , further comprising:

determining a constant multiplier of time based at least in part on the video coding and an audio coding used to encode an audio track of the video content; and

wherein dynamically adjusting the at least one of the start cue point or the end cue point to align the modified portion with the video content further comprises aligning the at least one of the start cue point or the end cue point with a key video frame at a time location determined by the constant multiplier of time.

15. The computer-implemented method of claim 9 , further comprising:

identifying an audio coding associated with an audio track of the video content; and

dynamically adjusting the at least one of the start cue point or the end cue point to align an audio track of the modified portion with the audio track of the video content based at least in part on the audio coding.

16. A computer-implemented method, comprising:

streaming video content to a media player;

determining to replace a portion of the video content with a modified portion of the video content, the modified portion having a start cue point and an end cue point that are set relative to a modification to the video content to indicate respectively when the modification approximately begins and ends compared to the video content;

directing the media player to switch from the video content to the modified portion of the video content and from the modified portion of the video content back to the video content while handling an audio track misalignment, the modified portion replacing an unmodified portion of the video content such that the unmodified portion of the video content is removed from a playback of the video content by the media player; and at least one of:

dynamically adjusting the start cue point of the modified portion to be earlier in time so that the modified portion includes a first unmodified portion before the modification; or

dynamically adjusting the end cue point to be later in time so that the modified portion includes a second unmodified portion after the modification.

17. The computer-implemented method of claim 16 , further comprising selecting the modified portion of the video content from a plurality of alternative versions of the modified portion based at least in part on one or more user characteristics associated with the media player.

18. The computer-implemented method of claim 16 , wherein directing the media player further comprises sending at least one tag to the media player specifying seamless contiguous playback from a first period to a second period.

19. The computer-implemented method of claim 16 , wherein directing the media player further comprises generating a manifest that specifies seamless contiguous playback using at least one discontinuity tag.

20. The computer-implemented method of claim 16 , further comprising:

determining a constant multiplier of time based at least in part on an audio coding used to encode an audio track of the video content; and

aligning the at least one of the start cue point or the end cue point with a key video frame at a time location determined by the constant multiplier of time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: WU, YONGJUN; MOON, HYO IN JAMES; KUMAR, ABHISHEK; AHMED, AHMED ALY SAAD; GANAPATHY, SITARAMAN; COX, STEVEN JAMES; CHATURVEDI, YASH
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 064900/0974 →
Continuity (1)
Related Publication 20240112703A1 · Apr 4, 2024
References Cited (13)
US 6584273B1 · Ashley · 2003 [cited by examiner]
US 10972809B1 · Key · 2021 [cited by examiner]
US 11589116B1 · Omar · 2023 [cited by examiner]
US 20140237521A1 · Rothschild et al. · 2014 [cited by applicant]
US 20180167698A1 · Mercer · 2018 [cited by examiner]
US 20180330756A1 · MacDonald · 2018 [cited by examiner]
US 20190069004A1 · Badawiyeh · 2019 [cited by applicant]
US 20190075148A1 · Nielsen et al. · 2019 [cited by applicant]
US 20190313135A1 · Pathak · 2019 [cited by examiner]
US 20200053394A1 · Shiraishi · 2020 [cited by examiner]
US 20220156317A1 · Adato · 2022 [cited by examiner]
US 20220180898A1 · Ahmed et al. · 2022 [cited by applicant]
International Search Report and Written Opinion for PCT/US23/75128 mailed Jan. 22, 2024. [cited by applicant]