IP Library Granted Patent US 12701306
Granted Patent B1
US 12701306 · App. 18/424,048 · Granted Aug 4, 2026

Personalized event highlight music video generator

Inventors: Avi Avraham Ben-Cohen (Holon, IL); Gilad Cohen (Jerusalem, IL); Amit Adam (Haifa, IL)
Assignee: Amazon Technologies, Inc.
H04N21/8549G06F16/635G06F16/907G06V30/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12701306
App. No.
18/424,048
Filed
Jan 26, 2024
Granted
Aug 4, 2026
Kind
B1
Art Unit
2484
USPC
386/241
Abstract

The system identifies a highlight from a highlight reel. Using association and personalization metadata, the highlight is processed and analyzed to determine if the highlight satisfies a user preference. The highlight can then be combined with audio, selected specifically for the highlight, into a music video to be provided to a user.

Claims (46)

1 . A method comprising:

identifying, using a first image analysis component of a plurality of image analysis components, a first highlight of a plurality of highlights of a highlight reel, wherein the highlight reel is associated with an event;

receiving association metadata from a first data store and personalized metadata from a second data store, wherein the association metadata is associated with the event and the personalized metadata is associated with a personal preference of a user;

determining a characteristic and an action of the first highlight using the association metadata, wherein the characteristic is associated with the event of the first highlight;

determining that the characteristic satisfies a criterion associated with the personalized metadata;

selecting an audio track from an audio data store that is separate from audio data of the event based on one of the action, the event, or the personalized metadata, wherein the audio track is associated with an audio element;

aligning the action depicted in the first highlight with the audio element;

generating a media representation that includes the action aligned with the audio element; and

causing a user device to present the media representation.

2 . The method of claim 1 , wherein determining that the characteristic satisfies the criterion further comprises determining that the characteristic is associated with an entity referenced by the criterion.

3 . The method of claim 1 , wherein generating the media representation further comprises combining the first highlight and a second highlight of the plurality of highlights of the highlight reel, wherein the second highlight satisfies the criterion.

4 . The method of claim 3 , wherein generating the media representation further comprises:

identifying a transition clip associated with the event; and

combining the first highlight, the second highlight and the transition clip.

5 . The method of claim 1 , wherein selecting audio from an audio data store further comprises selecting a first audio and a second audio, wherein the second audio is a subset of audio data of the highlight.

6 . The method of claim 5 , wherein generating the media representation further comprises:

identifying an action of the first highlight; and

aligning the first audio and the second audio with the first highlight, wherein the audio element of the first audio is aligned with the action and the second audio combines with the first audio from a first time to a second time within the first highlight.

7 . A non-transitory computer-readable medium storing instructions that, when executed by a computing system within a cloud provider network, cause the computing system to perform operations comprising:

identifying, using a first image analysis component of a plurality of image analysis components, a first highlight of a plurality of highlights of a highlight reel, wherein the highlight reel is associated with an event;

determining a characteristic and an action of the first highlight, wherein the characteristic is associated with the event of the first highlight;

determining that the characteristic satisfies a criterion associated with a preference of a user;

selecting audio from an audio data store that is separate from audio data of the event based on one of the action, the event, or metadata, wherein the audio is associated with an audio element; and

causing a media representation to be generated based on the first highlight and the audio, wherein the characteristic of the first highlight is aligned with the audio element.

8 . The non-transitory computer-readable medium of claim 7 , wherein the metadata includes association metadata received from a data store, wherein the association metadata is associated with the event.

9 . The non-transitory computer-readable medium of claim 7 , wherein the audio element is one of a beat, tempo, lyric, or dynamic.

10 . The non-transitory computer-readable medium of claim 7 , wherein the media representation is created according to a presentation type.

11 . The non-transitory computer-readable medium of claim 7 , wherein the instructions, when executed, further cause the computing system to perform operations comprising determining that the characteristic is associated with an entity referenced by the criterion.

12 . The non-transitory computer-readable medium of claim 7 , wherein the instructions, when executed, further cause the computing system to perform operations comprising combining the first highlight and a second highlight of the plurality of highlights of the highlight reel, wherein the second highlight satisfies the criterion.

13 . The non-transitory computer-readable medium of claim 12 , wherein the instructions, when executed, further cause the computing system to perform operations comprising identifying a transition clip associated with the event; and combining the first highlight, the second highlight and the transition clip.

14 . The non-transitory computer-readable medium of claim 7 , wherein the instructions, when executed, further cause the computing system to perform operations comprising selecting a first audio and a second audio.

15 . The non-transitory computer-readable medium of claim 14 , wherein the instructions, when executed, further cause the computing system to perform operations comprising:

identifying an action of the first highlight; and

wherein generating the media representation includes aligning the first audio and the second audio with the first highlight, wherein the audio element of the first audio is aligned with the action and the second audio combines with the first audio from a first time to a second time within the first highlight.

16 . An interactive broadcast system comprising:

a memory, wherein the memory is configured to store computer-executable instructions; and

one or more processors in communication with the memory, wherein the computer-executable instructions, when executed by the one or more processors, cause the one or more processors to:

receive a first highlight of a plurality of highlights of a highlight reel;

determine a characteristic and an action of the first highlight, wherein the characteristic is associated with an event of the first highlight;

determine that the characteristic satisfies a criterion associated with metadata from a user;

select audio that is separate from audio data of the event; and

cause a media representation to be generated based on the first highlight and the selected audio.

17 . The interactive broadcast system of claim 16 , wherein the computer-executable instructions, when executed, further cause the one or more processors to select an audio track from an audio data store for alignment with the first highlight, wherein the audio is selected based on network data that identifies popular music associated with the event.

18 . The interactive broadcast system of claim 16 , wherein the computer-executable instructions, when executed, further cause the one or more processors to compare the criterion with the action to determine that the characteristic is associated with an entity.

19 . The interactive broadcast system of claim 16 , wherein the computer-executable instructions, when executed, further cause the one or more processors to combine the first highlight and a second highlight of the plurality of highlights of the highlight reel, wherein the second highlight satisfies the criterion.

20 . The interactive broadcast system of claim 19 , wherein the computer-executable instructions, when executed, further cause the one or more processors to identify a transition clip associated with the event; and combine the first highlight, the second highlight and the transition clip.