IP Library Granted Patent US 11,848,032
Granted Patent B2
US 11,848,032 · App. 17/712,686 · Granted Dec 19, 2023

User-generated templates for segmented multimedia performance

Inventors: Jeffrey Christopher Smith (Atherton, CA); Perry Raymond Cook (Jacksonville, OR); David Adam Steinwedel (San Francisco, CA)
Assignee: SMULE, INC.
G11B27/036H04N9/8715H04N21/2187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,848,032
App. No.
17/712,686
Granted
Dec 19, 2023
Kind
B2
Abstract

Disclosed herein are computer-implemented method, system, and computer-readable storage-medium embodiments for implementing user-generated templates for segmented multimedia performances. An embodiment includes at least one computer processor configured to transmit a first version of a content instance and corresponding metadata. The first version of the content instance may include a plurality of structural elements, with at least one structural element corresponding to at least part of the metadata. The first content instance may be transformed by a rendering engine triggered by the at least one computer processor.

Claims (44)

1. A computer-implemented method for generating an enhanced audio-only performance that includes a rendered audio-only performance and at least one video effect, the computer-implemented method comprising:

receiving, at a mobile device, lyrical information and a backing track, wherein the lyrical information and the backing track are associated with an audio-only performance;

displaying, at the mobile device, the lyrical information;

capturing, at the mobile device, the audio-only performance while the lyrical information is being displayed, wherein the audio-only performance does not include livestream video content;

rendering, at the mobile device, the audio-only performance with at least one transformational effect to generate the rendered audio-only performance, wherein the at least one transformational effect includes the backing track, wherein the at least one transformational effect further comprises an audio effect and wherein the audio-only performance comprises a content instance, wherein the rendering further comprises:

rendering the audio-only performance with the audio effect;

displaying a plurality of structural elements corresponding to the content instance wherein the plurality of structural elements includes at least one structural element, wherein the at least one structural element comprises an intro, an outro, a verse, a pre-chorus, a chorus, a bridge, a hook, a climax, or a combination thereof; and

generating the audio-only performance based on the at least one transformation effect and the at least one structural element; and

applying, at the mobile device, the at least one video effect to the rendered audio-only performance to generate the enhanced audio-only performance.

2. The computer-implemented method of claim 1 , wherein the at least one video effect comprises a video filter or a text filter.

3. The computer-implemented method of claim 2 , wherein the video filter comprises at least one of a grayscale filter, a color profile, a lighting profile, a blur filter, a trailing filter, or a combination thereof.

4. The computer-implemented method of claim 2 , wherein the text filter comprises at least one of lyric filter for adding the lyrical information to the rendered audio-only performance, wherein the enhanced audio-only performance comprises the rendered audio-only performance and the added lyrical information.

5. The computer-implemented method of claim 1 , further comprising:

transmitting a first version of the content instance, wherein the first version of the content instance comprises the plurality of structural elements; and

triggering a transformation of the first version of the content instance into a second version of the content instance, wherein the transformation comprises rendering, by a rendering engine, a result of the transformation applying an audio-only performance template to the first version of the content instance.

6. The computer-implemented method of claim 1 , wherein the at least one transformational effect comprises a video filter configured to modulate at least part of a non-livestream video component of a second version of the content instance, based at least in part on a first audio component of a first version of the content instance, a second audio component of the second version of the content instance, a user-generated audio recording, an engagement metric of a plurality of users, or a combination thereof.

7. The computer-implemented method of claim 6 , wherein:

any of the first audio component, the second audio component, or the user-generated audio recording, comprises a selected audio element;

the selected audio element comprises at least one of an audio track for a selected instrument, an audio signal that is characteristic of the selected instrument, or a combination thereof; and

the video filter is configured to modulate the at least part of the non-livestream video component of the second version of the content instance, based at least in part on an intensity of the selected audio element.

8. The computer-implemented method of claim 6 , wherein the at least one transformation effect comprises a second audio filter configured to modulate at least part of an audio component of the second version of the content instance, based at least in part on a video component of the second version of the content instance, the user-generated audio recording, a detected motion of at least one user, an engagement metric of a plurality of users, or a combination thereof.

9. The computer-implemented method of claim 8 , wherein the second audio filter comprises an addition of echo, reverberation, harmony notes, harmony chords, noise gating, panning, shifting, flanging, dynamic-range compression, or a combination thereof.

10. A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one computer processor, cause the at least one computer processor to perform operations comprising:

receiving lyrical information and a backing track, wherein the lyrical information and the backing track are associated with an audio-only performance;

displaying the lyrical information;

capturing the audio-only performance while the lyrical information is being displayed, wherein the audio-only performance does not include livestream video content;

rendering the audio-only performance with at least one transformational effect to generate a rendered audio-only performance, wherein the at least one transformational effect includes the backing track, wherein the at least one transformational effect further comprises an audio effect and wherein the audio-only performance comprises a content instance, wherein the rendering further comprises:

rendering the audio-only performance with the audio effect;

displaying a plurality of structural elements corresponding to the content instance, wherein the plurality of structural elements includes at least one structural element, wherein the at least one structural element comprises an intro, an outro, a verse, a pre-chows, a chorus, a bridge, a hook, a climax, or a combination thereof; and

generating the audio-only performance based on the at least one transformation effect and the at least one structural element; and

applying at least one video effect to the rendered audio-only performance to generate an enhanced audio-only performance, wherein the enhanced audio-only performance includes the rendered audio-only performance and the at least one video effect.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the at least one video effect comprises a video filter or a text filter.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the video filter comprises at least one of a gray scale filter, a color profile, a lighting profile, a blur filter, a trailing filter, or a combination thereof.

13. The non-transitory computer-readable storage medium of claim 11 , wherein the text filter comprises at least one of lyric filter for adding the lyrical information to the rendered audio-only performance, wherein the enhanced audio-only performance comprises the rendered audio-only performance and the added lyrical information.

14. The non-transitory computer-readable storage medium of claim 10 , the operations further comprising:

transmitting a first version of the content instance, wherein the first version of the content instance comprises the plurality of structural elements; and

triggering a transformation of the first version of the content instance into a second version of the content instance, wherein the transformation comprises rendering, by a rendering engine, a result of the transformation applying an the audio-only performance template to the first version of the content instance.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the at least one transformational effect comprises a video filter configured to modulate at least part of a non-livestream video component of the second version of the content instance, based at least in part on a first audio component of the first version of the content instance, a second audio component of the second version of the content instance, a user-generated audio recording, an engagement metric of a plurality of users, or a combination thereof.

16. The non-transitory computer-readable storage medium of claim 15 , wherein:

any of the first audio component, the second audio component, or the user-generated audio recording, comprises a selected audio element;

the selected audio element comprises at least one of an audio track for a selected instrument, an audio signal that is characteristic of the selected instrument, or a combination thereof; and

the video filter is configured to modulate the at least part of the non-livestream video component of the second version of the content instance, based at least in part on an intensity of the selected audio element.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one transformation effect comprises a second audio filter configured to modulate at least part of an audio component of the second version of the content instance, based at least in part on a video component of the second version of the content instance, the user-generated audio recording, a detected motion of at least one user, an engagement metric of a plurality of users, or a combination thereof.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the second audio filter comprises an addition of echo, reverberation, harmony notes, harmony chords, noise gating, panning, shifting, flanging, dynamic-range compression, or a combination thereof.

Assignments (3)
SECURITY INTEREST Recorded Dec 30, 2024
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 069703/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2023
From: SMITH, JEFFREY CHRISTOPHER; COOK, PERRY RAYMOND; STEINWEDEL, DAVID ADAM
To: SMULE, INC.
Reel/Frame 065327/0142 →
SECURITY INTEREST Recorded Apr 19, 2023
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 063376/0889 →
Continuity (4)
Continuation 17221517 · Apr 2, 2021
Continuation In Part 16939679 · Jul 27, 2020
Continuation 16509688 · Jul 12, 2019
Related Publication 20220293135A1 · Sep 15, 2022