IP Library Granted Patent US 10,262,644
Granted Patent B2
US 10,262,644 · App. 14/587,625 · Granted Apr 16, 2019

Computationally-assisted musical sequencing and/or composition techniques for social music challenge or competition

Inventors: Randal Leistikow (San Jose, CA); Mark Godfrey (Atlanta, GA); Ian S. Simon (San Francisco, CA); Jeannie Yang (San Jose, CA); Michael W. Allen (San Carlos, CA)
Assignee: Smule, Inc.
G10H1/366G10L21/00G10H2210/051G10H2210/061G10H2240/141G10H2250/235G10L13/033G10L25/87
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,262,644
App. No.
14/587,625
Granted
Apr 16, 2019
Kind
B2
Abstract

An application that manipulates audio (or audiovisual) content, automated music creation technologies may be employed to generate new musical content using digital signal processing software hosted on handheld and/or server (or cloud-based) compute platforms to intelligently process and combine a set of audio content captured and submitted by users of modern mobile phones or other handheld compute platforms. The user-submitted recordings may contain speech, singing, musical instruments, or a wide variety of other sound sources, and the recordings may optionally be preprocessed by the handheld devices prior to submission.

Claims (34)

1. A social music method comprising:

capturing, using an audio interface of a portable computing device, a raw vocal performance by a user of the portable computing device;

in an audio processing pipeline,

computationally segmenting the raw captured vocal performance, wherein the segmenting results in a plurality of segments, and wherein each segment in the plurality satisfies a minimum segment length threshold such that a total number of segments in the plurality of segments is equal to or below a maximum number of segments;

temporally remapping segments of the segmented vocal performance; and

generating from the temporal remapping a derived musical composition;

audibly rendering the derived musical composition at the portable computing device; and

responsive to a selection by the user, causing a challenge to be transmitted to a remote second user, the challenge including an encoding of the derived musical composition and a seed including the user's raw captured vocal performance.

2. The method of claim 1 ,

wherein the seed encodes the segmentation of the user's captured vocal performance.

3. The method of claim 1 , further comprising:

receiving, for a vocal contribution of the remote second user captured in response to the challenge, a segmentation of the remote second user's vocal contribution; and

from a combined segment set including at least some vocal segments captured from the user and at least some vocal segments captured from the remote second user, temporally remapping segments of the combined segment set and generating therefrom a derived musical composition including contributions of both the user and the remote second user.

4. The method of claim 3 , wherein temporally remapping segments of the combined segment set and generating therefrom a derived musical composition including contributions of both the user and the remote second user utilizes fairness logic to ensure a level of balance in the derived musical composition amongst the contributions of the user and the remote second user.

5. The method of claim 1 , further comprising:

receiving a vocal contribution of the remote second user captured in response to the challenge; and

from a combined audio signal including at least some portions of the captured vocal performance of the user and at least some portions of the captured vocal contribution of the remote second user,

computationally segmenting the combined audio signal;

temporally remapping the segments of the combined audio signal; and

generating from the temporally remapped segments a derived musical composition including vocal content from both the user and the remote second user; and

audibly rendering the derived musical composition at the portable computing device.

6. The method of claim 1 ,

wherein the audio processing pipeline is implemented on the portable computing device.

7. The method of claim 1 ,

wherein the audio processing pipeline is implemented, at least in part, on a service platform in data communication with the portable computing device.

8. A computer program product encoded in one or more non-transitory computer-readable media, the computer program product including instructions executable on a processor of the portable computing device to cause the portable computing device to perform or initiate the steps recited in claim 1 .

9. A system comprising the portable computing device programmed with instructions executable on a processor thereof to cause the portable computing device to perform or initiate the steps recited in claim 1 .

10. An audio processing pipeline implemented on a portable computing device comprising:

a segmentation stage for computationally segmenting at least a current vocal contribution captured in connection with a vocal performance battle, wherein the computational segmenting results in a plurality of segments, and wherein each segment in the plurality satisfies a minimum segment length threshold such that a total number of segments in the plurality of segments is equal to or below a maximum number of segments;

a partition mapping stage for temporally remapping segments from a combined segment set including at least some vocal segments captured from an initial user's seed performance and at least some vocal segments from one or more subsequent vocal contributors, including the current vocal contribution, captured in connection with the vocal performance battle, the initial user's seed performance including a raw captured vocal performance of the initial user; and

further stages for generating from the temporal remapping, a derived musical composition including contributions of the initial user and one or more of the subsequent vocal contributors and for rendering the derived musical composition as an audio signal.

11. The audio processing pipeline of claim 10 ,

wherein segmentations of a seed performance and of subsequent vocal contributions are introduced into the audio processing pipeline at, or before, the partition mapping stage for subsequent round audio processing.

12. The audio processing pipeline of claim 10 , wherein the stages for generating from the temporal remapping a derived musical composition including contributions of the initial user and one or more of the subsequent vocal contributors utilizes fairness logic to ensure a level of balance in the derived musical composition amongst the contributions of the initial user and the subsequent vocal contributors.

Assignments (3)
SECURITY INTEREST Recorded Feb 26, 2020
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 052022/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2016
From: LEISTIKOW, RANDAL J.; GODFREY, MARK; SIMON, IAN S.; YANG, JEANNIE; ALLEN, MICHAEL W.
To: SMULE, INC.
Reel/Frame 040010/0083 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2016
From: LEISTIKOW, RANDAL J.; SIMON, IAN S.; YANG, JEANNIE
To: SMULE, INC.
Reel/Frame 039979/0103 →
Continuity (4)
Continuation In Part 13853759 · Mar 29, 2013
Provisional Application 61922433 · Dec 31, 2013
Provisional Application 61617643 · Mar 29, 2012
Related Publication 20150120308A1 · Apr 30, 2015