IP Library Granted Patent US 9,754,571
Granted Patent B2
US 9,754,571 · App. 14/720,320 · Granted Sep 5, 2017

Continuous pitch-corrected vocal capture device cooperative with content server for backing track mix

Inventors: Spencer Salazar (San Francisco, CA); Rebecca A. Fiebrink (Timmins, CA); Ge Wang (Palo Alto, CA); Mattias Ljungstrom (Berlin, DE); Jeffrey C. Smith (Atherton, CA); Perry R. Cook (Jacksonville, OR)
Assignee: Smule, Inc.
G10H1/366G06F3/165G10H1/368G10L21/013G10L21/0356G10H2210/251G10H2210/331G10H2220/011G10H2240/125G10H2240/175G10H2240/211G10H2240/251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,754,571
App. No.
14/720,320
Granted
Sep 5, 2017
Kind
B2
Abstract

Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

Claims (46)

1. A method comprising:

using a portable computing device for vocal performance capture, the portable computing device having a display, a microphone interface and a data communications interface;

retrieving via the data communications interface at least lyrics and timing information corresponding to a backing track;

at the portable computing device, audibly rendering a first encoding of the backing track and concurrently presenting the retrieved lyrics on the display in accord with the timing information;

at the portable computing device, capturing and pitch correcting a vocal performance of a user in accord with pitch correction settings; and

distorting the vocal performance capture in accord with an applied effect in correspondence with user interface gestures by the user, wherein a user interface gesture dynamically switches back and forth between melody and harmony note sets as operant pitch correction settings.

2. The method of claim 1 ,

storing an audio encoding of the pitch-corrected vocal performance to a local storage of the portable computing device.

3. The method of claim 1 ,

wherein the pitch correction settings include score-coded note targets.

4. The method of claim 3 ,

wherein a first user interface gesture switches off use of the score-coded note targets.

5. The method of claim 4 ,

wherein a second user interface gesture switches on use of the score-coded note targets.

6. The method of claim 1 ,

transmitting from the portable computing device to a remote server via the communications interface, an audio encoding of the pitch-corrected vocal performance for mixing with a second encoding of the backing track.

7. The method of claim 6 ,

wherein the second encoding is of higher quality or fidelity than the first encoding.

8. The method of claim 1 ,

wherein the pitch correction settings are specific to a particular artist.

9. A portable computing device comprising:

a display;

a microphone interface;

a data communications interface;

code executable on the portable computing device to retrieve via the data communications interface at least lyrics and timing information corresponding to a backing track;

code further executable on the portable computing device to audibly render a first encoding of the backing track and concurrently present the retrieved lyrics on the display in accord with the timing information;

code further executable on the portable computing device to capture and pitch correct a vocal performance of a user in accord with pitch correction settings; and

code further executable on the portable computing device to distort the vocal performance capture in accord with an applied effect in correspondence with user interface gestures by the user, wherein a user interface gesture dynamically switches back and forth between melody and harmony note sets as operant pitch correction settings.

10. The system of claim 9 , further comprising:

code further executable on the portable computing device to store an audio encoding of the pitch-corrected vocal performance to a local storage of the portable computing device.

11. The system of claim 9 ,

wherein the pitch correction settings include score-coded note targets.

12. The system of claim 11 ,

wherein a first user interface gesture switches off use of the score-coded note targets.

13. The system of claim 12 ,

wherein a second user interface gesture switches on use of the score-coded note targets.

14. The system of claim 9 ,

code further executable on the portable computing device to transmit from the portable computing device to a remote server via the communications interface, an audio encoding of the pitch-corrected vocal performance for mixing with a second encoding of the backing track.

15. The system of claim 14 ,

wherein the second encoding is of higher quality or fidelity than the first encoding.

16. The system of claim 9 , wherein the portable computing device is selected from the group of:

a mobile phone;

a personal digital assistant; and

a laptop computer, notebook computer, a pad-type computer or netbook.

17. The method of claim 1 , wherein a second user interface gesture causes modification of the pitch correction settings.

18. The system of claim 9 , wherein a second user interface gesture causes modification of the pitch correction settings.

Assignments (3)
SECURITY INTEREST Recorded Feb 26, 2020
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 052022/0440 →
CHANGE OF NAME Recorded Jun 29, 2016
From: SONICMULE, INC.
To: SMULE, INC.
Reel/Frame 039208/0660 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: LJUNGSTROM, MATTIAS; SALAZAR, SPENCER; FIEBRINK, REBECCA A.; WANG, GE; COOK, PERRY R.; SMITH, JEFFREY C.
To: SONICMULE, INC.
Reel/Frame 039032/0601 →
Continuity (4)
Continuation 12876131 · Sep 4, 2010
Provisional Application 61286749 · Dec 15, 2009
Provisional Application 61323348 · Apr 12, 2010
Related Publication 20160005416A1 · Jan 7, 2016