IP Library Granted Patent US 11,545,123
Granted Patent B2
US 11,545,123 · App. 16/898,891 · Granted Jan 3, 2023

Audiovisual content rendering with display animation suggestive of geolocation at which content was previously rendered

Inventors: Spencer Salazar (San Francisco, CA); Rebecca A. Fiebrink (Timmins, CA); Ge Wang (Palo Alto, CA); Mattias Ljungstrom (Berlin, DE); Jeffrey C. Smith (Atherton, CA); Perry R. Cook (Jacksonville, OR)
Assignee: Smule, Inc.
G10H1/366G06F3/165G10H1/368G10L21/013G10L21/0356G10H2210/251G10H2210/331G10H2220/011G10H2240/125G10H2240/175G10H2240/211G10H2240/251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,545,123
App. No.
16/898,891
Granted
Jan 3, 2023
Kind
B2
Abstract

Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

Claims (38)

1. In a system comprising at least first and second portable computing devices, a method comprising:

receiving, at the second portable computing device, a computer readable encoding corresponding to an audible rendering by a first user of a first audio performance at the first portable computing device;

receiving, at the second portable computing device, metadata associated with the first audio performance, the metadata including a geocoded location of the audible rendering by the first user of the first audio performance; and

at the second portable computing device, audibly rendering the received computer readable encoding in association with a visual display animation suggestive of the first vocal performance emanating from a particular location on a globe, the particular location being based on the received metadata and geocoded location therein.

2. The method of claim 1 , further comprising:

retrieving, at the second portable computing device, the first audio performance based on selection of a uniform resource locator (URL) that references the first audio performance.

3. The method of claim 1 , wherein the metadata includes attributes of one or more listeners who have loved, tagged, or left comments for the first audio performance.

4. The method of claim 1 , further comprising:

providing, at the second portable computing device, feedback from a second user on the first audio performance.

5. The method of claim 4 , further comprising:

presenting, at the second portable computing device, geocoded listener feedback indications on the globe at positions that indicate geographic locations from which the feedback was transmitted.

6. The method of claim 1 , further comprising:

filtering for additional audio performances by the first user.

7. The method of claim 1 , further comprising:

detecting, at the second portable computing device, a user interface gesture captured at a touch screen of the second portable computing device; and

manipulating, at the second portable computing device, the globe in accordance with the user interface gesture.

8. The method of claim 1 , wherein the first audio performance is captured at the first portable computing device.

9. The method of claim 8 , wherein the first audio performance includes a pitch-corrected vocal performance of the first user.

10. The method of claim 1 , further comprising:

capturing, at the second portable computing device, a vocal performance of a second user; and

at the second portable computing device, pitch correcting the vocal performance of the second user in accord with pitch correction settings corresponding to a backing track.

11. A second portable computing device comprising:

user interface code executable on the second portable computing device to receive a computer readable encoding corresponding to an audible rendering by a first user of a first audio performance at a first portable computing device;

the user interface code further executable to receive metadata associated with the first audio performance, wherein the metadata includes a geocoded location of the audible rendering by the first user of the first audio performance; and

the user interface code further executable to audibly render the received computer readable encoding in association with a visual display animation suggestive of the first vocal performance emanating from a particular location on a globe, wherein the particular location is based on the received metadata and geocoded location therein.

12. The second portable computing device of claim 11 , wherein the user interface code is further executable to retrieve the first audio performance based on selection of a uniform resource locator (URL) that references the first audio performance.

13. The second portable computing device of claim 11 , wherein the metadata includes attributes of one or more listeners who have loved, tagged, or left comments for the first audio performance.

14. The second portable computing device of claim 11 , wherein the user interface code is further executable to provide feedback from a second user on the first audio performance.

15. The second portable computing device of claim 14 , wherein the user interface code is further executable to present geocoded listener feedback indications on the globe at positions that indicate geographic locations from which the feedback was transmitted.

16. The second portable computing device of claim 11 , wherein the user interface code is further executable to filter for additional audio performances by the first user.

17. The second portable computing device of claim 11 ,

wherein the user interface code is further executable to detect a user interface gesture captured at a touch screen of the second portable computing device; and

wherein the user interface code is further executable to manipulate the globe in accordance with the user interface gesture.

18. The second portable computing device of claim 11 , wherein the first audio performance is captured at the first portable computing device.

19. The second portable computing device of claim 18 , wherein the first audio performance includes a pitch-corrected vocal performance of the first user.

20. The second portable computing device of claim 11 ,

wherein the user interface code is further executable to capture a vocal performance of a second user; and

wherein the user interface code is further executable to pitch correct the vocal performance of the second user in accord with pitch correction settings corresponding to a backing track.

Assignments (4)
SECURITY INTEREST Recorded Dec 30, 2024
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 069703/0571 →
CHANGE OF NAME Recorded Feb 23, 2022
From: SONICMULE, INC.
To: SMULE, INC.
Reel/Frame 059353/0891 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2022
From: SALAZAR, SPENCER; FIEBRINK, REBECCA A.; WANG, GE; COOK, PERRY R.; SMITH, JEFFREY C.; LJUNGSTROM, MATTIAS
To: SONICMULE, INC.
Reel/Frame 058894/0130 →
SECURITY INTEREST Recorded Apr 15, 2021
From: SMULE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 055937/0207 →
Continuity (6)
Continuation 15693946 · Sep 1, 2017
Continuation 14720320 · May 22, 2015
Continuation 12876131 · Sep 4, 2010
Provisional Application 61323348 · Apr 12, 2010
Provisional Application 61286749 · Dec 15, 2009
Related Publication 20210125595A1 · Apr 29, 2021