IP Library Granted Patent US 11,532,317
Granted Patent B2
US 11,532,317 · App. 17/126,213 · Granted Dec 20, 2022

Audio interactive decomposition editor method and system

Inventor: Derry Fitzgerald (County Cork, IE)
Assignee: MUNSTER TECHNOLOGICAL UNIVERSITY
G10L21/0272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,532,317
App. No.
17/126,213
Granted
Dec 20, 2022
Kind
B2
Abstract

A distributed system and a corresponding data processing method are disclosed, for decomposing audio signals including mixed audio sources. The system comprises at least one client terminal, a remote queuing module and at least one remote audio data processing module connected in a network. A client terminal stores source audio signal data, selects at least one signal decomposition type, uploads source audio signal data with data representative of the decomposition type selection to the queuing module, and downloads decomposed audio signal data. The queuing module queues uploaded source audio data and distributes same to data processing module(s). The queuing module also queues uploaded decomposed audio signal data and distributes same to client terminal(s). An audio data processing module processes distributed source audio data into decomposed audio signal data according to the type selection, and uploads decomposed audio signal data to the at least one remote queuing resource.

Claims (42)

1. A distributed system for decomposing audio signals including mixed audio sources, comprising:

at least one client terminal,

at least one remote queuing module, and

at least one remote audio data processing module connected in a network,

wherein

each client terminal of said at least one client terminal is programmed to

store source audio signal data,

select at least one signal decomposition type,

upload the source audio signal data with data representative of the at least one signal decomposition type that is selected to the at least one remote queuing module, and

download decomposed audio signal data;

each queuing module of the at least one remote queuing module is programmed to

queue the source audio signal data that is uploaded and distribute the source audio signal data that is uploaded to the at least one remote audio data processing module, and

queue the decomposed audio signal data that is downloaded and distribute the decomposed audio signal data that is downloaded to the each client terminal; and

each audio data processing module of the at least one remote audio data processing module is programmed to

process the source audio signal data that is distributed into decomposed audio signal data according to the at least one signal decomposition type that is selected, and

upload the decomposed audio signal data to the at least one remote queuing module;

wherein each remote audio data processing module of the at least one remote audio data processing module processes distributed source audio data for separating at least a vocal audio source therefrom, with a first sequence of algorithms implementing non-negative matrix factorizations, and

wherein each client terminal is further programmed to constrain one or more algorithms of the first sequence of algorithms with respective variables encoded in the data representative of the at least one signal decomposition type that is selected.

2. The distributed system of claim 1 , wherein the at least one signal decomposition type comprises at least one selected from a vocal audio source separation and a drums audio source separation.

3. The distributed system of claim 1 , wherein the at least one signal decomposition type further comprises a separation of an audio source location within the source audio signal data.

4. The distributed system of claim 1 , wherein each remote audio data processing module of the at least one remote audio data processing module processes the distributed source audio data for separating at least a drums audio source therefrom, with a second sequence of algorithms implementing non-negative matrix factorizations.

5. The distributed system of claim 4 , wherein at least one algorithm of the second sequence of algorithms implements at least one Kernel Additive Modelling (KAM) algorithm for processing the distributed source audio signal data.

6. The distributed system of claim 1 , wherein each client terminal is further programmed to locally process the stored source audio signal data with one or more locally-stored decomposition algorithms into edited audio signal data.

7. The distributed system of claim 5 , wherein the at least one KAM algorithm of the second sequence of algorithms is a locally-stored decomposition algorithm.

8. The distributed system of claim 1 , wherein said each client terminal is further programmed to combine any one or more of the source audio signal data that is stored, the decomposed audio signal data that is downloaded and edited audio signal data into a new audio signal.

9. A computer-implemented method for decomposing a digital audio signal including mixed audio sources in a network, comprising:

selecting a source audio signal data and selecting a decomposition type at a client terminal;

uploading the source audio signal data and data representative of the decomposition type that is selected to a queuing module;

queuing the source audio signal data that is uploaded and distributing to the source audio signal data that is uploaded to an audio data processing module from the queuing module;

processing the source audio signal data that is distributed into decomposed audio signal data at the audio data processing module with a sequence of algorithms implementing non-negative matrix factorizations, wherein the sequence of algorithms is determined by the decomposition type that is selected,

uploading the decomposed audio signal data to the queuing module; and

queuing the decomposed audio signal data that is uploaded and distributing the decomposed audio signal data that is uploaded to the client terminal from the queuing module.

10. The computer-implemented method of claim 9 , wherein the step of selecting the decomposition type comprises selecting at least one selected from a vocal audio source separation and a drums audio source separation.

11. The computer-implemented method of claim 9 , wherein the processing the source audio signal data that is distributed comprises separating at least a vocal audio source therefrom, with a first sequence of algorithms implementing said non-negative matrix factorizations.

12. The computer-implemented method of claim 9 , wherein the processing the source audio signal data that is distributed comprises separating at least a drums audio source therefrom, with a second sequence of algorithms implementing said non-negative matrix factorizations.

13. A set of instructions recorded on a non-transitory data carrying medium or stored at a non-transitory network storage medium which, when read and processed by a data processing terminal connected to a network, configures the data processing terminal to perform a computer-implemented method for decomposing a digital audio signal including mixed audio sources in the network, the computer-implemented method comprising:

selecting a source audio signal data and selecting a decomposition type at a client terminal;

uploading the source audio signal data and data representative of the decomposition type that is selected to a queuing module;

queuing the source audio signal data that is uploaded and distributing to the source audio signal data that is uploaded to an audio data processing module from the queuing module;

processing the source audio signal data that is distributed into decomposed audio signal data at the audio data processing module with a sequence of algorithms implementing non-negative matrix factorizations, wherein the sequence of algorithms is determined by the decomposition type that is selected,

uploading the decomposed audio signal data to the queuing module; and

queuing the decomposed audio signal data that is uploaded and distributing the decomposed audio signal data that is uploaded to the client terminal from the queuing module.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: FITZGERALD, DERRY
To: MUNSTER TECHNOLOGICAL UNIVERSITY
Reel/Frame 057988/0953 →
CHANGE OF NAME Recorded Aug 6, 2021
From: CORK INSTITUTE OF TECHNOLOGY
To: MUNSTER TECHNOLOGICAL UNIVERSITY
Reel/Frame 057111/0215 →
Continuity (2)
Provisional Application 62949662 · Dec 18, 2019
Related Publication 20210193164A1 · Jun 24, 2021