IP Library Granted Patent US 9,741,327
Granted Patent B2
US 9,741,327 · App. 14/996,812 · Granted Aug 22, 2017

Automatic transcription of musical content and real-time musical accompaniment

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,741,327
App. No.
14/996,812
Granted
Aug 22, 2017
Kind
B2
Abstract

Various embodiments provide techniques for generating real-time musical accompaniment for musical content included in an audio signal. A real-time musical accompaniment system receives the audio signal via an audio input device. The system extract, from the audio signal, musical information characterizing at least a portion of the musical content. The system generates musical information that has at least one of a rhythmic relationship and a harmonic relationship with the musical information. The system generates an output audio signal that is complementary to the musical information. The system transmits, substantially immediately after receiving the audio signal, the output audio signal to an audio output device.

Claims (45)

1. A method for generating an accompaniment for musical content included in a first audio signal, the method comprising:

receiving the first audio signal via an audio input device;

extracting, from the first audio signal, musical information characterizing at least a portion of the musical content;

generating a second audio signal that has at least one of a rhythmic relationship and a harmonic relationship with the musical information; and

transmitting, substantially immediately after receiving the first audio signal, the second audio signal to an audio output device;

wherein receiving the first audio signal and extracting the musical information are associated with a learning mode, and generating a second audio signal and transmitting the second audio signal are associated with an accompaniment mode; and

wherein, during both the learning mode and the accompaniment mode, the musical information is extracted from the first audio signal substantially continuously.

2. The method of claim 1 , wherein receiving the first audio signal comprises receiving a musical phrase associated with the musical content, and transmitting the second audio signal comprises transmitting, substantially immediately after receiving the musical phrase, the second audio signal to the audio output device.

3. The method of claim 1 , further comprising:

generating a third audio signal that is more complex than the second audio signal and has at least one of a rhythmic relationship and a harmonic relationship with the musical information;

halting transmission of the second audio signal to the audio output device; and

transmitting, substantially immediately after halting transmission of the second audio signal, the third audio signal to the audio output device.

4. The method of claim 1 , further comprising updating musical information corresponding to a portion of the first audio signal received in a most recent period of time having a predetermined length.

5. The method of claim 1 , wherein the first audio signal includes musical content associated with a first type of musical instrument, and the second audio signal includes second musical content associated with a second type of musical instrument.

6. The method of claim 5 , wherein the first type of musical instrument comprises a first stringed instrument, and the second type of musical instrument comprises at least one of a second stringed instrument and a percussive instrument.

7. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, configure the processor to generate accompaniment for musical content included in a received audio signal by performing the steps of:

receiving a first audio signal via an audio input device;

receiving an indication that the first audio signal has been received;

extracting, from the first audio signal, musical information characterizing at least a portion of the musical content;

generating a second audio signal that has at least one of a rhythmic relationship and a harmonic relationship with the musical information; and

transmitting, substantially immediately after receiving the indication, the second audio signal to an audio output device,

wherein receiving the first audio signal and extracting the musical information are associated with a learning mode, and generating a second audio signal and transmitting the second audio signal are associated with an accompaniment mode; and

wherein, during both the learning mode and the accompaniment mode, the musical information is extracted from the first audio signal substantially continuously.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the second audio signal is transmitted no more than 40 milliseconds after receiving the indication.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the second audio signal is transmitted no more than one beat of a musical meter associated with the musical information after receiving the indication.

10. A musical accompaniment device configured to generate accompaniment for musical content included in a received audio signal, the device comprising:

an audio input device;

an audio output device;

a memory; and

a processor that is coupled to the memory and the processor being configured to:

receive a first audio signal via an audio input device; and

extract, from the first audio signal, musical information characterizing at least a portion of the musical content;

receive a musical characteristic associated with the musical information;

generate, based on the musical characteristic, a second audio signal that has at least one of a rhythmic relationship and a harmonic relationship with the musical information; and

transmit, substantially immediately after receiving the first audio signal, the second audio signal to an audio output device,

wherein the processor is further configured to receive the first audio signal and to extract the musical information in a learning mode, and wherein the processor is further configured to generate the second audio signal and to transmit the second audio signal in an accompaniment mode, and

wherein, during both the learning mode and the accompaniment mode, the musical information is extracted from the first audio signal substantially continuously.

11. The musical accompaniment device of claim 10 , wherein the processor is further configured to receive an indication to transition from the learning mode to the accompaniment mode.

12. The musical accompaniment device of claim 11 , wherein the indication comprises at least one of a selection of a user interface (UI) element and closing a switch.

13. The musical accompaniment device of claim 10 , wherein the processor is further configured to update musical information corresponding to a portion of the audio signal received in a most recent period of time having a predetermined length.

14. The musical accompaniment device of claim 10 , wherein the second audio signal includes at least a portion of the first audio signal.

15. The musical accompaniment device of claim 10 , wherein the processor is further configured to:

generate, based on the musical characteristic, a third audio signal that has at least one of a rhythmic relationship and a harmonic relationship with the musical information and includes additional information relative to the second audio signal; and

subsequent to transmitting the second audio signal, transmit the third audio signal to an audio output device.

16. The musical accompaniment device of claim 10 , wherein the musical characteristic comprises at least one of a key signature, a chord, a note pitch, a number of measures or bars, a time signature, a tempo, and a rhythm.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: HARMAN INTERNATIONAL INDUSTRIES INCORPORATED
To: COR-TEK CORPORATION.
Reel/Frame 059800/0904 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNEE NAME TO: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED PREVIOUSLY RECORDED ON REEL 037501 FRAME 0806. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 24, 2017
From: RUTLEDGE, GLEN A.; LUPINI, PETER R.; CAMPBELL, NORM
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 041810/0524 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2016
From: RUTLEDGE, GLEN A.; LUPINI, PETER R.; CAMPBELL, NORM
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 040233/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2016
From: RUTLEDGE, GLEN A.; LUPINI, PETER R.; CAMPBELL, NORM
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATION
Reel/Frame 037501/0806 →