Vocal processing with accompaniment music input
Systems, including methods and apparatus, for generating audio effects based on accompaniment audio produced by live or pre-recorded accompaniment instruments, in combination with melody audio produced by a singer. Audible broadcast of the accompaniment audio may be delayed by a predetermined time, such as the time required to determine chord information contained in the accompaniment signal. As a result, audio effects that require the chord information may be substantially synchronized with the audible broadcast of the accompaniment audio. The present teachings may be especially suitable for use in karaoke systems, to correct and add sound effects to a singer's voice that sings along with a pre-recorded accompaniment track.
1. A method of generating a musical harmony signal, comprising:
scanning a pre-recorded song stored in digital form on an electronic device;
analyzing the pre-recorded song to determine a musical key of the pre-recorded song;
receiving a melody note from a singer;
generating a harmony signal harmonized to the musical key of the pre-recorded song and the melody note;
transmitting the harmony signal to an output mechanism to produce output harmony audio;
streaming an accompaniment audio signal corresponding to the pre-recorded song to the output mechanism after a predetermined delay time has elapsed to produce accompaniment audio;
wherein determining the musical key of the pre-recorded song requires a first duration of time, and wherein the predetermined delay time is at least equal to the first duration of time.
2. The method of claim 1 , wherein the melody note is received in real time from a karaoke singer.
3. The method of claim 1 , wherein the harmony signal is produced substantially in real time with receiving the melody note.
4. The method of claim 1 , wherein the predetermined delay time approximates the first duration of time.
5. The method of claim 1 , further comprising transmitting the melody note to the output mechanism.
6. The method of claim 5 , wherein the output mechanism is a loudspeaker.
7. The method of claim 5 , wherein the output mechanism is an output jack.
8. The method of claim 1 , further comprising:
creating a pitch-corrected melody note by shifting the melody note received from the singer into the musical key of the pre-recorded song; and
transmitting the pitch-corrected melody note to the output mechanism.
9. The method of claim 1 , wherein the predetermined delay time exceeds the first duration of time by a time required to generate the harmony signal after receiving the melody note.
10. A harmony generating method, comprising:
causing a digital signal processor to:
(i) analyze a pre-recorded song stored in digital form on an electronic device, to determine chord information contained within the pre-recorded song;
(ii) after a time at least equal to the time required to determine the chord information, transmit an accompaniment audio signal corresponding to the pre-recorded song to an audio output mechanism;
(iii) receive a melody audio signal produced by a singer's voice;
(iv) generate at least one harmony note based on the chord information and the melody audio signal; and
(v) transmit the melody audio signal and the harmony note to the audio output mechanism.
11. The method of claim 10 , wherein the audio output mechanism is a loudspeaker.
12. The method of claim 10 , wherein the audio output mechanism is an output jack.
13. The method of claim 10 , wherein the accompaniment audio signal, the melody audio signal and the harmony note are transmitted to the audio output mechanism substantially simultaneously.
14. The method of claim 10 , wherein generating the harmony note is based on the chord information excluding chord changes of less than a predetermined duration and also excluding chords determined to have been produced by percussion instruments.
15. A method of generating harmonized audio signals with a digital signal processor, comprising:
with a digital signal processor, analyzing a pre-recorded digital song to determine key information associated with the song;
with the digital signal processor, receiving a melody note produced by a singer, and generating a synthesized harmony signal harmonized to the melody note and a corresponding key of the pre-recorded song; and
transmitting the pre-recorded song, the melody note and the synthesized harmony signal to an output mechanism to produce synthesized harmony audio, wherein the pre-recorded song, the melody note and the corresponding synthesized harmony audio are synchronized when produced by the output mechanism.
16. The method of claim 15 , wherein the key information includes key changes, and wherein the digital signal processor is configured to ignore key changes lasting less than a predetermined threshold duration.
17. The method of claim 15 , wherein the output mechanism is a speaker.
18. The method of claim 15 , wherein the output mechanism is an output jack.
19. The method of claim 15 , further comprising storing the pre-recorded song in memory for at least a time required to generate the synthesized harmony signal.
20. The method of claim 15 , further comprising:
creating a pitch-corrected melody note by shifting the melody note received from the singer into the corresponding key of the pre-recorded song; and
transmitting the pitch-corrected melody note to the output mechanism.