Vocal processing with accompaniment music input
Systems, including methods and apparatus, for generating audio effects based on accompaniment audio produced by live or pre-recorded accompaniment instruments, in combination with melody audio produced by a singer. Audible broadcast of the accompaniment audio may be delayed by a predetermined time, such as the time required to determine chord information contained in the accompaniment signal. As a result, audio effects that require the chord information may be substantially synchronized with the audible broadcast of the accompaniment audio. The present teachings may be especially suitable for use in karaoke systems, to correct and add sound effects to a singer's voice that sings along with a pre-recorded accompaniment track.
1. A time-aligned audio system for harmony generation, comprising:
a chord detection circuit configured to receive and analyze an accompaniment audio signal and to determine chord information corresponding to the accompaniment audio signal;
a harmony processing circuit configured to identify errors in the chord information, to determine a chord of the accompaniment audio signal while ignoring the errors, to produce a harmony signal harmonized to the chord of the accompaniment audio signal, and to transmit the harmony signal to a loudspeaker; and
a delay circuit configured to store the accompaniment audio signal in memory until the harmony signal is transmitted to the loudspeaker, and to transmit the accompaniment audio signal to the loudspeaker substantially simultaneously with the harmony signal;
wherein the errors in the chord information are chosen from the set consisting of short-term chord changes lasting less than a predetermined amount of time, sequential key changes, and sounds produced by percussion instruments.
2. The audio system of claim 1 , wherein the harmony signal is also harmonized to a melody note.
3. The audio system of claim 1 , wherein the delay circuit is further configured to store in memory a melody audio signal corresponding to the accompaniment signal until the harmony signal is transmitted to the loudspeaker, and to transmit the melody audio signal to the loudspeaker substantially simultaneously with the harmony signal and the accompaniment audio signal.
4. The audio system of claim 1 , wherein the chord detection circuit is further configured to receive and analyze a melody note sung by a singer, and the harmony generation circuit is configured to produce the harmony signal harmonized to both the melody note and the chord of the accompaniment audio signal.
5. The audio system of claim 4 , wherein the harmony generation circuit is configured to identify a pitch error in the melody note, to generate a pitch-corrected melody note, and to produce the harmony signal harmonized to the pitch-corrected melody note.
6. The audio system of claim 1 , wherein the harmony generation circuit is configured to identify short-term chord changes lasting less than a predetermined amount of time as errors.
7. The audio system of claim 1 , wherein the harmony generation circuit is configured to identify sequential key changes as errors.
8. A time-aligned audio system for harmony generation, comprising:
a digital signal processor configured to:
receive a melody audio signal produced by a singer,
detect melody notes within the melody audio signal,
determine whether the melody notes include one or more pitch errors,
produce a harmony signal harmonized to the melody notes and an accompaniment audio signal while ignoring the errors,
transmit the harmony signal to a loudspeaker,
store the melody audio signal in memory until the harmony signal has been produced, and
transmit a version of the melody audio signal to the loudspeaker substantially simultaneously with the harmony signal.
9. The audio system of claim 8 , wherein the digital signal processor is configured to correct the errors by creating corresponding pitch-corrected melody notes and wherein the version of the melody audio signal transmitted to the loudspeaker is a corrected version including the pitch-corrected melody notes.
10. The audio system of claim 9 , wherein the digital signal processor is configured to determine a musical key of the accompaniment audio signal and to create the pitch-corrected melody notes by shifting the melody notes received from the singer into the musical key of the accompaniment audio signal.
11. The audio system of claim 8 , wherein the digital signal processor is configured to determine whether the accompaniment audio signal includes one or more errors, and wherein ignoring the errors includes ignoring the errors in both the melody notes and the accompaniment signal.
12. The audio system of claim 11 , wherein the digital signal processor is configured to determine that short-term chord changes lasting less than a predetermined amount of time are errors in the accompaniment signal.
13. The audio system of claim 12 , wherein the digital signal processor is configured to determine that sequential key changes are errors in the accompaniment signal.
14. The audio system of claim 8 , wherein the digital signal processor is configured to store the accompaniment signal in memory until the harmony signal has been produced, and to transmit the accompaniment audio signal to the loudspeaker substantially simultaneously with the harmony signal.
15. A method of generating a time-aligned, harmonized musical signal, comprising:
determining melody notes within a melody audio signal,
determining chords within an accompaniment audio signal,
analyzing at least one of the audio signals to identify errors,
producing a harmony signal harmonized only to the melody notes and the chords which do not include the identified errors,
storing the melody audio signal and the accompaniment audio signal until the harmony signal has been produced, and
transmitting a version of the melody audio signal, a version of the accompaniment audio signal and the harmony signal to a loudspeaker substantially simultaneously;
wherein errors identified in the melody audio signal are pitch errors, and errors identified in the accompaniment audio signal are chosen from the set consisting of short-term chord changes lasting less than a predetermined amount of time, sequential key changes, and sounds produced by percussion instruments.
16. The method of claim 15 , wherein the step of analyzing includes analyzing the melody audio signal to identify melody notes that contain a pitch error.
17. The method of claim 16 , wherein the transmitted version of the melody audio signal includes pitch-shifted melody notes in place of melody notes identified to contain a pitch error.
18. The method of claim 16 , wherein the transmitted version of the melody audio signal includes both pitch-shifted melody notes and original melody notes identified to contain a pitch error.
19. The method of claim 15 , wherein the step of analyzing includes analyzing the accompaniment audio signal to identify as errors short-term chord changes lasting less than a predetermined amount of time.
20. The method of claim 15 , wherein the step of analyzing includes analyzing the accompaniment audio signal to identify as errors sounds produced by percussion instruments.