System and method for pitch adjusting vocals
A system and method to assist a singer or other user. An audio source is processed to extract the lead vocals from the audio signal. This vocal signal is fed to a pitch detection processor which estimates the pitch at each moment in time. A user singing into a microphone provides a user vocal signal that is also pitch detected. The pitch of the lead vocal signal and the user vocal signal are compared and any difference is provided to a pitch shifting module, which then can correct the pitch of the user vocal signal. The corrected user vocal signal may be combined with a background signal comprising a signal from the audio source without the lead vocal signal, and then provided to headphones or loudspeakers to the user and/or an audience. This system and method may be used for Karaoke performances.
1. A method performed by a processor, comprising:
receiving a first audio signal;
extracting a vocal signal from the first audio signal;
receiving a second audio signal;
determining a pitch for the second audio signal;
determining a pitch for the extracted vocal signal by limiting a pitch detection range based on the determined pitch of the second audio signal; and
adjusting the pitch of the second audio signal based on a difference between the determined pitch of the extracted vocal signal and the second audio signal.
2. The method of claim 1 wherein the process of extracting a vocal signal from the first audio signal includes producing a third audio signal, the third audio signal comprising the first audio signal without the vocal signal.
3. The method of claim 2 further including combining the third audio signal with the adjusted second audio signal.
4. The method of claim 3 , further including delaying the third audio signal before combining the third audio signal with the adjusted second audio signal.
5. The method of claim 1 wherein the first audio signal is a stereo audio signal, and the process of extracting a vocal signal from the first audio signal includes determining a portion of the first audio signal that is present in both channels of the stereo first audio signal.
6. The method of claim 5 wherein the process of extracting a vocal signal from the first audio signal includes attenuating similar coefficients present in both channels of the stereo first audio signal.
7. The method of claim 1 wherein the second audio signal is a vocal signal from a singer.
8. The method of claim 1 wherein determining a pitch includes determining a pitch value and a reliability value.
9. The method of claim 7 wherein the method is performed as the singer is singing.
10. The method of claim 1 wherein the pitch detection range is limited to within +/− one semitone of the determined pitch of the second audio signal.
11. The method of claim 1 wherein the pitch detection range is dynamically adjusted.
12. An audio processing system comprising:
a vocal extraction component, to receive a first audio signal and produce a second audio signal comprising vocals present in the first audio signal;
a first pitch detection component, to receive the second audio signal and produce a first pitch value indicating a pitch of the second audio signal, wherein the first pitch detection component limits a pitch detection range for the second audio signal based on a detected second pitch value of a third audio signal;
a pitch differencing component, to receive the first pitch value and the second pitch value, and to produce a pitch envelope indicating a difference in pitch between the first pitch value and the second pitch value; and
a pitch shifting component, to receive the pitch envelope and the third audio signal, and produce a pitch-adjusted audio signal comprising the third audio signal with an adjusted pitch based on the pitch envelope.
13. The system of claim 12 , wherein the first audio signal is a stereo audio signal, and the vocal extraction component determines a portion of the first audio signal that is present in both channels of the stereo audio signal.
14. The system of claim 13 wherein the vocal extraction component attenuates similar coefficients present in both channels of the stereo audio signal.
15. The system of claim 12 wherein the vocal extraction component produces a background audio signal comprising the first audio signal without the second audio signal.
16. The system of claim 15 wherein the background audio signal is combined with the pitch-adjusted audio signal.
17. The system of claim 16 wherein the third audio signal is from a singer singing, and the system combines the background audio signal with the pitch-adjusted audio signal while the singer is singing.
18. A computer-readable non-transitory media including executable instructions, wherein when said executable instructions are provided to a processor, cause the processor to perform a method, comprising:
receiving a first audio signal;
extracting a vocal signal from the first audio signal;
receiving a second audio signal;
determining a pitch for the second audio signal;
determining a pitch for the extracted vocal signal by limiting a pitch detection range based on the determined pitch of the second audio signal; and
adjusting the pitch of the second audio signal based on a difference between the determined pitch of the extracted vocal signal and the second audio signal.
19. The computer-readable non-transitory media of claim 18 , further including executable instructions to cause the processor to perform a method wherein the process of extracting a vocal signal from the first audio signal includes producing a third audio signal, the third audio signal comprising the first audio signal without the vocal signal; and
combining the third audio signal with the adjusted second audio signal.
20. The computer-readable non-transitory media of claim 18 , further including executable instructions to cause the processor to perform a method wherein the first audio signal is a stereo audio signal, and the process of extracting a vocal signal from the first audio signal includes determining a portion of the first audio signal that is present in both channels of the stereo first audio signal; and
attenuating similar coefficients present in both channels of the stereo first audio signal.