Musical score position estimating device, musical score position estimating method, and musical score position estimating robot
A musical score position estimating device includes an audio signal acquiring unit, a musical score information acquiring unit acquiring musical score information corresponding to an audio signal acquired by the audio signal acquiring unit, an audio signal feature extracting unit extracting a feature amount of the audio signal, a musical score feature extracting unit extracting a feature amount of the musical score information, a beat position estimating unit estimating a beat position of the audio signal, and a matching unit matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal.
1. A musical score position estimating device comprising:
an audio signal acquiring unit;
a musical score information acquiring unit acquiring musical score information corresponding to an audio signal acquired by the audio signal acquiring unit;
an audio signal feature extracting unit extracting a feature amount of the audio signal;
a musical score feature extracting unit extracting a feature amount of the musical score information;
a beat position estimating unit estimating a beat position of the audio signal; and
a matching unit matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal,
wherein the musical score feature extracting unit calculates rareness which is an appearance frequency of a musical note from the musical score information, and
wherein the matching unit makes a match using the rareness.
2. The musical score position estimating device according to claim 1 , wherein the matching unit makes a match on the basis of the product of the calculated rareness, the extracted feature amount of the audio signal, and the extracted feature amount of the musical score information.
3. The musical score position estimating device according to claim 1 , wherein the rareness is the lowness in appearance frequency of a musical note in the musical score information.
4. The musical score position estimating device according to claim 1 , wherein the audio signal feature extracting unit extracts the feature amount of the audio signal using a chroma vector, and
wherein the musical score feature extracting unit extracts the feature amount of the musical score information using a chroma vector.
5. The musical score position estimating device according to claim 1 , wherein the audio signal feature extracting unit weights a high-frequency component in the extracted feature amount of the audio signal and calculates an onset time of a musical note on the basis of the weighted feature amount, and
wherein the matching unit makes a match using the calculated onset time of the musical note.
6. The musical score position estimating device according to claim 1 , wherein the beat position estimating unit estimates the beat position by switching a plurality of different observation error models using a switching Kalman filter.
7. A musical score position estimating method comprising:
an audio signal acquiring step of acquiring an audio signal;
a musical score information acquiring step of acquiring musical score information corresponding to the acquired audio signal;
an audio signal feature extracting step of extracting a feature amount of the audio signal;
a musical score information feature extracting step of extracting a feature amount of the musical score information;
a beat position estimating step of estimating a beat position of the audio signal; and
a matching step of matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal,
wherein, in the musical score information feature extracting step, rareness, which is an appearance frequency of a musical note, is calculated from the musical score information, and
wherein, in the matching step, matching is performed using the rareness.
8. A musical score position estimating robot comprising:
an audio signal acquiring unit;
an audio signal separating unit extracting an audio signal corresponding to a performance by performing a suppression process on the audio signal acquired by the audio signal acquiring unit;
a musical score information acquiring unit acquiring musical score information corresponding to the audio signal extracted by the audio signal separating unit;
an audio signal feature extracting unit extracting a feature amount of the audio signal extracted by the audio signal separating unit;
a musical score feature extracting unit extracting a feature amount of the musical score information;
a beat position estimating unit estimating a beat position of the audio signal extracted by the audio signal separating unit; and
a matching unit matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal,
wherein the musical score feature extracting unit calculates rareness which is an appearance frequency of a musical note from the musical score information, and
wherein the matching unit makes a match using the rareness.
9. A musical score position estimating device comprising:
an audio signal acquiring unit;
a musical score information acquiring unit acquiring musical score information corresponding to an audio signal acquired by the audio signal acquiring unit;
an audio signal feature extracting unit extracting a feature amount of the audio signal;
a musical score feature extracting unit extracting a feature amount of the musical score information;
a beat position estimating unit estimating a beat position of the audio signal; and
a matching unit matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal,
wherein the audio signal feature extracting unit extracts the feature amount of the audio signal using a chroma vector, and
wherein the musical score feature extracting unit extracts the feature amount of the musical score information using a chroma vector.
10. A musical score position estimating device comprising:
an audio signal acquiring unit;
a musical score information acquiring unit acquiring musical score information corresponding to an audio signal acquired by the audio signal acquiring unit;
an audio signal feature extracting unit extracting a feature amount of the audio signal;
a musical score feature extracting unit extracting a feature amount of the musical score information;
a beat position estimating unit estimating a beat position of the audio signal; and
a matching unit matching the feature amount of the audio signal with the feature amount of the musical score information using the estimated beat position to estimate a position of a portion in the musical score information corresponding to the audio signal, wherein
the beat position estimating unit estimates the beat position by switching a plurality of different observation error models using a switching Kalman filter.