IP Library Granted Patent US 9,275,616
Granted Patent B2
US 9,275,616 · App. 14/573,237 · Granted Mar 1, 2016

Associating musical score image data and logical musical score data

Inventors: Norihiro Uemura (Hamamatsu, JP); Dan Sasai (Hamamatsu, JP); Motoichi Tamura (Hamamatsu, JP)
Assignee: YAMAHA CORPORATION
G10H1/0008G06K9/00476
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,275,616
App. No.
14/573,237
Granted
Mar 1, 2016
Kind
B2
Abstract

The method analyzes, on the basis of the musical score image data, an image note sequence that is a time series of a plurality of notes included in the image of a musical score of a given music piece, acquires, on the basis of a logical musical score data, a logical note sequence that is a time series of a plurality of notes included in the musical score of the given music piece, and then identifies correspondence relationship between the individual notes in the image note sequence and the individual notes in the logical note sequence by comparing the image note sequence and the logical note sequence. Further, the method displays the musical score image of the given music piece on the basis of the musical score image data, and controls a display state of the displayed image of the musical score by use of the identified correspondence relationship.

Claims (47)

1. A computer-implemented method for analyzing a musical score based on musical score image data representing an image of a musical score of a given music piece and logical musical score data logically representing the musical score of the given music piece, the method comprising:

identifying, based on the musical score image data of a first type file, an image note sequence that is a time series of a plurality of notes included in the image of the musical score of the given music piece;

identifying, based on the logical musical score data of a second type file different from the first type file, a logical note sequence that is a time series of a plurality of notes included in the musical score of the given music piece; and

generating musical score analysis data defining a correspondence relationship between individual ones of the notes in the image note sequence and individual ones of the notes in the logical note sequence by comparing the image note sequence and the logical note sequence,

wherein said comparing the image note sequence and the logical note sequence compares a time series of vector data of the image note sequence and a time series of vector data of the logical note sequence.

2. The computer-implemented method as claimed in claim 1 , wherein said identifying an image note sequence includes extracting a note head of each of the plurality of notes from the image of the musical score, and the image note sequence is identified based on individual ones of the extracted note heads.

3. The computer-implemented method as claimed in claim 2 , wherein said identifying an image note sequence further includes estimating respective pitches of the notes based on the individual note heads extracted thereby.

4. The computer-implemented method as claimed in claim 3 , wherein said identifying an image note sequence further includes extracting, from the image of the musical score, a musical symbol including at least one of a staff notation, a clef and an accidental, and said identifying an image note sequence estimates the respective pitches of the notes by use of the extracted musical symbol.

5. The computer-implemented method as claimed in claim 2 , wherein said identifying an image note sequence further includes partly estimating note values of the individual notes based on types of the extracted note heads.

6. The computer-implemented method as claimed in claim 1 , wherein the image note sequence comprises the time series of vector data each indicating, per pitch, present/absence of a note in a same time segment in the musical score image, and

the logical note sequence comprises the time series of vector data each indicating, per pitch, present/absence of a note in a same time segment graspable from the logical musical score data.

7. The computer-implemented method as claimed in claim 1 , which further comprises:

displaying the image of the musical score of the given music piece based on the musical score image data; and

controlling a display state of the displayed image of the musical score by use of the correspondence relationship.

8. The computer-implemented method as claimed in claim 7 , which further comprises:

reproducing the given music piece based on the logical musical score data; and

controlling a display state of the displayed musical score in accordance with a current reproduced position of the given music piece.

9. The computer-implemented method as claimed in claim 7 , which further comprises changing the musical score image data in accordance with the correspondence relationship and based on any of data included in the logical musical score data.

10. The computer-implemented method as claimed in claim 7 , which further comprises:

editing the logical musical score data; and

changing the musical score image data in accordance with the correspondence relationship and the editing of the logical musical score data.

11. An apparatus for analyzing a musical score based on musical score image data representing an image of a musical score of a given music piece and logical musical score data logically representing the musical score of the given music piece, said apparatus comprising a processor unit configured to:

identify, based on the musical score image data of a first type file, an image note sequence that is a time series of a plurality of notes included in the image of the musical score of the given music piece;

identify, based on the logical musical score data of a second type file different from the first type file, a logical note sequence that is a time series of a plurality of notes included in the musical score of the given music piece; and

generate musical score analysis data defining a correspondence relationship between individual ones of the notes in the image note sequence and individual ones of the notes in the logical note sequence by comparing the image note sequence and the logical note sequence,

wherein said processor unit is configured to compare the image note sequence and the logical note sequence by comparing a time series of vector data of the image note sequence and a time series of vector data of the logical note sequence.

12. The apparatus as claimed in claim 11 , wherein said processor unit is configured to extract a note head of each of the plurality of notes from the image of the musical score, and the image note sequence is identified based on individual ones of the extracted note heads.

13. The apparatus as claimed in claim 12 , wherein said processor unit is further configured to estimate respective pitches of the notes based on the individual extracted note heads.

14. The apparatus as claimed in claim 13 , wherein said processor unit is further configured to extract, from the image of the musical score, a musical symbol including at least one of a staff notation, a clef and an accidental and estimate the respective pitches of the notes by use of the extracted musical symbol.

15. The apparatus as claimed in claim 12 , wherein said processor unit is further configured to partly estimate note values of the individual notes based on types of the extracted note heads.

16. The apparatus as claimed in claim 11 , wherein the image note sequence comprises the time series of vector data each indicating, per pitch, present/absence of a note in a same time segment in the image of the musical score, and

the logical note sequence comprises the time series of vector data each indicating, per pitch, present/absence of a note in a same time segment graspable from the logical musical score data.

17. The apparatus as claimed in claim 11 , which further comprises:

a display device that displays the image of the musical score of the given music piece based on the musical score image data; and

said processor unit is further configured to control a display state of the image of the musical score, displayed on said display device, by use of the correspondence relationship.

18. The apparatus as claimed in claim 17 , which further comprises:

a reproduction device that reproduces the given music piece based on the logical musical score data; and

said processor unit is further configured to control a display state of the musical score, displayed on said display device, in accordance with a current reproduced position of the given music piece.

19. The apparatus as claimed in claim 17 , wherein said processor unit is further configured to change the musical score image data in accordance with the correspondence relationship and based on any of data included in the logical musical score data.

20. The apparatus as claimed in claim 17 , wherein said processor unit is further configured to:

edit the logical musical score data; and

change the musical score image data in accordance with the correspondence relationship and the editing of the logical musical score data.

21. A non-transitory computer-readable storage medium containing a group of instructions executable by a processor unit for performing a method for analyzing a musical score based on musical score image data representing an image of a musical score of a given music piece and logical musical score data logically representing the musical score of the given music piece, the method comprising:

identifying, based on the musical score image data of a first type file, an image note sequence that is a time series of a plurality of notes included in the image of the musical score of the given music piece;

identifying, based on the logical musical score data of a second type file different from the first type file, a logical note sequence that is a time series of a plurality of notes included in the musical score of the given music piece; and

generating musical score analysis data defining a correspondence relationship between individual ones of the notes in the image note sequence and individual ones of the notes in the logical note sequence by comparing the image note sequence and the logical note sequence,

wherein said comparing the image note sequence and the logical note sequence compares a time series of vector data of the image note sequence and a time series of vector data of the logical note sequence.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2015
From: UEMURA, NORIHIRO; SASAI, DAN; TAMURA, MOTOICHI
To: YAMAHA CORPORATION
Reel/Frame 034843/0595 →
Priority Claims (1)
JP 2013-263047 · Dec 19, 2013 · national
Continuity (1)
Related Publication 20150179156A1 · Jun 25, 2015