Motion information display apparatus and method
View Patent ↗A motion information display apparatus according to an embodiment includes obtaining circuitry, identifying circuitry, and display controlling circuitry. The obtaining circuitry obtains a plurality of pieces of moving image information, and motion information that indicates a motion of a subject included in each of the moving image information. The identifying circuitry identifies a frame corresponding to a timing of a predetermined motion, from each frame group included in each of the moving image information, based on the motion information. The display controlling circuitry performs display control of the plurality of pieces of moving image information, using the frame corresponding to a timing of a predetermined motion.
1. A motion information display apparatus comprising:
processing circuitry configured to
obtain a first moving image of a first subject moving in a periodic manner, first motion information that indicates chronological change of a position of a characteristic point corresponding to a joint of the first subject in the first moving image, a second moving image of a second subject moving in a periodic manner, and second motion information that indicates chronological change of a position of a characteristic point corresponding to a joint of the second subject in the second moving image;
retrieve, from storage, definition information for defining a characteristic motion;
identify, by analyzing the first moving image based on the first motion information, a first frame corresponding to a timing when the first subject performed the characteristic motion corresponding to the definition information, from each frame group included in the first moving image;
identify, by analyzing the second moving image based on the second motion information, a second frame corresponding to a timing when the second subject performed the characteristic motion corresponding to the definition information from each frame group included in the second moving image;
cause play back of the first moving image and the second moving image to have respective timings of the play back that accord with each other, using the first frame and the second frame;
display a first graph showing the chronological change in the position of the characteristic point of the first subject, based on the first motion information;
display, on the first graph, a first marker showing a timing of motions corresponding to the first frame;
display a second graph showing the chronological change in the position of the characteristic point of the second subject, based on the second motion information; and
display, on the second graph, a second marker showing a timing of motions corresponding to the second frame.
2. The motion information display apparatus according to claim 1 , wherein the processing circuitry is further configured to
obtain coordinates of the characteristic point in the first subject, as the first motion information,
obtain coordinates of the characteristic point in the second subject, as the second motion information,
identify the first frame based on the coordinates of the characteristic point in the first subject, and
identify the second frame based on the coordinates of the characteristic point in the second subject.
3. The motion information display apparatus according to claim 1 , wherein
the processing circuitry is further configured to identify the first frame and the second frame, according to at least one of a type of rehabilitation and a purpose of rehabilitation.
4. The motion information display apparatus according to claim 1 , wherein the processing circuitry is further configured to cause the play back of the first moving image and the second moving image to accord with each other by using parallel display or superimposition display to cause the timings of the playback to approximately accord with each other between the first moving image and the second moving image, using the first frame and the second frame.
5. The motion information display apparatus according to claim 1 , wherein the processing circuitry is further configured to
identify a size of the subject included in each of the first and second motion information, and
cause the play back of the first moving image and the second moving image to accord with each other by causing the sizes of the first subject and the second subject to approximately accord with each other between the first and second moving images, using the sizes of the first subject and the second subject.
6. The motion information display apparatus according to claim 1 , wherein the processing circuitry is further configured to cause the play back of the first moving image and the second moving image after translating and/or rotating at least one of the first moving image and the second moving image to cause directions of the first subject and the second subject to accord with each other between the first moving image and the second moving image.
7. The motion information display apparatus according to claim 1 , wherein when causing the play back of the first moving image and the second moving image, the processing circuitry is further configured to display first skeleton information of the first subject included in the first moving image and second skeleton information of the second subject included in the second moving image.
8. A motion information display method comprising:
obtaining a first moving image of a first subject moving in a periodic manner, and first motion information that indicates chronological change of a position of a characteristic point corresponding to a joint of the first subject in the first moving image, a second moving image of a second subject moving in a periodic manner, and second motion information that indicates chronological change of a position of a characteristic point corresponding to a joint of the second subject in the second moving image;
retrieving, from storage, definition information for defining a characteristic motion;
identifying, by analyzing the first moving image based on the first motion information, a first frame corresponding to a timing when the first subject performed the characteristic motion corresponding to the definition information, from each frame group included in the first moving image;
identifying, by analyzing the second moving image based on the second motion information, a second frame corresponding to a timing when the second subject performed the characteristic motion corresponding to the definition information, from each frame group included in the second moving image;
causing play back of the first moving image and the second moving image to have respective timings of the play back that accord with each other, using the first frame and the second frame;
displaying a first graph showing the chronological change in the position of the characteristic point of the first subject, based on the first motion information;
displaying, on the first graph, a first marker showing a timing of motions corresponding to the first frame;
displaying a second graph showing the chronological change in the position of the characteristic point of the second subject, based on the second motion information; and
displaying, on the second graph, a second marker showing a timing of motions corresponding to the second frame.
9. The motion information display apparatus according to claim 1 , wherein the first motion and the second motion are defined by at least one of positional relationship between a plurality of characteristic points of a human body and chronological change of position of a characteristic point of the human body.