Information processing system, information processing method, and program
An information processing system includes a state machine and a motion analysis unit. The state machine detects, based on posture information on a target extracted from moving image data, a plurality of phases included in a series of motions of the target. The motion analysis unit analyzes, by using the posture information, the motion of the target for each phase.
1 . An information processing system comprising:
circuitry configured to implement
a state machine configured to detect, based on posture information on a target extracted from moving image data, a plurality of phases included in a series of motions of the target;
a motion analysis unit configured to analyze, by using the posture information, the motion of the target for each phase;
a scene extraction unit configured to extract, from the moving image data, one or more specific frame images for each phase, the one or more specific frame images indicating a specific scene according to the phase; and
a posture information extraction unit configured to extract, from the one or more specific frame images, the posture information on the target for each frame image, wherein
the scene extraction unit is configured to
detect switching to the specific scene based on a posture analysis result of a frame image group before the specific scene, and extract, as the one or more specific frame images, one or more other frame images acquired according to the switching to the specific scene, and
the analysis information includes skeleton information on the target and reference skeleton information serving as a reference of the comparison.
2 . The information processing system according to claim 1 , wherein
the one or more other frame images having higher resolution than resolution of the frame image group.
3 . The information processing system according to claim 2 , wherein
the scene extraction unit is configured to detect the switching to the specific scene based on the motion of the target when the target and a specific object are in a predetermined positional relationship or a change in the positional relationship between the target and the specific object.
4 . The information processing system according to claim 2 , wherein
the scene extraction unit is configured to: extract the posture information on the target by using an analysis model having lower posture estimation accuracy than posture estimation accuracy of an analysis model used by the posture information extraction unit; and detect the switching to the specific scene based on a change in a posture of the target, the posture being estimated from the extracted posture information.
5 . The information processing system according to claim 1 , wherein the circuitry is further configured to implement
an image capturing condition determination unit configured to determine, based on a type of the motion serving as a motion analysis target, an image capturing direction of the target when the moving image data is acquired.
6 . The information processing system according to claim 5 , wherein
the state machine is configured to detect, based on the posture information acquired from a plurality of directions, the plurality of phases included in the series of motions.
7 . The information processing system according to claim 1 , wherein
the motion analysis unit is configured to: score the motion of each phase based on one or more scoring items set for each phase; and generate, based on a scoring result of each phase, analysis information indicating an evaluation result of the series of motions.
8 . The information processing system according to claim 7 , comprising
an output unit configured to pause movement of the target for each phase and to display the analysis information together with a still image of the target in the phase.
9 . The information processing system according to claim 8 , wherein
the analysis information includes information indicating comparison with a target motion.
10 . The information processing system according to claim 9 , wherein
the analysis information includes information indicating a guideline to bring the motion of the target close to the target motion.
11 . The information processing system according to claim 8 , wherein
the analysis information includes information indicating comparison with a past motion of the target.
12 . The information processing system according to claim 11 , wherein
the analysis information includes current skeleton information on the target and past skeleton information on the target, the past skeleton information serving as a reference of the comparison.
13 . The information processing system according to claim 12 , wherein
the output unit is configured to display the current skeleton information on the target and the past skeleton information on the target at a timing when a difference exceeding an allowable reference is generated between the current skeleton information on the target and reference skeleton information indicating a target motion.
14 . The information processing system according to claim 13 , wherein
the output unit is configured to highlight and display a portion of a skeleton of the target, the portion being a portion at which the current skeleton information on the target and the reference skeleton information are different from each other beyond the allowable reference.
15 . The information processing system according to claim 7 , wherein
the analysis information includes information indicating a transition of a scoring result for each scoring item of each phase from the past to the present.
16 . The information processing system according to claim 7 , comprising
an intervention information generation unit configured to generate intervention information for the target based on the analysis information.
17 . The information processing system according to claim 16 , wherein
the intervention information includes determination information serving as a determination material used to encourage the target to improve the motion or a training plan of the target.
18 . The information processing system according to claim 16 , wherein
the intervention information generation unit is configured to generate authentication information used to authenticate a current level of the target.
19 . The information processing system according to claim 1 , wherein
the output unit is configured to selectively display, as the skeleton information on the target and the reference skeleton information, information on a skeleton corresponding to a portion of the target to be analyzed in the phase.
20 . The information processing system according to claim 1 wherein
the output unit is configured to display the skeleton information on the target and the reference skeleton information at a timing when a difference exceeding an allowable reference is generated between the skeleton information on the target and the reference skeleton information.
21 . The information processing system according to claim 1 wherein
the output unit is configured to highlight and display a portion of a skeleton of the target, the portion being a portion at which the skeleton information on the target and the reference skeleton information are different from each other beyond an allowable reference.
22 . The information processing system according to claim 1 , wherein
the state machine is configured to detect the plurality of phases based on a determination method for each phase stored in an index database.
23 . The information processing system according to claim 22 , wherein
the motion analysis unit is configured to analyze the motion of the target for each phase based on a scoring item for each phase stored in the index database and a scoring reference.
24 . The information processing system according to claim 22 , wherein
the index database stores, as an index of motion analysis, one or more pieces of information among an image capturing condition of a moving image, a phase definition, a specific scene serving as a target to be analyzed, a scoring item, and a scoring reference for each determination item.
25 . The information processing system according to claim 24 , wherein
the determination item is associated with a type of exercise serving as a target of the motion analysis.
26 . The information processing system according to claim 1 , wherein
the motion analysis unit is configured to transmit an evaluation result of the series of motions to a terminal or a server owned by an intervener who intervenes in the target.
27 . An information processing method executed by a computer, the information processing method comprising:
detecting, based on posture information on a target extracted from moving image data, a plurality of phases included in a series of motions of the target;
analyzing, by using the posture information, the motion of the target for each phase;
extracting, from the moving image data, one or more specific frame images for each phase, the one or more specific frame images indicating a specific scene according to the phase;
and
extracting, from the one or more specific frame images, the posture information on the target for each frame image, wherein
the extracting one or more specific frame images for each phase includes detecting switching to the specific scene based on a posture analysis result of a frame image group before the specific scene, and extracting, as the one or more specific frame images, one or more other frame images acquired according to the switching to the specific scene, and
the analysis information includes skeleton information on the target and reference skeleton information serving as a reference of the comparison.
28 . A non-transitory computer readable storage having instructions contained therein that when executed by a processor cause the processor to perform a method, the method comprising:
detecting, based on posture information on a target extracted from moving image data, a plurality of phases included in a series of motions of the target; and
analyzing, by using the posture information, the motion of the target for each phase;
extracting, from the moving image data, one or more specific frame images for each phase, the one or more specific frame images indicating a specific scene according to the phase;
and
extracting, from the one or more specific frame images, the posture information on the target for each frame image, wherein
the extracting one or more specific frame images for each phase includes detecting switching to the specific scene based on a posture analysis result of a frame image group before the specific scene, and extracting, as the one or more specific frame images, one or more other frame images acquired according to the switching to the specific scene, and
the analysis information includes skeleton information on the target and reference skeleton information serving as a reference of the comparison.