AUTOMATIC FRONTAL-VIEW GAIT SEGMENTATION FOR ABNORMAL GAIT QUANTIFICATION
A computer-implemented method for gait analysis of a subject includes obtaining visual data from an image capture device positioned in front of or behind the subject, the visual data comprising at least two image frames of the subject over a period of time walking toward or away from the image capture device, the at least two image frames capturing at least a portion of the gait of the subject, detecting within the at least two images body parts as two-dimensional landmarks using a pose estimation algorithm on each of the at least two frames, generating a joint model depicting the location of the at least one joint in each of the at least two frames, using the joint model to segment a gait cycle for the at least one joint, and comparing the gait cycle to a threshold value to detect abnormal gait.
1 . A computer-implemented method for gait analysis of a subject comprising:
obtaining visual data from an image capture device positioned in front of or behind the subject, the visual data comprising at least two image frames of the subject over a period of time walking toward or away from the image capture device, the at least two image frames capturing at least a portion of the gait of the subject;
detecting within the at least two images body parts as two-dimensional landmarks using a pose estimation algorithm on each of the at least two frames;
generating a joint model depicting the location of the at least one joint in each of the at least two frames;
using the joint model to segment a gait cycle for the at least one joint; and
comparing the gait cycle to a threshold value to detect abnormal gait.
2 . The computer-implemented method for gait analysis of a subject as set forth in claim 1 , further comprising, prior to generating the joint model, estimating a three-dimensional shape of the subject using the two-dimensional landmarks, and estimating the at least one joint location based on the three-dimensional shape.
3 . The computer-implemented method for gait analysis of a subject as set forth in claim 1 , wherein the joint model includes a deformable parts model.
4 . The computer-implemented method for gait analysis of a subject as set forth in claim 1 , wherein the at least one joint includes an ankle, a knee, a hip, or other joint.
5 . The computer-implemented method for gait analysis of a subject as set forth in claim 4 , wherein the gait cycle includes a distance between two consecutive peaks in a trajectory of a joint.
6 . The computer-implemented method for gait analysis of a subject as set forth in claim 4 , wherein the gait cycle includes a distance between consecutive peaks in an angle of a joint or body part.
7 . The computer-implemented method for gait analysis of a subject as set forth in claim 1 , wherein the obtaining visual data from an image capture device includes using a camera mounted in an elongated hallway in which the subject can walk toward and away from the camera.
8 . A system for gait analysis of a subject comprising:
an image capture device operatively coupled to a data processing device and positioned in front of or behind the subject, the image capture device configured to capture visual data comprising at least two image frames of the subject over a period of time walking toward or away from the image capture device, the at least two image frames capturing at least a portion of the gait of the subject;
a processor-usable medium embodying computer code, said processor-usable medium being coupled to said data processing device, said computer code comprising instructions executable by said data processing device and configured for:
detecting within the at least two images body parts as two-dimensional landmarks using a pose estimation algorithm on each of the at least two frames;
generating a joint model depicting the location of the at least one joint in each of the at least two frames;
using the joint model to segment a gait cycle for the at least one joint; and
comparing the gait cycle to a threshold value to detect abnormal gait.
9 . The system set forth in claim 8 , wherein the instructions further comprise, prior to generating the joint model, estimating a three-dimensional shape of the subject using the two-dimensional landmarks, and estimating the at least one joint location based on the three-dimensional shape.
10 . The system set forth in claim 8 , wherein the joint model includes a deformable parts model.
11 . The system set forth in claim 8 , wherein the at least one joint includes an ankle, a knee, a hip, or other joint.
12 . The system set forth in claim 11 , wherein the gait cycle includes a distance between two consecutive peaks in a trajectory of a joint.
13 . The system set forth in claim 11 , wherein the gait cycle includes a distance between consecutive peaks in an angle of a joint or body part.
14 . The system set forth in claim 8 , the image capture device is mounted in an elongated hallway in which the subject can walk toward and away from the camera.
15 . A non-transitory computer-usable medium for gait analysis of a subject, said computer-usable medium embodying a computer program code, said computer program code comprising computer executable instructions configured for:
obtaining visual data from an image capture device positioned in front of or behind the subject, the visual data comprising at least two image frames of the subject over a period of time walking toward or away from the image capture device, the at least two image frames capturing at least a portion of the gait of the subject;
detecting within the at least two images body parts as two-dimensional landmarks using a pose estimation algorithm on each of the at least two frames;
generating a joint model depicting the location of the at least one joint in each of the at least two frames;
using the joint model to segment a gait cycle for the at least one joint; and
comparing the gait cycle to a threshold value to detect abnormal gait.
16 . The non-transitory computer-usable medium as set forth in claim 15 , wherein the instructions further comprise, prior to generating the joint model, estimating a three-dimensional shape of the subject using the two-dimensional landmarks, and estimating the at least one joint location based on the three-dimensional shape.
17 . The non-transitory computer-usable medium as set forth in claim 15 , wherein the joint model includes a deformable parts model.
18 . The non-transitory computer-usable medium as set forth in claim 15 , wherein the at least one joint includes an ankle, a knee, a hip, or other joint.
19 . The non-transitory computer-usable medium as set forth in claim 18 , wherein the gait cycle includes a distance between two consecutive peaks in a trajectory of a joint or a distance between consecutive peaks in an angle of a joint or body part.
20 . The non-transitory computer-usable medium as set forth in claim 15 , wherein the obtaining visual data from an image capture device includes using a camera mounted in an elongated hallway in which the subject can walk toward and away from the camera.