Foot shape measurement apparatus and computer program

1 . A foot shape measurement apparatus comprising:

an imaging unit;

a display controller;

one or more processors; and

a predetermined reference sheet to be imaged together with a foot of a subject to detect a reference length in an augmented reality space, wherein

the one or more processors is configured to set the augmented reality space, based on an image captured by the imaging unit,

the display controller structured to display, on a screen, the image captured by the imaging unit and a guide object to be arranged in the augmented reality space and to guide an imaging procedure, and

the one or more processors is configured to acquire a plurality of foot images that have been captured by the imaging unit imaging the foot of the subject from a plurality of angles,

generate a three-dimensional model of the foot of the subject, based on the plurality of foot images, and

output a measurement result based on the three-dimensional model that has been generated, wherein

the display controller displays, as the guide object, a target mark and a state mark to be superimposed on a visual being captured by the imaging unit, the target mark indicating a viewpoint position in which an imaging viewpoint of the imaging unit in the augmented reality space forms a predetermined angle to the foot of the subject, the state mark indicating a current state of the imaging viewpoint of the imaging unit in the augmented reality space,

the one or more processors acquires, as the foot image that has been captured from the predetermined angle, the image to be captured when the imaging viewpoint by the imaging unit in the augmented reality space is present in the imaging viewpoint by which a display state of the target mark and a display state of the state mark each satisfy a predetermined condition, and

the display controller displays a first foot shape mark to be superimposed, and also displays a second foot shape mark, the first foot shape mark indicating an area for placing one of feet to be measured in a predetermined position of the reference sheet that has been imaged by the imaging unit, the second foot shape mark indicating a position of the other one of the feet such that a gravity center position of the subject falls within a base of support when the imaging viewpoint becomes the predetermined angle to the foot of the subject, as a position outside the reference sheet that is preferable for placing the other one of the feet not to be measured.

2 . The foot shape measurement apparatus according to claim 1 , wherein a direction suggesting mark is displayed in a supplemental manner on the first state mark and the second target mark, the direction suggesting mark indicating a direction from the imaging viewpoint by the imaging unit toward the foot of the subject.

3 . The foot shape measurement apparatus according to claim 1 , wherein

the one or more processors stores a coordinate group of anatomical feature points of an average foot in a three-dimensional space beforehand as a three-dimensional homology model, the three-dimensional homology model including a predetermined number of contour points that have been defined beforehand, detects a contour from the foot image, moves a contour of the three-dimensional homology model toward the contour that has been detected to a position for minimizing a total sum of positional differences between the contour points and detected points included in the contour that has been detected, and brings the three-dimensional homology model in close proximity to the contour that has been detected, and

the contour of the foot in the three-dimensional homology model includes a first part having a relatively large individual difference and a second part having a small individual difference, and the predetermined number of contour points defined in the three-dimensional homology model are defined such that a space between contour points in the second part is wider than a space between contour points in the first part.

4 . The foot shape measurement apparatus according to claim 1 , wherein

the one or more processors stores a coordinate group of anatomical feature points of an average foot in a three-dimensional space beforehand as a three-dimensional homology model, the three-dimensional homology model including a predetermined number of contour points that have been defined beforehand, detects a contour from the foot image, moves a contour of the three-dimensional homology model toward the contour that has been detected to a position for minimizing a total sum of positional differences between the contour points and detected points included in the contour that has been detected, and brings the three-dimensional homology model in close proximity to the contour that has been detected,

the contour of the foot in the three-dimensional homology model includes a plurality of points to be measured as a predetermined part size, and

the one or more processors brings a contour point closer to the plurality of points to be measured among the predetermined number of contour points in the three-dimensional homology model in closer proximity to a detected point on a priority basis to make a positional difference from the detected point smaller.

5 . The foot shape measurement apparatus according to claim 1 , wherein

the one or more processors stores a coordinate group of anatomical feature points of an average foot in a three-dimensional space beforehand as a three-dimensional homology model, the three-dimensional homology model including a predetermined number of contour points that have been defined beforehand, detects a contour from the foot image, moves a contour of the three-dimensional homology model toward the contour that has been detected to a position for minimizing a total sum of positional differences between the contour points and detected points included in the contour that has been detected, and brings the three-dimensional homology model in close proximity to the contour that has been detected, and

the one or more processors performs convex hull processing of omitting a convexity defect corresponding to a shape between toes in the contour that has been detected, and also brings the three-dimensional homology model in close proximity to the contour that has been detected to minimize the total sum of the positional differences between the contour points and detected points included in the contour, after the convex hull processing is performed.

6 . The foot shape measurement apparatus according to claim 1 , further comprising

a predetermined reference sheet that is a sheet to be imaged together with the foot of the subject to detect a reference length in the augmented reality space, the predetermined reference sheet including a first area and a second area, the first area being formed in a predetermined color that is likely to have a complementary color relationship to a color of the foot, as an area for placing the foot of the subject, the second area including a plurality of reference markers each having a predetermined shape to be referred to and to be arranged for detecting position coordinates, wherein

the one or more processors recognizes a position of the reference sheet in the image obtained by image recognition of the image that has been captured by the imaging unit, and sets the augmented reality space with the position of the reference sheet that has been recognized as a reference, and

the one or more processors detects a color component range of the predetermined color included in the reference sheet that has been recognized from the image captured by the imaging unit before generation of the three-dimensional model, and recognizes a boundary between the foot of the subject and the first area from the foot image, based on the color component range that has been detected, and detects a contour of the foot of the subject.

7 . The foot shape measurement apparatus according to claim 1 , wherein the display controller indicates that a position of a current imaging viewpoint satisfies the predetermined condition when positions and sizes of the first state mark and the first target mark become substantially identical.

8 . A non-transitory computer-readable storage medium storing a computer program that, when executed by one or more processors, causes the one or more processors to perform:

a function of setting an augmented reality space, based on an image captured by a predetermined imaging unit;

a function of displaying, on a screen, the image captured and a guide object arranged in the augmented reality space to guide an imaging procedure;

a function of acquiring a plurality of foot images that have been captured by imaging a foot of a subject from a plurality of angles;

a function of generating a three-dimensional model of the foot of the subject, based on the plurality of foot images; and

a function of outputting a measurement result based on the three-dimensional model that has been generated, wherein

the function of displaying displays, as the guide object, a target mark and a state mark to be superimposed on a visual being captured, the target mark indicating a viewpoint position in which an imaging viewpoint by the predetermined imaging unit in the augmented reality space forms a predetermined angle to the foot of the subject, the state mark indicating a current state of the imaging viewpoint by the predetermined imaging unit in the augmented reality space,

the function of acquiring acquires, as the foot image that has been captured from the predetermined angle, the image to be captured when the imaging viewpoint by the predetermined imaging unit in the augmented reality space is present in the imaging viewpoint by which a display state of the target mark and a display state of the state mark each satisfy a predetermined condition, and

the function of displaying displays a first foot shape mark to be superimposed, and also displays a second foot shape mark, the first foot shape mark indicating an area for placing one of feet to be measured in a predetermined position of a reference sheet that has been imaged together with the foot of the subject to detect a reference length in the augmented reality space by the imaging unit, the second foot shape mark indicating a position of the other one of the feet such that a gravity center position of the subject falls within a base of support when the imaging viewpoint becomes the predetermined angle to the foot of the subject, as a position outside the reference sheet that is preferable for placing the other one of the feet not to be measured.

9 . The non-transitory computer-readable storage medium according to claim 8 , wherein the computer program causes the one or more processors to perform a function of indicating that a position of a current imaging viewpoint satisfies the predetermined condition when positions and sizes of the first state mark and the first target mark become substantially identical.