Hinge detection for orthopedic fixation
View Patent ↗First and second images are displayed of anatomical structure segments with an attached fixator. Indications may be received of first image hinge locations of a plurality of hinges of the fixator in the first image. Projected second image hinge locations may be determined based at least in part on the first image hinge locations. Hinge candidates may be detected in the second image having shapes associated with the plurality of hinges. The hinges candidates may be detected by computer software using automated software-based image analysis techniques. Adjusted second image hinge locations may then be calculated based at least in part on the projected second image hinge locations and candidate second image hinge locations. The adjusted second image hinge locations may be used to determine physical locations of the fixator and anatomical structure segments in three-dimensional space, which may be used to determine manipulations to the fixator for deformity correction.
1. A computer-implemented method comprising:
displaying first and second images of first and second anatomical structure segments with a fixation device attached thereto, the fixation device for correction of a deformity of the first and the second anatomical structure segments, the first and the second images captured from different positions and orientations with respect to one another, the fixation device comprising rings, struts and a plurality of hinges;
receiving indications of first image hinge locations associated with the plurality of hinges in the first image;
detecting hinge candidates in the second image having shapes associated with the plurality of hinges;
identifying candidate second image hinge locations of the hinge candidates in the second image;
calculating, based at least in part on the candidate second image hinge locations, adjusted second image hinge locations associated with the plurality of hinges in the second image; and
determining, based at least in part on the first image hinge locations and the adjusted second image hinge locations, physical locations of the fixation device and the first and the second anatomical structure segments in three-dimensional space.
2. The computer-implemented method of claim 1 , further comprising determining a range of expected size characteristics for the plurality of hinges, wherein the hinge candidates are limited to shapes having determined size characteristics that are within the range of expected size characteristics.
3. The computer-implemented method of claim 1 , wherein the detecting of the hinge candidates is performed based at least in part on orientations of detected shapes within the second image.
4. The computer-implemented method of claim 1 , wherein the plurality of hinges have a circular shape, and wherein the detecting the of the hinge candidates comprises performing a Hough transformation to detect circular shapes in the second image.
5. The computer-implemented method of claim 1 , wherein calculating the adjusted second image hinge locations comprises grouping the hinge candidates into a set of hinge candidate groups.
6. The computer-implemented method of claim 5 , wherein the hinge candidates are grouped based at least in part on a similarity of at least one of size characteristics or locations.
7. The computer-implemented method of claim 5 , wherein calculating the adjusted second image hinge locations further comprises weighting the set of hinge candidate groups based at least in part on a number of hinge candidates within each of the set of hinge candidate groups.
8. The computer-implemented method of claim 7 , wherein calculating the adjusted second image hinge locations further comprises selecting a highest weighted subset of hinge candidate groups from the set of hinge candidate groups.
9. The computer-implemented method of claim 8 , wherein calculating the adjusted second image hinge locations further comprises calculating a plurality of average group locations, each of the average group locations associated with a respective hinge candidate group of the highest weighted subset of hinge candidate groups.
10. The computer-implemented method of claim 9 , wherein calculating the adjusted second image hinge locations further comprises:
calculating the adjusted second image hinge locations based at least in part on the plurality of average group locations.
11. The computer-implemented method of claim 1 , further comprising:
using the physical locations of the fixation device and the first and the second anatomical structure segments to determine manipulations to the fixation device for the correction of the deformity.
12. One or more non-transitory computer-readable storage media having stored thereon instructions that, upon execution by one or more computing devices, cause the one or more computing devices to perform operations comprising:
displaying first and second images of first and second anatomical structure segments with a fixation device attached thereto, the fixation device for correction of a deformity of the first and the second anatomical structure segments, the first and the second images captured from different positions and orientations with respect to one another, the fixation device comprising rings, struts and a plurality of hinges;
receiving indications of first image hinge locations associated with the plurality of hinges in the first image;
detecting hinge candidates in the second image having shapes associated with the plurality of hinges;
identifying candidate second image hinge locations of the hinge candidates in the second image;
calculating, based at least in part on the candidate second image hinge locations, adjusted second image hinge locations associated with the plurality of hinges in the second image; and
determining, based at least in part on the first image hinge locations and the adjusted second image hinge locations, physical locations of the fixation device and the first and the second anatomical structure segments in three-dimensional space.
13. The one or more non-transitory computer-readable storage media of claim 12 , wherein the operations further comprise determining a range of expected size characteristics for the plurality of hinges, wherein the hinge candidates are limited to shapes having determined size characteristics that are within the range of expected size characteristics.
14. The one or more non-transitory computer-readable storage media of claim 12 , wherein calculating the adjusted second image hinge locations comprises grouping the hinge candidates into a set of hinge candidate groups.
15. The one or more non-transitory computer-readable storage media of claim 14 , wherein the hinge candidates are grouped based at least in part on a similarity of at least one of size characteristics or locations.
16. The one or more non-transitory computer-readable storage media of claim 14 , wherein calculating the adjusted second image hinge locations further comprises weighting the set of hinge candidate groups based at least in part on a number of hinge candidates within each of the set of hinge candidate groups.
17. The one or more non-transitory computer-readable storage media of claim 16 , wherein calculating the adjusted second image hinge locations further comprises selecting a highest weighted subset of hinge candidate groups from the set of hinge candidate groups.
18. The one or more non-transitory computer-readable storage media of claim 17 , wherein calculating the adjusted second image hinge locations further comprises calculating a plurality of average group locations, each of the average group locations associated with a respective hinge candidate group of the highest weighted subset of hinge candidate groups.
19. The one or more non-transitory computer-readable storage media of claim 18 , wherein calculating the adjusted second image hinge locations further comprises:
calculating the adjusted second image hinge locations based at least in part on the plurality of average group locations.
20. A computing system comprising:
one or more computer processors; and
one or more memories having stored therein instructions that, upon execution by the one or more computer processors, causes the one or more computer processors to perform operations comprising:
displaying first and second images of first and second anatomical structure segments with a fixation device attached thereto, the fixation device for correction of a deformity of the first and the second anatomical structure segments, the first and the second images captured from different positions and orientations with respect to one another, the fixation device comprising rings, struts and a plurality of hinges;
receiving indications of first image hinge locations associated with the plurality of hinges in the first image;
detecting hinge candidates in the second image having shapes associated with the plurality of hinges;
identifying candidate second image hinge locations of the hinge candidates in the second image;
calculating, based at least in part on the candidate second image hinge locations, adjusted second image hinge locations associated with the plurality of hinges in the second image; and
determining, based at least in part on the first image hinge locations and the adjusted second image hinge locations, physical locations of the fixation device and the first and the second anatomical structure segments in three-dimensional space.