AUTONOMOUS LEVEL IDENTIFICATION OF ANATOMICAL BONY STRUCTURES ON 3D MEDICAL IMAGERY

1 . A computer-implemented method for fully-autonomous level identification of anatomical structures within a three-dimensional (3D) medical imagery, the method comprising:

receiving ( 101 ) the 3D medical imagery comprising a set of medical scan images of the anatomical structures;

processing ( 102 ) the set of medical scan images to perform an autonomous semantic segmentation of anatomical components and to store segmentation results;

processing ( 103 ) segmentation results by removing the false positives, and smoothing 3D surfaces of the generated anatomical components;

determining ( 104 ) morphological and spatial relationships of the anatomical components;

grouping ( 105 ) the anatomical components to form separate levels based on the morphological and spatial relationships of the anatomical components;

processing ( 106 ) the set of medical scan images using a convolutional neural network ( 500 ) to autonomously assign an initial level type;

assigning ( 107 ) a level type to each group of anatomical components by combining the determined morphological and spatial relationships with the assigned initial level type; assigning ( 108 ) an ordinal identifier to each group of anatomical components to complement the assigned level type based on a relative distribution of the groups of anatomical components and their respective level types; and

storing ( 109 ) information about the assigned levels with their ordinal identifier.

2 . The method according to claim 1 , wherein the anatomical structure is a spine and the level type is a vertebral level type (C, T, L, S), to which an ordinal identifier (C1-C7, T1-T12, L1-L5, S1-S5) is assigned.

3 . The method according to claim 1 , wherein the determined ( 104 ) morphological relationships of anatomical components are their size and bounding box.

4 . The method according to claim 1 , wherein the determined ( 104 ) spatial relationships of anatomical component are their relative position and orientation.

5 . The method according to claim 1 , wherein the anatomical structure is a spine, and determining ( 105 ) morphological and spatial relationships among the anatomical components, includes in particular:

determining ( 301 ) pairs of pedicles;

determining ( 302 ) a vertebral body closest to or intersecting with each pair of pedicles; searching ( 303 ) for anatomy parts intersecting with other components that were already assigned to the level; and

repeating ( 304 ) the previous steps ( 301 - 303 ) for each level separately, excluding parts that were already assigned.

6 . The method according to claim 1 , further comprising providing a virtual 3D model, including the identified levels, as an augmented reality image ( 600 ) with some of the levels shown ( 602 ) and some other levels hidden ( 601 ).

7 . The method according to claim 6 , wherein the augmented reality image ( 600 ) further comprises implants ( 603 ) corresponding to the levels shown ( 602 ).

8 . The method according to claim 1 , further comprising providing a visual representation of identified levels as labels displayed in the surgical field as an augmented reality image ( 600 ), with some of the labels shown ( 604 ) and some other labels hidden.

9 . A computer-implemented system, comprising:

at least one nontransitory processor-readable storage medium ( 710 ) that stores at least one of processor-executable instructions or data; and

at least one processor ( 720 ) communicably coupled to at least one nontransitory processor-readable storage medium, wherein at least one processor is configured to perform the steps of the method of claim 1 .