IP Library Granted Patent US 12,373,951
Granted Patent B2
US 12,373,951 · App. 18/744,328 · Granted Jul 29, 2025

Processing of brain image data to assign voxels to parcellations

Inventors: Michael Edward Sughrue (Sydney, AU); Stephane Philippe Doyen (Glebe, AU); Charles Teo (Sydney, AU)
Assignee: Omniscient Neurotechnology Pty Limited
G06T7/0014G01R33/5608G01R33/56341G06T7/30G06T2207/10088G06T2207/20076G06T2207/20081G06T2207/30016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,951
App. No.
18/744,328
Granted
Jul 29, 2025
Kind
B2
Abstract

A method ( 400 ) including: determining ( 702 ) a registration function [ 705 , Niirf(T1)] for the particular brain in a coordinate space, determining ( 706 ) a registered atlas [ 708 , Ard(T1)] from the registration function and an HCP-MMP1 Atlas ( 102 ) containing a standard parcellation scheme, performing ( 310, 619 ) diffusion tractography to determine a set [ 621 , DTIp(DTI)] of brain tractography images of the particular brain, for a voxel in a particular parcellation in the registered atlas, determining ( 1105, 1120 ) voxel level tractography vectors [ 1123 , Vje, Vjn] showing connectivity of the voxel with voxels in other parcellations, classifying ( 1124 ) the voxel based on the probability of the voxel being part of the particular parcellation, and repeating ( 413 ) the determining of the voxel level tractography vectors and the classifying of the voxels for parcellations of the HCP-MMP1 Atlas to form a personalised brain atlas [ 1131 , PBs Atlas] containing an adjusted parcellation scheme reflecting the particular brain (Bbp).

Claims (52)

1. A method comprising:

obtaining brain tractography data of a particular brain;

registering the brain tractography data for the particular brain in a three-dimensional coordinate system space;

registering a standard atlas in the three-dimensional coordinate system space to produce a registered atlas, the registered atlas containing a parcellation scheme;

for at least one voxel and a first parcellation in the registered atlas:

determining end-to-end voxel level tractography vectors showing end-to-end connectivity of the voxel with voxels in other parcellations;

classifying the voxel based on probability of the voxel being part of the first parcellation; and

repeating the determining of the end-to-end voxel level tractography vectors and the classifying of the voxels for a plurality of parcellations of the registered atlas to form a personalised brain atlas containing an adjusted parcellation scheme reflecting the particular brain.

2. The method according to claim 1 , further comprising, prior to the repeating step, the step of interpolating a voxel grid for end-to-end parcellated voxel level tractography vectors to fill gaps between voxels.

3. The method according to claim 2 , further comprising, for each voxel in a particular parcellation in the registered atlas:

determining end-to-end voxel level tractography vectors and pass-through parcellated voxel level tractography vectors respectively showing end-to-end and pass-through connectivity of the voxel with voxels in other parcellations;

classifying the voxel to determine labels and a voxel grid for end-to-end parcellated voxel level tractography vectors and pass-through parcellated voxel level tractography vectors, based on the probability of the voxel being part of the particular parcellation; and

interpolating the voxel grid for end-to-end parcellated voxel level tractography vectors and pass-through parcellated voxel level tractography vectors to fill gaps between voxels.

4. The method according to claim 1 , wherein the method further comprises determining a registration function for the particular brain in the three dimensional coordinate system space and wherein determining the registration function comprises the steps of:

performing face stripping, skull stripping and masking of a NIfTI version of T1 images of the brain to obtain a masked, skull and face stripped T1 image; and

determining a relationship between the masked, skull and face stripped T1 image and a set of standard brain data image sets to generate the registration function.

5. The method according to claim 1 , wherein the step of determining the registered atlas comprises applying a registration function to the standard Atlas to generate the registered atlas.

6. The method according to claim 1 , wherein obtaining brain tractography data comprises performing diffusion tractography on brain image data using a face stripped masked NIfTI version of DTI images of a DICOM image set.

7. The method according to claim 1 , wherein the determining of the voxel level tractography vectors comprises the steps of:

registering the registered Atlas and a brain tractography image set;

generating end-to-end parcellated voxel level tractography vectors; and

generating end-to-end and pass-through parcellated voxel level tractography vectors.

8. The method according to claim 1 , wherein classifying the voxel comprises processing the end-to-end parcellated voxel level tractography vectors and the pass-through parcellated voxel level tractography vectors with an end-to-end classifier and a pass-by classifier to form a voxel grid.

9. The method according to claim 1 , wherein the plurality of parcellations comprises all parcellations in the registered atlas.

10. The method according to claim 1 , wherein the three dimensional coordinate system space is Montreal Neurological Institute space described by a set (HCP-SDB) of standard brain data image sets.

11. The method according to claim 1 , wherein the standard Atlas is a HCP-MMP1 Atlas.

12. The method of claim 1 , wherein the brain tractography data of the particular brain are whole brain tractography images of the particular brain.

13. A system comprising:

one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

obtaining brain tractography data of a particular brain;

registering the brain tractography data for the particular brain in a specified space;

registering a standard atlas in the specified space to produce a registered atlas, the registered atlas containing a parcellation scheme;

for at least one voxel and a first parcellation in the registered atlas:

determining end-to-end voxel level tractography vectors showing end-to-end connectivity of the voxel with voxels in other parcellations;

classifying the voxel based on the probability of the voxel being part of the particular parcellation; and

repeating the determining of the end-to-end voxel level tractography vectors and the classifying of the voxels for a plurality of parcellations of the registered atlas to form a personalised brain atlas containing an adjusted parcellation scheme reflecting the particular brain.

14. The system according to claim 13 , wherein the operations further comprise, prior to the repeating step, the step of interpolating a voxel grid for end-to-end parcellated voxel level tractography vectors to fill gaps between voxels.

15. The system according to claim 13 , wherein the step of determining the registered atlas comprises applying a registration function to the standard atlas to generate the registered atlas.

16. The system according to claim 13 , wherein the operations further comprises performing diffusion tractography on brain image data, performed in relation to a face stripped masked NIfTI version of DTI images of a DICOM image set.

17. The system according to claim 13 , wherein the plurality of parcellations comprises all parcellations in the registered atlas.

18. The method according to claim 1 , wherein the determining of the voxel level tractography vectors comprises the steps of:

registering the registered Atlas and the brain tractography data;

generating end-to-end parcellated voxel level tractography vectors; and

generating end-to-end and pass-through parcellated voxel level tractography vectors.

19. A computer readable storage medium having one or more computer programs recorded therein, the one or more programs being executable by a computer apparatus to make the computer apparatus perform a method of processing brain image data of a particular brain to be parcellated, the method comprising the steps of:

obtaining brain tractography data of a particular brain;

registering the brain tractography data for the particular brain in a three-dimensional coordinate system space;

registering a standard atlas in the three-dimensional coordinate system space to produce a registered atlas, the registered atlas containing a parcellation scheme;

for at least one voxel and a first parcellation in the registered atlas:

determining end-to-end voxel level tractography vectors showing end-to-end connectivity of the voxel with voxels in other parcellations;

classifying the voxel based on the probability of the voxel being part of the particular parcellation; and

repeating the determining of the end-to-end voxel level tractography vectors and the classifying of the voxels for a plurality of parcellations of the registered atlas to form a personalised brain atlas containing an adjusted parcellation scheme reflecting the particular brain.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2024
From: SUGHRUE, MICHAEL EDWARD
To: OMNISCIENT NEUROTECHNOLOGY PTY LIMITED
Reel/Frame 069345/0373 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2024
From: TEO, CHARLES
To: OMNISCIENT NEUROTECHNOLOGY PTY LIMITED
Reel/Frame 069345/0564 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2024
From: DOYEN, STEPHANE PHILIPPE
To: OLIVER WYMAN PTY LTD
Reel/Frame 069345/0803 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2024
From: OLIVER WYMAN PTY LTD
To: OMNISCIENT NEUROTECHNOLOGY PTY LIMITED
Reel/Frame 069347/0906 →
Priority Claims (1)
AU 2019903932 · Oct 18, 2019 · national
Continuity (3)
Continuation 17343699 · Jun 9, 2021
Continuation 17066171 · Oct 8, 2020
Related Publication 20240331157A1 · Oct 3, 2024
References Cited (56)
US 8742754B2 · Hasan · 2014 [cited by examiner]
US 9747421B2 · Krishna · 2017 [cited by examiner]
US 10032281B1 · Ghesu et al. · 2018 [cited by applicant]
US 10088544B2 · Cetingul et al. · 2018 [cited by applicant]
US 11055849B2 · Sughrue et al. · 2021 [cited by applicant]
US 12056876B2 · Sughrue et al. · 2024 [cited by applicant]
US 20100004527A1 · Dale · 2010 [cited by examiner]
US 20100303318A1 · Benali · 2010 [cited by examiner]
US 20110199084A1 · Hasan · 2011 [cited by examiner]
US 20120322068A1 · Lee · 2012 [cited by examiner]
US 20130102877A1 · Mori · 2013 [cited by examiner]
US 20150227702A1 · Krishna · 2015 [cited by examiner]
US 20160192889A1 · Koutsouleris · 2016 [cited by examiner]
US 20170035320A1 · Verma · 2017 [cited by examiner]
US 20170039708A1 · Henry · 2017 [cited by examiner]
US 20170052241A1 · Cetingul · 2017 [cited by examiner]
US 20180025489A1 · Tiwari · 2018 [cited by examiner]
US 20200051255A1 · Frank · 2020 [cited by examiner]
US 20210118138A1 · Sughrue · 2021 [cited by examiner]
US 20210295520A1 · Sughrue et al. · 2021 [cited by applicant]
US 20240331157A1 · Sughrue et al. · 2024 [cited by applicant]
CN 102947862 · 2013 [cited by applicant]
CN 105636541 · 2016 [cited by applicant]
CN 108460783 · 2018 [cited by applicant]
CN 109509193 · 2019 [cited by applicant]
CN 109978871 · 2019 [cited by applicant]
EP 1990768 · 2008 [cited by applicant]
WO WO2014153466 · 2014 [cited by applicant]
WO WO2021072485A1 · 2021 [cited by examiner]
Christian Lambert,“Confirmation of functional zones within the human subthalamic nucleus: Patterns of connectivity and sub-parcellation using diffusion weighted imaging,” Dec. 8, 2011,Neurolmage 60 (2012) 83-94, pp. 83-… [cited by examiner]
Huaigui Liu,“Connectivity-Based Parcellation of the Human Frontal Pole with Diffusion Tensor Imaging,” Mar. 6, 2013,The Journal of Neuroscience, Apr. 17, 2013, 33(16),pp. 6782-6788. [cited by examiner]
Jinping Xu,“Tractography-based Parcellation of the Human Middle Temporal Gyrus,” Dec. 22, 2015,Scientific Reports|5: 18883|DOI: 10.1038/srep18883,pp. 1-5. [cited by examiner]
Heidi Johansen-Berg,“Functional—Anatomical Validation and Individual Variation of Diffusion Tractography-based Segmentation of the Human Thalamus,” Jul. 6, 2004,Cerebral Cortex Jan. 2005; 15:doi:10.1093/cercor/bhh105,pp… [cited by examiner]
Elena Najdenovska,“In-vivo probabilistic atlas of human thalamic nuclei based on diffusion weighted magnetic resonance imaging,” Nov. 27, 2018,Scientific Data | 5:180270 | DOI: 10.1038/sdata.2018.270,pp. 1-9. [cited by examiner]
S. Jbabdi,“Multiple-subjects connectivity-based parcellation using hierarchical Dirichlet process mixture models,” Sep. 19, 2008,Neurolmage 44 (2009),pp. 373-381. [cited by examiner]
Yu Jin,“Scalable Algorithms for Generating and Analyzing Structural Brain Networks with a Varying Number of Nodes,” Sep. 13, 2016,arXiv:1609.03893v1 [cs.CE],pp. 1-9. [cited by examiner]
A.W. Toga,“The role of image registration in brain mapping,” Jun. 27, 2000,Image and Vision Computing 19 (2001),pp. 3-19. [cited by examiner]
Nigel C. Lawes,“Atlas-based segmentation of white matter tracts of the human brain using diffusion tensor tractography and comparison with classical dissection,” Aug. 7, 2007,NeuroImage 39 (2008),pp. 62-72. [cited by examiner]
Jakob Wasserthal et al.,“Combined tract segmentation and orientation mapping for bundle-specific tractography,” Sep. 12, 2019,Medical Image Analysis 58 (2019) 101559,pp. 1-7. [cited by examiner]
Timothy S. Coalson et al.,“The impact of traditional neuroimaging methods on the spatial localization of cortical areas,” May 17, 2018, PNAS, vol. 115,No. 27,pp. E6357-E6363. [cited by examiner]
Coalson et al., “The impact of traditional neuroimaging methods on the spatial localization of cortical areas.” Proceedings of the National Academy of Sciences, 2018, 115.27:E6356-65. [cited by applicant]
Cook et al., “An Automated Approach to Connectivity-Based Partitioning of Brain Structures,” 18th International Conference, Oct. 26, 2005, 8 pages. [cited by applicant]
Dipy.org [online], “Introduction to Basic Tracking,” retrieved on Dec. 2, 2020, retrieved from URL <https://dipy.org/documentation/1.3.0./examples_built/tracking_introduction_eudx/#example-tracking-introduction-eudx?>, … [cited by applicant]
Extended European Search Report in European Appln No. 20876723.6, dated Nov. 10, 2022, 11 pages. [cited by applicant]
Jbabdi,“Multiple-subjects connectivity-based parcellation using hierarchical Dirichlet process mixture models,” Sep. 19, 2008, Neurolmage, 44 (2009), pp. 373-381. [cited by applicant]
Jin et al., “Scalable Algorithms for Generating and Analyzing Structural Brain Networks with a Varying No. of Nodes,” ARXIV.org, Sep. 13, 2016, 15 pages. [cited by applicant]
Johansen-Berg, “Functional—Anatomical Validation and Individual Variation of Diffusion Tractography-based Segmentation of the Human Thalamus,” Jul. 6, 2004, Cerebral Cortex Jan. 2005 ; 15:doi:10.1093/cercor/bhh105,pp. 3… [cited by applicant]
Lambert, “Confirmation of functional zones within the human subthalamic nucleus: Patterns of connectivity and sub-parcellation using diffusion weighted imaging,” Dec. 8, 2011, Neurolmage, 60 (2012) 83-94, pp. 83-92. [cited by applicant]
Liu, “Connectivity-Based Parcellation of the Human Frontal Pole with Diffusion Tensor Imaging,” Mar. 6, 2013, The Journal of Neuroscience, Apr. 17, 2013, 33(16), pp. 6782-6788. [cited by applicant]
Najdenovska et al., “In-vivo probabilistic atlas of human thalamic nuclei based on diffusion-weighted magnetic resonance imaging” Scientific Data, Nov. 2018, 5:180270. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/AU2020/051093, Nov. 10, 2020, 10 pages. [cited by applicant]
pypi.org, [online] “DeepDefacer: Automatic Removal of Facial Features via Deep Learning” Jan. 13, 2019, retrieved on Dec. 2, 2020, retrieved from URL <https://pypi.org/project/deepdefacer/>, 4 pages. [cited by applicant]
Toga et al., “The role of image registration in brain mapping”; Image Vis Comput., Jan. 2001, 19(1-2): 3-24. [cited by applicant]
Wang et al., “Connectivity-Based Brain 1, 2, 4-15 Parcellation,” Neuroinformatics, Oct. 3, 2015, 14(1): 83-97. [cited by applicant]
Xu, “Tractography-based Parcellation of the Human Middle Temporal Gyrus,” Dec. 22, 2015, Scientific Reports 5: 18883, D01: 10.1038/srep18883, pp. 1-5. [cited by applicant]
Yao, “Research on magnetic resonance diffusion tensor image processing technology in neuronavigation,” Thesis for the degree of Doctor of Biomedical Engineering, Fudan University, 2011, 94 pages (English abstract only). [cited by applicant]