IP Library › Granted Patent US 12,505,912
Granted Patent B2
US 12,505,912 · App. 17/654,190 · Granted Dec 23, 2025

Methods and systems for resting state fMRI brain mapping with reduced imaging time

Inventors: Eric Leuthardt (St. Louis, MO); Joshua Shimony (St. Louis, MO); Patrick Luckett (St. Louis, MO); John Lee (St. Louis, MO)
Assignee: Washington University
G16H30/20G01R33/4806G06N3/0464G06N3/08A61B2576/026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,912
App. No.
17/654,190
Granted
Dec 23, 2025
Kind
B2
Abstract

A method for mapping brain function of a subject includes receiving a dataset of resting state fMRI (RS-fMRI) three dimensional (3D) image frames of the subject's brain, and inputting the 3D image frames to a deep learning artificial neural network. For each voxel of each 3D image frame and for each resting state network of a plurality of resting state networks, the deep learning artificial neural network calculates a probability that the voxel belongs to the resting state network. The deep learning artificial neural network is trained beforehand using a plurality of 3D image frames including previously defined resting state networks obtained from a plurality of calibration subjects. The method includes generating one or more functional map of the plurality of resting state networks of the subject's brain using the probabilities calculated by the artificial neural network.

Claims (22)

1 . A method for mapping brain function of a subject, the method comprising:

receiving a dataset of time-series resting state fMRI (RS-fMRI) comprising a series of individual three dimensional (3D) image frames of the subject's brain, wherein each frame represents a snapshot in time over the course of the RS-fMRI scan and the dataset comprises less than about 200 individual 3D image frames;

inputting the 3D image frames to a 3D convolutional neural network designed to account for the spatial relationship between voxels by performing three dimensional convolutions, wherein for each voxel of the subject's brain and for each defined resting state network of a plurality of defined resting state networks the 3D convolutional neural network calculates a probability that the voxel belongs to each of the resting state networks, each of the plurality of defined resting state networks is characterized by its location being in a same general region across a population of subjects but where there is significant variability in network boundaries at an individual level, and the 3D convolutional neural network is trained beforehand using a plurality of 3D image frames including previously defined resting state networks obtained from a plurality of calibration subjects; and

generating one or more functional map of the plurality of resting state networks of the subject's brain using the probabilities calculated by the 3D convolutional neural network.

2 . The method of claim 1 , wherein the 3D image frames of the subject's brain are input to the 3D convolutional neural network as tensors.

3 . The method of claim 1 , wherein the dataset comprises less than about 150 3D image frames.

4 . The method of claim 1 , further comprising generating 3D correlation maps correlating each voxel in each 3D image frame to other time correlated voxels in the 3D image frame.

5 . The method of claim 4 , wherein inputting the 3D image frames to the artificial neural network comprises inputting the generated 3D correlation maps to the 3D convolutional neural network.

6 . A method for mapping brain function of a subject, the method comprising:

receiving a dataset of time-series resting state fMRI (RS-fMRI) comprising a series of individual three dimensional (3D) image frames of the subject's brain, wherein each frame represents a snapshot in time over the course of the RS-fMRI scan;

inputting the 3D image frames to a a 3D convolutional neural network designed to account for the spatial relationship between voxels by performing three dimensional convolutions, wherein for the subject's brain and for each defined resting state network of a plurality of defined resting state networks the 3D convolutional neural network calculates a probability that the voxel belongs to each of the resting state networks, each of the plurality of defined resting state networks is characterized by its location being in a same general region across a population of subjects but where there is significant variability in network boundaries at an individual level, and the 3D convolutional neural network is trained beforehand using a plurality of 3D image frames including previously defined resting state networks obtained from a plurality of calibration subjects; and

generating one or more functional map of the plurality of resting state networks of the subject's brain using the probabilities calculated by the 3D convolutional neural network.

7 . The method of claim 6 , wherein the 3D image frames of the subject's brain are input to the 3D convolutional neural network as tensors.

8 . The method of claim 6 , further comprising generating 3D correlation maps correlating each voxel in each 3D image frame to other time correlated voxels in the 3D image frame.

9 . The method of claim 8 , wherein inputting the 3D image frames to the 3D convolutional neural network comprises inputting the generated 3D correlation maps to the 3D convolutional neural network.

10 . A method for mapping of brain function of a subject for a purpose for which a first number of resting state fMRI (RS-fMRI) individual three dimensional (3D) image frames of the subject's brain is typically acquired, the method comprising:

receiving a dataset of time-series RS-fMRI comprising a series of individual 3D image frames of the subject's brain, wherein each frame represents a snapshot in time over the course of the RS-fMRI scan and the dataset comprising less than half of the first number of individual 3D image frames;

inputting the 3D image frames to a 3D convolutional neural network account for the spatial relationship between voxels by performing three dimensional convolutions, wherein for each voxel of the subject's brain and for each defined resting state network of a plurality of defined resting state networks the 3D convolutional neural network calculates a probability that the voxel belongs to each of the resting state networks, each of the plurality of defined resting state networks is characterized by its location being in a same general region across a population of subjects but where there is significant variability in network boundaries at an individual level, and the 3D convolutional neural network is trained beforehand using a plurality of 3D image frames including previously defined resting state networks obtained from a plurality of calibration subjects; and

generating one or more functional map of the plurality of resting state networks of the subject's brain using the probabilities calculated by the 3D convolutional neural network.

11 . The method of claim 10 , wherein the 3D image frames of the subject's brain are input to the 3D convolutional neural network as tensors.

12 . The method of claim 10 , wherein the purpose comprises pre-surgical planning in a patient with brain tumors and epilepsy, and the first number of RS-fMRI 3D image frames is more than 1000.

13 . The method of claim 12 , wherein the dataset comprising less than half of the first number of 3D image frames comprises less than 200 3D image frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2022
From: LEUTHARDT, ERIC; SHIMONY, JOSHUA; LUCKETT, PATRICK; LEE, JOHN
To: WASHINGTON UNIVERSITY
Reel/Frame 059343/0026 →
Continuity (2)
Provisional Application 63158627 · Mar 9, 2021
Related Publication 20220293244A1 · Sep 15, 2022
References Cited (31)
US 8020993B1 · Fram · 2011 [cited by examiner]
US 9480402B2 · Leuthardt et al. · 2016 [cited by applicant]
US 10289903B1 · Chandler · 2019 [cited by examiner]
US 11651491B2 · Siemionow · 2023 [cited by examiner]
US 11954578B2 · Meyer · 2024 [cited by examiner]
US 20100111386A1 · El-Baz · 2010 [cited by examiner]
US 20100268733A1 · Hayaishi · 2010 [cited by examiner]
US 20110304332A1 · Mahfouz · 2011 [cited by examiner]
US 20150272468A1 · Liu · 2015 [cited by examiner]
US 20180374213A1 · Arnold · 2018 [cited by examiner]
US 20190030371A1 · Han · 2019 [cited by examiner]
US 20190090749A1 · Leuthardt · 2019 [cited by examiner]
US 20200219262A1 · Hsiao · 2020 [cited by examiner]
US 20200372637A1 · Ha · 2020 [cited by examiner]
US 20200397293A1 · Peng · 2020 [cited by examiner]
US 20220181005A1 · Narvaez · 2022 [cited by examiner]
FR 3117329A1 · 2022 [cited by examiner]
GB 2574233A · 2019 [cited by examiner]
WO WO2019077410A1 · 2019 [cited by examiner]
WO WO2019106061A1 · 2019 [cited by examiner]
WO WO2020050721A1 · 2020 [cited by examiner]
WO WO2020249359A1 · 2020 [cited by examiner]
Mitchell et al., “A Novel Data-Driven Approach to Preoperative Mapping of Functional Cortex Using Resting-State Functional Magnetic Resonance Imaging,” Neurosurgery 73:969-983, 2013 DOI: 10.1227/NEU.0000000000000141. (Y… [cited by examiner]
Valdes-Sosa et al., “Automatic selection of resting-state networks with functional magnetic resonance imaging,” Frontiers in Neuroscience May 2013|vol. 7|Article72 | doi: 10.3389/fnins.2013.00072. (Year: 2013). [cited by examiner]
Li et al., “Brain Age Prediction Based on Resting-State Functional Connectivity Patterns Using Convolutional Neural Networks,” Proc IEEE Int Symp Biomed Imaging. Apr. 2018 ; 2018: 101-104. doi:10.1109/ISBI.2018.8363532.… [cited by examiner]
Leuthardt et al., “Integration of resting state functional MRI into clinical practice - A large single institution experience,” Plos One 13(6): e0198349. https:// doi.org/10.1371/journal.pone.0198349. (Year: 2018). [cited by examiner]
Dongiovanni et al., “Select and Cluster: A Method for Finding Functional Networks of Clustered Voxels in fMRI,” Hindawi Publishing Corporation Computational Intelligence and Neuroscience vol. 2016, Article ID 4705162, 1… [cited by examiner]
Naveau et al., “Voxel-based homotopic functional correspondences using functional connectivity analysis of resting state FMRI,” Brain Connectivity 2.4: A88-A89. Mary Ann Liebert Inc.(2012); http://dx.doi.org/10.1089/bra… [cited by examiner]
Kamnitsas et al.., “Efficient multi-scale 3D Cnn with fully connected CRF for accurate brain lesion segmentation,” Medical Image Analysis 36 (2017) 61-78; http://dx.doi.org/10.1016/j.media.2016.10.004. (Year: 2017). [cited by examiner]
“Tensors Explained—Data Structures of Deep Learning,” https://deeplizard.com/learn/video/Csa5R12jYRg#:˜: text=The%20inputs%2C%20outputs%2C%20and%20transformations,structure%20used%20by%20neural%20networks. (Year: 2018). [cited by examiner]
Huang, Gao et al., Convolutional Networks with Dense Connectivity, IEEE Transactions on Pattern Analysis and Machine Intelligence; pp. 1-12. [cited by applicant]