On-demand metadata extraction of clinical image data
A method and system for providing on-demand updating of metadata information associated with clinical image data files is disclosed. The system allows for extracting, on the fly, additional metadata fields from clinical image data files and re-indexing the metadata to include the additional fields so that an end-user can perform operations (e.g., searching, browsing, etc.) based on the newly indexed fields. The metadata fields may be defined in a configurable schema file (e.g., XML, YML, etc.). The system can gain efficiencies by, for example, reading only a subset of the DICOM file (e.g., reading only the first few kilobytes that contain the header), scanning only a subset of source data folders, etc.
1. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing device comprising one or more hardware processors, cause the computing device to perform a method comprising:
receiving a set of metadata attributes associated with clinical image data; and
for a clinical image data file selected from a set of clinical image data files:
retrieving a header portion of the clinical image data file, wherein the header portion of the clinical image data file is smaller than the clinical image data file, and wherein the header portion comprises metadata; and
for each respective attribute in the set of metadata attributes:
parsing the header portion of the clinical image data file to determine whether the respective attribute is present in the header portion of the clinical image data file and further to identify a value associated with the respective attribute,
determining that the respective attribute is not included in a metadata file, which is distinct from the set of clinical image data files, and which comprises some but not all metadata attributes of the clinical image data file,
updating the metadata file to include the respective attribute from the header portion of the clinical image data file and the value associated with the respective attribute, and
updating a metadata index based on the updated metadata file, wherein the metadata index is associated with the set of clinical image data files.
2. The non-transitory computer-readable storage medium of claim 1 , wherein the receiving of the set of metadata attributes comprises receiving a configurable schema file that includes the set of metadata attributes.
3. The non-transitory computer-readable storage medium of claim 1 , wherein the receiving of the set of metadata attributes comprises receiving a configurable schema file including the set of metadata attributes, and wherein the configurable schema file is based at least in part on one or more of:
user profile, security permissions, one or more locations of respective clinical image data files in the set of clinical image data files, timing information, and news-based events.
4. The non-transitory computer-readable storage medium of claim 1 , wherein the header portion of the clinical image data file is determined based at least in part on one or more of:
type of the clinical image data file, bandwidth constraints, data storage constraints, and response time constraints.
5. The non-transitory computer-readable storage medium of claim 1 , wherein the method further comprises:
receiving, via an application programming interface (API), the set of clinical image data files, wherein each clinical image data file in the set of clinical image data files is associated with at least one metadata file.
6. The non-transitory computer-readable storage medium of claim 1 , wherein the method further comprises:
receiving the set of clinical image data files, wherein each clinical image data file in the set of clinical image data files is associated with at least one metadata file, and wherein receiving the set of clinical image data files comprises receiving a location of at least one folder comprising at least one clinical image data file among the set of clinical image data files.
7. The non-transitory computer-readable storage medium of claim 1 , wherein the method further comprises:
based on the determining that the respective attribute is not included in the metadata file, extracting the identified value associated with the respective attribute from the header portion of the clinical image data file; and
adding, based on a configurable schema of the metadata file, the respective attribute and the identified value to the metadata file.
8. The non-transitory computer-readable storage medium of claim 1 , wherein the metadata file is associated with the clinical image data file.
9. The non-transitory computer-readable storage medium of claim 1 , wherein the metadata file is associated with the set of clinical image data files.
10. The non-transitory computer-readable storage medium of claim 1 , wherein the metadata index is associated with the set of clinical image data files.
11. The non-transitory computer-readable storage medium of claim 1 further comprising:
storing the metadata file at a data storage repository, which is distinct from a computer that stores the clinical image data file.
12. The non-transitory computer-readable storage medium of claim 1 , wherein a type of the clinical image data file is Digital Imaging and Communications in Medicine (DICOM).
13. The non-transitory computer-readable storage medium of claim 1 , wherein a type of the clinical image data file is Neuroimaging Informatics Technology Initiative (NIFTI).
14. The non-transitory computer-readable storage medium of claim 1 , wherein the receiving of the set of metadata attributes comprises receiving a configurable schema file for the metadata file.
15. The non-transitory computer-readable storage medium of claim 1 , wherein the receiving of the set of metadata attributes comprises receiving a configurable schema file for the clinical image data, and wherein the configurable schema file is based on one or more of: user profile, security permissions, a location of the clinical image data file, and timing information.
16. The non-transitory computer-readable storage medium of claim 1 further comprising: identifying the header portion of the clinical image data file based at least in part on a type of the clinical image data file.
17. The non-transitory computer-readable storage medium of claim 1 further comprising:
receiving, via an application programming interface (API), the set of clinical image data files, wherein each clinical image data file is associated with at least one metadata file, which is stored at a data storage repository remotely from the respective clinical image data file.
18. The non-transitory computer-readable storage medium of claim 1 further comprising:
receiving the set of clinical image data files and further receiving a location of at least one folder comprising one or more clinical image data files among the set of clinical image data files.