AUTOMATED SYSTEM FOR HANDLING FILES CONTAINING PROTECTED HEALTH INFORMATION
The current document is directed to methods and automated systems for handling files and other data during a data ingestion process that may contain PHI within the file content, filenames, file-associated metadata, and other such data-associated information. The methods and automated systems protect sensitive health information using encryption methods to prevent the protected health information from being exposed. In certain implementations, the currently disclosed automated system includes a client-network system, one or more client servers, an encrypted data-storage device including a source folder for temporarily storing original files downloaded from the client network system and a second folder for storing PHI-free files created from the original files, and processes that create the PHI-free files from the original files, remove the original files from the source folder, and securely copy the PHI-free files to a secure file-transfer protocol server to be processed for later use.
1 . A secure-ingestion subsystem within an automated medical-data-processing system that securely receives medical-data-containing files from a client computer system, the secure-ingestion subsystem comprising:
a client server, including one or more processors and one or more memories, that is connected through one or more communications media and communications subsystems to the client computer system; and
one or more processes that run within the client server to
download encrypted medical-data-containing files from the client computer system through the one or more communications media and communications subsystems,
store the medical-data-containing files on an encrypted mass-storage device, and
for each medical-data-containing file stored on the encrypted mass-storage device,
generate a new filename,
create a meta file and a data file with filenames based on the new filename,
write medical-data-containing-file metadata into the meta file,
write medical-data-containing-file content into the data file,
store the meta file and data-file on the encrypted mass-storage device, and
delete the medical-data-containing file from the encrypted mass-storage device.
2 . The secure-ingestion subsystem of claim 1 wherein the medical-data-processing system is implemented with virtual servers, mass-storage devices, and networks that together comprise a virtual data center within a cloud-computing facility.
3 . The secure-ingestion subsystem of claim I wherein the new filename is generated by applying a cryptographic hashing method to all or a portion of the medical-data-containing-file filename.
4 . The secure-ingestion subsystem of claim 1 wherein the new filename does not contain protected health information.
5 . The secure ingestion subsystem of claim 1 wherein the medical-data-containing-file metadata includes one or more of a filename that may contain protected health information;
a file-creation date;
an identification of a file creator;
a file size;
a last-modified date;
a file-owner identification; and
access permissions.
6 . The secure ingestion subsystem of claim 1 wherein the medical-data-containing-file content includes data that may contain protected health information.
7 . The secure ingestion subsystem of claim 1 wherein the encrypted mass-storage device is protected by the Windows Bitlocker Drive encryption solution.
8 . The secure ingestion subsystem of claim 1 wherein the client server continuously or intermittently executes:
an import process that downloads the encrypted medical-data-containing files from the client computer system through the one or more communications media and communications subsystems and stores the medical-data-containing files in a source folder on the encrypted mass-storage device; and
a cleaner process that, for each medical-data-containing file stored by the import process in the source folder on the encrypted mass-storage device, generates the new filename, creates the meta file and the data file with filenames based on the new filename, writes the medical-data-containing-file metadata into the meta file, writes the medical-data-containing-file content into the data file, stores the meta file and data-file in a green-zone folder on the encrypted mass-storage device, and deletes the medical-data-containing file from the encrypted mass-storage device.
9 . The secure ingestion subsystem of claim 8 wherein the source folder is accessible only by the import process and the cleaner process.
10 . The secure ingestion subsystem of claim 8 wherein the client server additionally executes a scheduler process that transfers each meta-file/data-file pair stored in the green-zone folder to a secure-file-transfer server within an automated medical-data-processing system.
11 . The secure ingestion subsystem of claim 10 further including a listener ingestion process executed by a listener ingestion host server within the automated medical-data-processing system, the listener ingestion process:
receiving meta-file/data-file pairs from the SFTP server; and
for each received meta-file/data-file pair,
determining to which automated-medical-data-processing-system application to send the received meta-file/data-file pair,
storing the received meta-file/data-file pair on a second encrypted mass-storage device, and
arranging for transfer of the meta-file/data-file pair to the determined automated-medical-data-processing-system application.
12 . The secure ingestion subsystem of claim 10 wherein the second encrypted mass-storage device is protected by the LUKS DM-crypt technology.
13 . The secure ingestion subsystem of claim 1 wherein the metadata and content of a medical-data-containing file downloaded by the import process are both encrypted from when the medical-data-containing file is transmitted to the one or more communications media and communications subsystems by the client computer system until the meta-file/data-file pair corresponding to the medical-data-containing file is received by an application within the automated medical-data-processing system that processes the meta-file/data-file pair, preventing exposure of any protected health information contained in either the medical-data-containing-file metadata and the medical-data-containing-file content.
14 . A method, carried out within an automated medical-data-processing system, that securely ingests medical-data-containing files from a client computer system, the method comprising:
downloading, by an import process executing on a client server that includes one or more processors and one or more memories and that is connected through one or more communications media and communications subsystems to the client computer system, encrypted medical-data-containing files from the client computer system;
storing, by the import process, the medical-data-containing files on an encrypted mass-storage device; and
for each medical-data-containing file stored by the import process on the encrypted mass-storage device,
generating, by a cleaner process, a new filename,
creating, by the cleaner process, a meta file and a data file with filenames based on the new filename,
writing, by the cleaner process, medical-data-containing-file metadata into the meta file,
writing, by the cleaner process, medical-data-containing-file content into the data file,
storing, by the cleaner process, the meta file and data-file on the encrypted mass-storage device, and
deleting, by the cleaner process, the medical-data-containing file from the encrypted mass-storage device.
15 . The method of claim 14
wherein the new filename is generated by applying a cryptographic hashing method to all or a portion of the medical-data-containing-file filename; and
wherein the new filename does not contain protected health information.
16 . The method of claim 15 wherein the import process stores the medical-data-containing files in a source folder on the encrypted mass-storage device, the source folder accessible only to the import and cleaner processes.
17 . The method of claim 15 wherein the cleaner process stores the meta file and data-file as a meta-data/data-file pair in a green-zone folder on the encrypted mass-storage device.
18 . The method of claim 17 further including transferring, by a scheduler process running on the client server, each meta-file/data-file pair stored in the green-zone folder to a secure-file-transfer server within an automated medical-data-processing system.
19 . The method of claim 10 further including:
receiving, by a listener ingestion process executed by a listener ingestion host server within the automated medical-data-processing system, meta-file/data-file pairs from the SFTP server; and
for each received meta-file/data-file pair,
determining, by the listener ingestion process, to which automated-medical-data-processing-system application to send the received meta-file/data-file pair,
storing, by the listener ingestion process, the received meta-file/data-file pair on a second encrypted mass-storage device, and
arranging for transfer of the meta-file/data-file pair, by the listener ingestion process, to the determined automated-medical-data-processing-system application.
20 . Computer instructions, stored on a physical data-storage device, that, when executed by a client server within an automated medical-data-processing system, control the client server to:
download encrypted medical-data-containing files from the client computer system;
store the medical-data-containing files on an encrypted mass-storage device; and
for each medical-data-containing file stored by the import process on the encrypted mass-storage device,
generate a new filename,
create a meta file and a data file with filenames based on the new filename,
write medical-data-containing-file metadata into the meta file,
write medical-data-containing-file content into the data file,
store the meta file and data-file on the encrypted mass-storage device, and
delete the medical-data-containing file from the encrypted mass-storage device.