Fully automated non-contact remote biometric and health sensing systems, architectures, and methods
Systems and methods for fully-automated contact-less biometric measurement include receiving a stream of image frames from an internet capable device. Frame data is extracted from the stream of image frames. A predictive load balancer selects a worker server based on a load prediction. An interface delivery server communicates the frame data from the internet capable device to the worker server. A set of patient face images captured by the frame data are extracted. A facial recognition machine learning model determines a patient identity associated with the set of patient face images of the frame data. A shared memory system stores the set of patient face images. The worker server determines biometric measurements based on the set of patient face images in the shared memory system using independent biometric data processing pipelines with shared access to the shared memory system for inter-process communication.
1. A method for fully-automated contact-less biometric measurement comprising:
receiving, by at least one processor, a set of image frames produced by one or more biometric sensor devices including at least one digital image capture device;
extracting, by the at least one processor, a set of patient face images associated with a user captured by one or more frames of the set of image frames;
determining, by the at least one processor, a patient identity of the user associated with the set of patient face images of the one or more frames of the set of image frames using a facial recognition machine learning model;
storing, by the at least one processor, the set of patient face images in a shared memory system with shared access by a plurality of independent biometric data processing pipelines;
determining, by the at least one processor, one or more biometric measurements of the user based on the set of patient face images in the shared memory system, each of the one or more biometric measurements being determined with an independent biometric data processing pipeline of the plurality of independent biometric data processing pipelines with the shared access to the shared memory system for inter-process communication;
wherein each of the one or more biometric measurements comprises a distinct health-related metric of the user;
exporting, by the at least one processor, the one or more biometric measurements to a user database; and
displaying, by the at least one processor, a selected set of the one or more biometric measurements on a screen of a user computing device in response to a user selection.
2. The method of claim 1 , further comprising determining, by the at least one processor, a consent status associated with the patient identity indicating whether consent for biometric analysis exists.
3. The method of claim 1 , further comprising balancing, by the at least one processor, each independent biometric data processing pipeline across a plurality of worker servers using a predictive load balancer.
4. The method of claim 1 , further comprising determining, by the at least one processor, a neural biometric data signal for each set of patient face images independently with each independent biometric data processing pipeline using a respective super-resolution neural network.
5. The method of claim 1 , further comprising determining, by the at least one processor, a quality measurement of a respective one or more biometric measurement in each independent biometric data measurement pipeline using a respective signal template neural network of a one or more signal template neural networks.
6. The method of claim 1 , wherein the set of image frames comprises frames of one or more videos, each of the one or more videos comprising five seconds in duration.
7. The method of claim 1 , further comprising sharing, by the at least one processor, results between each of the one or more independent biometric data measurement pipelines via the shared memory system;
wherein the results comprise one or more of the following:
the respective one or more biometric measurements of the respective one or more independent biometric data measurement pipelines,
a respective quality measurement of the respective one or more independent biometric data measurement pipelines, and
a respective neural biometric data signal of the respective one or more independent biometric data measurement pipelines.
8. The method of claim 6 , wherein the set of image frames comprises the frames of a user selected subset of the one or more videos.
9. A method for contact-less biometric measurement comprising:
receiving, by at least one processor, a stream of image frames produced by one or more biometric sensor devices including at least one internet capable device;
extracting, by the least one processor, frame data from the stream of image frames comprising a plurality of images;
determining, by the at least one processor, at least one worker server from a plurality of worker servers based on a future load prediction by a predictive load balancer;
communicating, by the at least one processor, the frame data from the at least one internet capable device to the at least one worker server;
extracting, by the at least one processor, a set of patient face images associated with a user captured by the frame data;
determining, by the at least one processor, a patient identity of the user associated with the set of patient face images of the frame data using a facial recognition machine learning model;
storing, by the at least one processor, the set of patient face images in a shared memory system with shared access by a plurality of independent biometric data processing pipelines;
determining, by the at least one processor, one or more biometric measurements based on the set of patient face images in the shared memory system, each of the one or more biometric measurements being determined with an independent biometric data processing pipeline of the plurality of independent biometric data processing pipelines with the shared access to the shared memory system for inter-process communication;
wherein each of the one or more biometric measurements comprises a distinct health-related metric of the user;
exporting, by the at least one processor, the one or more biometric measurements to a user database; and
displaying, by the at least one processor, a selected set of the one or more biometric measurements on a screen of a user computing device in response to a user selection.
10. The method of claim 9 , further comprising determining, by the at least one processor, a consent status associated with the patient identity indicating whether consent for biometric analysis exists.
11. The method of claim 9 , further comprising balancing, by the at least one processor, each independent biometric data processing pipeline across a plurality of worker servers of the at least one worker server using the predictive load balancer.
12. The method of claim 9 , further comprising determining, by the at least one processor, a neural biometric data signal for each set of patient face images independently with each independent biometric data processing pipeline using a respective super-resolution neural network.
13. The method of claim 9 , further comprising determining, by the at least one processor, a quality measurement of a respective one or more biometric measurement in each independent biometric data measurement pipeline using a respective signal template neural network of a one or more signal template neural networks.
14. The method of claim 9 , wherein the stream of image frames comprises frames of one or more videos.
15. The method of claim 9 , further comprising sharing, by the at least one processor, results between each of the one or more independent biometric data measurement pipelines via the shared memory system;
wherein the results comprise one or more of the following:
the respective one or more biometric measurements of the respective one or more independent biometric data measurement pipelines,
a respective quality measurement of the respective one or more independent biometric data measurement pipelines, and
a respective neural biometric data signal of the respective one or more independent biometric data measurement pipelines.
16. The method of claim 14 , wherein the frame data comprises the frames of a user selected segment of the one or more videos.
17. The method of claim 16 , wherein the user selected segment of the one or more videos comprises a selection of one or more segments each comprising 5 seconds in duration.
18. A system for contact-less biometric measurement comprising:
one or more internet connected devices configured to:
produce a stream of image frames produced by one or more biometric sensor devices including at least one internet capable device, and
extract frame data from the stream of image frames comprising a plurality of images;
a plurality of worker servers, each worker server comprising a respective at least one processor and a respective shared memory system;
a user database in communication with the plurality of worker servers and the one or more internet connected devices;
a predictive load balancer in communication with the plurality of worker servers and configured to determine at least one worker server from the plurality of worker servers based on a future load prediction;
an interface delivery server in communication with the plurality of worker servers, the predictive load balancer and the one or more internet connect devices, and configured to communicate the frame data from the at least one internet capable device to each of the predictive load balancer and the at least one worker server;
wherein the at least one processor of the at least one worker server is configured to:
extract a set of patient face images associated with a user captured by the frame data;
determine a patient identity of the user associated with the set of patient face images of the frame data using a facial recognition machine learning model;
store the set of patient face images in the shared memory system with shared access by a plurality of independent biometric data processing pipelines;
determine one or more biometric measurements based on the set of patient face images in the shared memory system, each of the one or more biometric measurements being determined with an independent biometric data processing pipeline of the plurality of independent biometric data processing pipelines with the shared access to the shared memory system for inter-process communication; and
wherein each of the one or more biometric measurements comprises a distinct health-related metric of the user;
export the one or more biometric measurements to the user database.
19. The system of claim 18 , wherein the at least one processor of the at least one worker server is further configured to share results between each of the one or more independent biometric data measurement pipelines via the shared memory system;
wherein the results comprise one or more of the following:
the respective one or more biometric measurements of the respective one or more independent biometric data measurement pipelines,
a respective quality measurement of the respective one or more independent biometric data measurement pipelines, and
a respective neural biometric data signal of the respective one or more independent biometric data measurement pipelines.
20. The system of claim 18 , wherein the interface delivery server is further configured to display a selected set of the one or more biometric measurements on a screen of the one or more internet connected devices in response to a user selection.