DIGITAL PEN SYSTEM FOR RECORDING MEDICAL INFORMATION
Systems and methods of capturing responses to question prompts using a smart pen and special paper. The smart pen has sensors to collect data about its user, such as temperature, moisture, motion, and magnetism. The smart pen can also detect features of the special paper to determine a location on the paper such that responses to prompts can be correlated with the prompts by location on the page. Responses can be captured as handwriting or as audio, and all sensor information collected during the course of a response can be used to further analyze that response.
1 . A system for extracting structured data, the system comprising:
a database configured to store a data structure comprising a plurality of data fields;
a smart pen comprising an audio recording device and an optical sensor; and
a server communicatively coupled with the smart pen and the database, and programmed to:
retrieve audio data and associated image data from the smart pen,
correspond the audio data with a first one of the plurality of data fields in the data structure based on the associated image data, and
store the audio data in the database as a new data entry for the first one of the plurality of data fields.
2 . The system of claim 1 , wherein the smart pen further comprises a management module programmed to associate the audio data with the image data in response to a gesture input.
3 . The system of claim 2 , wherein the gesture input comprises a double tap of the smart pen.
4 . The system of claim 1 , wherein the smart pen is configured to work with a special paper imprinted with distinct micro-patterns at different locations on the paper.
5 . The system of claim 4 , wherein the image data comprises a micro-pattern.
6 . The system of claim 4 , wherein the database is further configured to store associations between the distinct micro-patterns and the plurality of data fields.
7 . The system of claim 4 , wherein different locations on the special paper are designated to be associated with different data fields in the plurality of data fields.
8 . The system of claim 1 , wherein the image data comprises hand-writing notes made by a user of the smart pen.
9 . The system of claim 8 , wherein the hand-writing notes are temporally synchronized with the audio data recorded while the hand-writing notes were made
10 . The system of claim 8 , wherein the server is further programmed to derive a medical meaning based on an association between the hand-writing notes and the audio data.
11 . A method of extracting structured data, comprising:
storing a data structure comprising a plurality of data fields to a database;
providing a smart pen comprising an audio recording device and an optical sensor;
coupling a server communicatively with the smart pen and the database;
retrieving, by the server, audio data and associated image data from the smart pen,
correlating, by the server, the audio data with a first one of the plurality of data fields in the data structure based on the associated image data; and
storing the audio data in the database as a new data entry for the first one of the plurality of data fields.
12 . The method of claim 10 , wherein the smart pen further comprises a management module programmed to associate the audio data with the image data in response to a gesture input.
13 . The method of claim 12 , wherein the gesture input comprises a double tap of the smart pen.
14 . The method of claim 11 , wherein the smart pen is configured to work with a special paper imprinted with distinct micro-patterns at different locations on the paper.
15 . The method of claim 14 , wherein the image data comprises a micro-pattern.
16 . The method of claim 14 , wherein the database is further configured to store associations between the distinct micro-patterns and the plurality of data fields.
17 . The method of claim 14 , wherein different locations on the special paper are designated to be associated with different data fields in the plurality of data fields.
18 . The method of claim 11 , wherein the image data comprises hand-writing notes made by a user of the smart pen.
19 . The method of claim 18 , wherein the hand-writing notes are temporally synchronized with the audio data recorded while the hand-writing notes were made.
20 . The method of claim 18 , wherein the server derives a medical meaning based on an association between the hand-writing notes and the audio data.