Medical device configuration procedure guidance responsive to detected gestures
Techniques disclosed herein relate to providing guidance for configuring a medical device to a user in response to detected gestures of the user. In some embodiments, the techniques involve obtaining sensor data indicative of one or more gestures of a user of a medical device, and detecting a configuration procedure being performed on the medical device by the user based on the sensor data, where the configuration procedure includes a sequence of tasks to be performed by the user to configure the medical device. The techniques also involve determining one or more tasks of the configuration procedure that have been performed by the user based on the sensor data, identifying a subsequent task of the configuration procedure to be performed by the user based on the one or more tasks, and generating guidance information for performing the subsequent task of the configuration procedure.
1. A system comprising:
one or more processors; and
one or more processor-readable media storing instructions which, when executed by the one or more processors, cause performance of:
obtaining sensor data indicative of one or more gestures of a user of a medical device;
detecting, based on the sensor data, a configuration procedure being performed on the medical device by the user, the configuration procedure comprising a pre-defined sequence of tasks to be performed by the user to configure the medical device;
determining, based on the sensor data, one or more tasks of the configuration procedure that have been performed by the user;
identifying, based on the pre-defined sequence of tasks and the determined one or more tasks of the configuration procedure, a subsequent task of the pre-defined sequence of tasks for the configuration procedure to be performed by the user; and
generating guidance information for performing the subsequent task of the configuration procedure.
2. The system of claim 1 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises determining guidance content based at least in part on a difficulty or complexity metric associated with the subsequent task.
3. The system of claim 1 , wherein the instructions, when executed by the one or more processors, further cause performance of:
detecting performance of the subsequent task by the user based on subsequent sensor data; and
generating, in response to detecting the performance of the subsequent task, guidance information for performing a next task of the pre-defined sequence of tasks following the subsequent task.
4. The system of claim 1 , wherein the instructions, when executed by the one or more processors, further cause performance of determining a personalized score of the user for performing the configuration procedure based on historical procedural gesture data associated with the user, the personalized score of the user indicating a skill or experience level of the user for performing the configuration procedure.
5. The system of claim 4 , wherein the instructions, when executed by the one or more processors, further cause performance of generating, in response to the personalized score of the user indicating an experienced or skilled user, guidance content for an advanced feature associated with the configuration procedure.
6. The system of claim 4 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises generating, in response to the personalized score of the user indicating an inexperienced user, detailed guidance content for performing the subsequent task.
7. The system of claim 4 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises determining guidance content based on both a difficulty metric associated with the subsequent task and the personalized score of the user for performing the configuration procedure.
8. The system of claim 1 , wherein detecting the configuration procedure comprises mapping the sensor data indicative of the one or more gestures of the user to the configuration procedure, based on:
gestures corresponding to the pre-defined sequence of tasks of the configuration procedure; and
a type of the one or more gestures, a sequence of the one or more gestures, a temporal relationship between the one or more gestures, a confidence metric of the one or more gestures, or a combination thereof.
9. A processor-implemented method comprising:
obtaining sensor data indicative of one or more gestures of a user of a medical device;
detecting, based on the sensor data, a configuration procedure being performed on the medical device by the user, the configuration procedure comprising a pre-defined sequence of tasks to be performed by the user to configure the medical device;
determining, based on the sensor data, one or more tasks of the configuration procedure that have been performed by the user;
identifying, based on the pre-defined sequence of tasks and the determined one or more tasks of the configuration procedure, a subsequent task of the pre-defined sequence of tasks for the configuration procedure to be performed by the user; and
generating guidance information for performing the subsequent task of the configuration procedure.
10. The processor-implemented method of claim 9 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises determining guidance content based at least in part on a difficulty or complexity metric associated with the subsequent task.
11. The processor-implemented method of claim 10 , further comprising:
detecting performance of the subsequent task based on subsequent sensor data; and
generating, in response to detecting the performance of the subsequent task, guidance information for performing a next task of the pre-defined sequence of tasks following the subsequent task.
12. The processor-implemented method of claim 10 , further comprising determining a personalized score of the user for performing the configuration procedure based on historical procedural gesture data associated with the user, the personalized score of the user indicating a skill or experience level of the user for performing the configuration procedure.
13. The processor-implemented method of claim 12 , further comprising generating, in response to the personalized score of the user indicating an experienced or skilled user, guidance content for an advanced feature associated with the configuration procedure.
14. The processor-implemented method of claim 12 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises selectively performing, based on the personalized score of the user:
generating detailed guidance content for performing the subsequent task, in response to the personalized score of the user indicating an inexperienced user; or
generating a lesser amount of guidance content for performing the subsequent task, in response to the personalized score of the user indicating an experienced or skilled user.
15. The processor-implemented method of claim 9 , wherein detecting the configuration procedure comprises mapping the one or more gestures of the user to the configuration procedure, based on:
gestures corresponding to the pre-defined sequence of tasks of the configuration procedure; and
a type of the one or more gestures, a sequence of the one or more gestures, a temporal relationship between the one or more gestures, a confidence metric of the one or more gestures, or a combination thereof.
16. One or more non-transitory processor-readable media storing instructions which, when executed by one or more processors, cause performance of:
obtaining sensor data indicative of one or more gestures of a user of a medical device;
detecting, based on the sensor data, a configuration procedure being performed on the medical device by the user, the configuration procedure comprising a pre-defined sequence of tasks to be performed by the user to configure the medical device;
determining, based on the sensor data, one or more tasks of the configuration procedure that have been performed by the user;
identifying, based on the pre-defined sequence of tasks and the determined one or more tasks of the configuration procedure, a subsequent task of the pre-defined sequence of tasks for the configuration procedure to be performed by the user; and
generating guidance information for performing the subsequent task of the configuration procedure.
17. The one or more non-transitory processor-readable media of claim 16 , wherein generating the guidance information for performing the subsequent task of the configuration procedure comprises determining guidance content based at least in part on a difficulty or complexity metric associated with the subsequent task.
18. The one or more non-transitory processor-readable media of claim 17 , wherein the instructions, when executed by the one or more processors, further cause performance of:
detecting performance of the subsequent task based on subsequent sensor data; and
generating, in response to detecting the performance of the subsequent task, guidance information for performing a next task of the pre-defined sequence of tasks following the subsequent task.
19. The one or more non-transitory processor-readable media of claim 16 , wherein the instructions, when executed by the one or more processors, further cause performance of:
determining a personalized score of the user for performing the configuration procedure based on historical procedural gesture data associated with the user, the personalized score of the user indicating a skill or experience level of the user for performing the configuration procedure; and
generating, in response to the personalized score of the user indicating an experienced or skilled user, guidance information for an advanced feature associated with the configuration procedure.
20. The one or more non-transitory processor-readable media of claim 16 , wherein:
the instructions, when executed by the one or more processors, further cause performance of determining a personalized score of the user for performing the configuration procedure based on historical procedural gesture data associated with the user, the personalized score of the user indicating a skill or experience level of the user for performing the configuration procedure; and
generating the guidance information for performing the subsequent task of the configuration procedure comprises, in response to the personalized score of the user indicating an inexperienced user, generating detailed guidance content for performing the subsequent task.