Selecting a stressor based on thermal measurements of the face
Described herein are systems and methods for selecting a stressor based on thermal measurements. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) and a computer. CAM takes thermal measurements of a region on a periorbital area (TH ROI1 ) of the user. The computer detects extents of stress based on TH ROI1 , receives indications of potential stressors to which the user was exposed while TH ROI1 were taken, and selects the stressor, from among the potential stressors, based on the indications and the extents. Optionally, during most of the time the user was affected by the stressor, the effect of the stressor, as manifested via changes to TH ROI1 , was higher than the effects of most of the potential stressors. Optionally, thermal measurements of other regions on the face may also be utilized to detect the extents of stress.
1. A system configured to select a stressor, comprising:
an inward-facing head-mounted thermal camera (CAM) configured to take thermal measurements of a region on a periorbital area (TH ROI1 ) of a user; and
a computer configured to:
detect extents of stress based on TH ROI1 ;
receive indications of potential stressors to which the user was exposed while TH ROI1 were taken; and
select the stressor, from among the potential stressors, based on the indications and the extents.
2. The system of claim 1 , wherein the region on the periorbital area is a region of the periorbital area of the right eye of the user; and further comprising a second inward-facing head-mounted thermal camera (CAM2) configured to take thermal measurements of a region on the periorbital area of the left eye (TH ROI2 ) of the user; wherein the computer is further configured to detect the stress level also based on TH ROI2 ; and further comprising a frame configured to be worn on the user's head, and to hold each of CAM and CAM2 less than 10 cm from the user's head; wherein each of CAM and CAM2 is weighs below 10 g.
3. The system of claim 1 , further comprising second and third inward-facing head-mounted thermal cameras configured to take thermal measurements of regions on the forehead (TH ROI2 ) of the user and the nose (TH ROI3 ) of the user, respectively; and wherein the computer is further configured to detect the extents of stress also based on TH ROI2 and TH ROI3 .
4. The system of claim 1 , further comprising a second inward-facing head-mounted thermal camera configured to take thermal measurements of a region below the nostrils (TH ROI2 ) of the user; wherein TH ROI2 are indicative of the user's breathing, and the computer is further configured to detect the extents of stress also based on TH ROI2 .
5. The system of claim 1 , further comprising a camera configured to take images of the surroundings of the user; wherein the computer is further configured to generate at least some of the indications based on analysis of the images.
6. The system of claim 1 , wherein the computer selects the stressor based on at least one of the following assumptions (i) an average stress level of the user while being affected by the stressor is greater than an average stress level of the user while not being affected by the stressor, and (ii) during most of the time the user was affected by the stressor, an effect of the stressor, as manifested via changes to TH ROI1 , was higher than effects of most of the potential stressors.
7. The system of claim 6 , wherein the indications comprise a certain indication of a stressor that is indicative of at least one of the following: the user conducted a certain activity, the user was at a certain location, and the user interacted with a certain entity.
8. The system of claim 6 , wherein the computer is further configured to calculate, based on the indications and the extents, an effect of each potential stressor, and to select as the stressor a potential stressor with a maximal effect.
9. The system of claim 1 , wherein the computer is further configured to generate a machine learning-based model based on the indications and extents, and to select the stressor based on an analysis of the model.
10. The system of claim 9 , wherein the model comprises parameters of at least one of the following models: a regression model, a nave Bayes model, a Bayes network, a support vector machine for regression, and a neural network model.
11. The system of claim 9 , wherein the computer is further configured to perform the analysis of the model by evaluating parameters of the model that correspond to the potential stressors, and to select as the stressor a certain potential stressor that has a corresponding parameter that is indicative of an effect that reaches a threshold, while effects indicated in parameters corresponding to most of the potential stressors do not reach the threshold.
12. The system of claim 9 , wherein the computer is further configured to perform the analysis of the model by providing a predictor module with various inputs that correspond to different potential stressors that affect the user, and to calculate, based on the inputs and the model, various predicted stress levels; and wherein the stressor is selected from among the potential stressors, responsive to identifying that: (i) based on a first subset of the various predicted stress levels, the effect of the stressor reaches a threshold, and (ii) based on a second subset of the various predicted stress levels, the effects of most of the potential stressors do not reach the threshold.
13. A method for selecting a stressor, comprising:
taking, utilizing an inward-facing head-mounted thermal camera (CAM), thermal measurements of a region on a periorbital area (TH ROI1 ) of a user;
detecting extents of stress based on TH ROI1 ;
receiving indications of times during which the user was exposed to potential stressors; and
selecting the stressor, from among the potential stressors, based on the indications and the extents.
14. The method of claim 13 , wherein the region on the periorbital area is a region of the periorbital area of the right eye of the user; and further comprising: taking, utilizing a second inward-facing head-mounted thermal camera, thermal measurements of a region on the periorbital area of the left eye TH ROI2 ) of the user, and selecting the stressor also based on TH ROI2 .
15. The method of claim 13 , further comprising taking, utilizing a second inward-facing head-mounted thermal camera, thermal measurements of a region on the forehead (TH ROI2 ), and selecting the stressor also based on TH ROI2 .
16. The method of claim 13 , further comprising taking, utilizing a second inward-facing head-mounted thermal camera, thermal measurements of a region on the nose (TH ROI2 ), and selecting the stressor also based on TH ROI2 .
17. The method of claim 13 , further comprising taking, utilizing a second inward-facing head-mounted thermal camera, thermal measurements of a region below the nostrils (TH ROI2 ) of the user, and selecting the stressor also based on TH ROI2 ; wherein TH ROI2 are indicative of the user's breathing.
18. The method of claim 13 , further comprising generating a machine learning-based model based on the indications and extents, and selecting the stressor based on an analysis of the model.
19. The method of claim 18 , further comprising performing the analysis of the model by evaluating parameters of the model that correspond to the potential stressors, and selecting as the stressor a certain potential stressor that has a corresponding parameter that is indicative of an effect that reaches a threshold, while effects indicated in parameters corresponding to most of the other potential stressors do not reach the threshold.
20. The method of claim 18 , further comprising performing the analysis of the model by: (i) providing a predictor module with various inputs that correspond to different potential stressors that affect the user; (ii) calculating, based on the inputs and the model, various predicted stress levels; (iii) determining, based on the various predicted stress levels, effects of the potential stressors; and (iv) selecting the stressor based on the effects; wherein an effect of the stressor reaches a threshold, while effects of most of the other potential stressors do not reach the threshold.