Temperature detection
Methods and apparatus for measuring biometric data including temperature in head-mounted devices (HMDs). Thermal sensors may also be integrated into the HMD and used to collect thermal data from the surface of the user's face. This thermal data may, for example, be processed to determine core body temperature of the user, or be processed to generate estimates of the user's respiration. The temperature data and/or respiration rate and changes to respiration rate derived from signals from the sensors may be used to generate and present biometric data to the user.
1 . A system, comprising:
a frame configured to be worn on a head;
one or more thermal sensors integrated in or coupled to the frame and configured to collect thermal data from a surface of the head, wherein the one or more thermal sensors include one or more passive non-contact infrared sensors integrated in one or more diaphragms configured to align a surface of the non-contact thermal sensors approximately normal to a surface of the head to detect infrared radiation from the surface of the head;
one or more infrared cameras coupled to the frame and configured to capture views of an eye region of the head for use in gaze tracking; and
a controller comprising one or more processors configured to:
process the thermal data collected by the one or more thermal sensors, including data captured by the one or more passive non-contact infrared sensors, to generate biometric data separate from the gaze tracking; and
present the biometric data.
2 . The system as recited in claim 1 , wherein, to process the thermal data collected by the one or more thermal sensors to generate biometric data, the controller is configured to process the thermal data collected by the one or more thermal sensors to estimate core body temperature.
3 . The system as recited in claim 1 , wherein, to process the thermal data collected by the one or more thermal sensors to generate biometric data, the controller is configured to process the thermal data collected by the one or more thermal sensors to estimate respiration rate.
4 . The system as recited in claim 1 , wherein the one or more thermal sensors further include contact thermal sensors configured to contact a surface of a face.
5 . The system as recited in claim 1 , wherein the one or more thermal sensors further include the one or more infrared cameras, wherein the thermal data collected by the one or more thermal sensors further includes data captured by the one or more infrared cameras to generate the biometric data separate from the gaze tracking.
6 . The system as recited in claim 1 , further comprising a flexible nose mount coupled to or integrated in the frame, wherein at least one of the thermal sensors is integrated in the nose mount and configured to detect temperature of a surface of a nose.
7 . The system as recited in claim 1 , wherein the frame further comprises a light seal configured to conform to a face, wherein at least one of the thermal sensors is integrated in the light seal and configured to detect temperature of a surface of the face.
8 . The system as recited in claim 1 , wherein the controller is further configured to subsample and process data captured by the one or more infrared cameras to estimate temperature at portions of a surface of a face captured by the one or more infrared cameras.
9 . The system as recited in claim 1 , wherein the one or more thermal sensors further include visible light cameras configured to capture views of portions of the face.
10 . The system as recited in claim 1 , wherein, to process the thermal data collected by the one or more thermal sensors to generate biometric data, the controller is configured to:
pre-process one or more signals from the one or more thermal sensors; and
analyze the pre-processed one or more signals to generate the biometric data.
11 . The system as recited in claim 1 , wherein the system is a head-mounted device (HMD).
12 . A method, comprising:
performing, by a controller comprising one or more processors:
receiving thermal data for a surface of a face from one or more thermal sensors integrated in or coupled to a head-mounted device (HMD), wherein the one or more thermal sensors include one or more passive non-contact infrared sensors integrated in one or more diaphragms configured to align a surface of the non-contact thermal sensors approximately normal to a surface of the head to detect infrared radiation from the surface of the head;
processing the thermal data received from the one or more thermal sensors, including data captured by the one or more passive non-contact infrared sensors, to generate biometric data; and
presenting the biometric data.
13 . The method as recited in claim 12 , wherein processing the thermal data received from the one or more thermal sensors to generate biometric data comprises processing the thermal data collected by the one or more thermal sensors to estimate core body temperature.
14 . The method as recited in claim 12 , wherein processing the thermal data received from the one or more thermal sensors to generate biometric data comprises processing the thermal data collected by the one or more thermal sensors to estimate respiration rate.
15 . The method as recited in claim 12 , wherein the thermal sensors include one or more cameras coupled to a frame, the method further comprising subsampling and processing data captured by the one or more cameras to estimate temperature at portions of a surface of the face captured by the one or more cameras.
16 . The method as recited in claim 15 , wherein the temperature estimated at one or more of the portions of the surface of the face is used in determining respiration or changes in respiration alone or in combination with the thermal data collected from the thermal sensors.
17 . The method as recited in claim 15 , wherein the one or more cameras include infrared cameras configured to capture views of a face's eye region for use in gaze tracking.
18 . The method as recited in claim 12 , wherein processing the thermal data received from the one or more thermal sensors to generate biometric data comprises:
pre-processing one or more signals from the one or more thermal sensors; and
analyzing the pre-processed one or more signals to generate the biometric data.
19 . The method as recited in claim 12 , further comprising calibrating at least one thermal sensor in a device external to the HMD based on the thermal data received from the one or more thermal sensors of the HMD.