Clip-on device with inward-facing cameras
In order to enable collection of data from a head-mounted inward-facing camera, a clip-on device is attached to eyeglasses. The clip-on device optionally weighs less than 40 g and includes: (i) a body that may be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses, (ii) an inward-facing camera fixed to the body, and (iii) a wireless communication module fixed to the body.
1. A clip-on device comprising:
a body configured to be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses;
an inward-facing camera fixed to the body; and
a wireless communication module fixed to the body.
2. The clip-on of claim 1 , wherein the clip-on device weighs less than 40 g, and further comprising a processor fixed to the body and a battery fixed to the body; wherein the wireless communication module is configured to transmit measurements taken by the inward-facing camera to a computer that is not fixed to the body and is configured to detect a physiological response based on the measurements.
3. The clip-on of claim 1 , wherein the inward-facing camera is a thermal camera; and wherein when the body is attached to the eyeglasses, the thermal camera: is configured to take thermal measurements of a region on the forehead (TH F ) of a user who wears the eyeglasses, is located less than 5 cm from the user's face, and its optical axis is above 20° from the Frankfort horizontal plane; and wherein the wireless communication module is configured to transmit TH F to a computer configured to detect a physiological response based on TH F .
4. The clip-on of claim 1 , wherein the inward-facing camera is a thermal camera; and wherein when the body is attached to the eyeglasses, the thermal camera: is configured to take thermal measurements of a region on the nose (TH N ) of a user who wears the eyeglasses, and is located less than 5 cm from the user's face; and wherein the wireless communication module is configured to transmit TH N to a computer configured to detect a physiological response based on TH N .
5. The clip-on of claim 1 , wherein the inward-facing camera is a thermal camera; and wherein when the body is attached to the eyeglasses, the thermal camera: is configured to take thermal measurements of a region on a periorbital area (TH P ) of a user who wears the eyeglasses, and is located less than 5 cm from the user's face; and wherein the wireless communication module is configured to transmit TH P to a computer configured to detect a physiological response based on TH P .
6. The clip-on of claim 1 , wherein the inward-facing camera is a thermal camera; wherein when the body is attached to the eyeglasses, the thermal camera is: located below eye-level of a user who wears the eyeglasses, located at least 2 cm from the vertical symmetry axis that divides the user's face, and configured to take thermal measurements (TH ROI ) of a region on at least one of the following parts of the user's face: upper lip, lips, and a cheek; and wherein the wireless communication module is configured to transmit TH ROI to a computer configured to detect a physiological response based on TH ROI .
7. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera; wherein when the body is attached to the eyeglasses, the visible-light camera: is configured to take images (IM ROI ) of a region above eye-level of a user who wears the eyeglasses, is located less than 10 cm from the user's face, and its optical axis is above 20° from the Frankfort horizontal plane; and wherein the wireless communication module is configured to transmit IM ROI to a computer configured to detect a physiological response based on IM ROI .
8. The clip-on of claim 7 , wherein the region is on the forehead, and the computer is configured to detect the physiological response based on facial skin color changes (FSCC) recognizable in IM ROI .
9. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera; wherein when the body is attached to the eyeglasses, the visible-light camera is: configured to take images (IM N ) of a region on the nose of a user who wears the eyeglasses, and located less than 10 cm from the user's face; and wherein the wireless communication module is configured to transmit IM N to a computer configured to detect a physiological response based on IM N .
10. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera; wherein when the body is attached to the eyeglasses, the visible-light camera is: located below eye-level of a user who wears the eyeglasses, located at least 2 cm from the vertical symmetry axis that divides the user's face, and configured to take images (IM ROI ) of a region on at least one of the following parts of the user's face: upper lip, lips, and a cheek; and wherein the wireless communication module is configured to transmit M ROI to a computer configured to detect an emotional response of the user based on IM ROI .
11. The clip-on of claim 1 , wherein the inward-facing camera is a thermal camera; wherein when the body is attached to the eyeglasses, the thermal camera is: configured to take thermal measurements of a region of interest (TH ROI ) on the face of a user who wears the eyeglasses, and located less than 10 cm from the user's face; and further comprising an outward-facing head-mounted thermal camera configured to take thermal measurements of the environment (TH ENV ); wherein the wireless communication module is configured to transmit TH ROI and TH ENV to a computer configured to detect a physiological response of the user based on TH ROI and TH ENV .
12. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera; wherein when the body is attached to the eyeglasses, the visible-light camera is: configured to take images of a region of interest (IM ROI ) on the face of a user who wears the eyeglasses, and located less than 10 cm from the user's face; and further comprising an outward-facing head-mounted visible-light camera configured to take images of the environment (IM ENV ); wherein the wireless communication module is configured to transmit IM ROI and IM ENV to a computer configured to detect a physiological response of the user based on IM ROI and IM ENV .
13. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera; wherein when the body is attached to the eyeglasses, the visible-light camera is: configured to take images of a region of interest (IM ROI ) on the face of a user who wears the eyeglasses, and located less than 10 cm from the user's face; and further comprising an outward-facing head-mounted visible-light camera configured to take images of the environment (IM ENV ); wherein the wireless communication module is configured to transmit IM ROI and IM ENV to a computer configured to detect a physiological response based on facial skin color changes (FSCC) recognizable in IM ROI , and to utilize IM ENV to account for variations in ambient light.
14. The clip-on of claim 1 , wherein the inward-facing camera is a visible-light camera, and further comprising a second inward-facing visible-light camera; wherein, when the body is attached to the eyeglasses, the visible-light camera and the second visible-light camera: are configured to take images of a first region above eye-level and a second region on the upper lip (IM ROI and IM ROI2 , respectively), and are located less than 10 cm from the user's face; wherein the wireless communication module is configured to transmit IM ROI and IM ROI2 to a computer configured to generate an avatar of the user based on IM ROI and IM ROI2 .
15. The clip-on of claim 1 , wherein the clip-on device weighs less than 40 g, and the inward-facing camera comprises a multi-pixel sensor and a lens, and the sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture sharper images when the body is attached to the eyeglasses that are worn by a user.
16. The clip-on of claim 1 , wherein when the body is attached to the eyeglasses, more than 50% of the out-facing surface of the clip-on device is located behind the eyeglasses frame.
17. The clip-on of claim 1 , wherein when the body is attached to the eyeglasses, most of the volume of the clip-on device is located above the lenses of the eyeglasses, and the inward-facing camera is configured to take images of a region on the forehead of a user who wears the eyeglasses.
18. The clip-on of claim 1 , wherein the eyeglasses comprise left and right lenses, and when the body is attached to the eyeglasses, most of the volume of the clip-on device is located to the left of the left lens or to the right of the right lens; wherein the inward-facing camera is configured to take images of at least one of: a region on the nose of a user wearing the eyeglasses, and a region on the mouth of the user.
19. The clip-on of claim 1 , wherein the body is configured to be detached from the eyeglasses, by a user who uses the eyeglasses, without using a screwdriver or a knife, and the clip-on device weighs less than 20 g.
20. The clip-on of claim 1 , wherein the eyeglasses consist at least one of: prescription eyeglasses, prescription sunglasses, plano sunglasses, and augmented reality eyeglasses; and wherein neither attaching the clip-on device to the eyeglasses nor detaching the clip-on device from the eyeglasses should take more than 10 seconds for an average user.