Techniques for using inward-facing eye-tracking cameras of a head-worn device to measure heart rate, and systems and methods using those techniques

1 . A method of monitoring heart rate of a user, the method comprising:

illuminating, via an illumination source of an artificial-reality headset, an eye of the user;

capturing, via an inward-facing camera of the artificial-reality headset, a plurality of images of a region of a face of the user, the region including the eye of the user, wherein:

a first image of the plurality of images includes a first position of a pupil in the eye; and

a second image of the plurality of images includes a second position of the pupil in the eye, the second position different than the first position;

determining heart rate information based on the plurality of images;

in accordance with a determination that the heart rate information meets one or more quality criteria, causing the heart rate information to be presented to the user, wherein the one or more quality criteria comprise at least one of:

the region of the face of the user being unobstructed; and

the illumination of the pupil being within a predetermined range; and

in accordance with a determination that the heart rate information does not meet the one or more quality criteria, forgoing causing the heart rate information to be presented to the user.

2 . The method of claim 1 , further comprising:

determining eye-tracking information from the plurality of images; and

updating a user interface in accordance with the eye-tracking information.

3 . The method of claim 2 , wherein updating the user interface in accordance with the eye-tracking information includes updating a point of focus in the user interface based on a gaze direction of the user.

4 . The method of claim 1 , wherein the heart rate information is based on a change in dilation of the eye calculated based on the plurality of images.

5 . The method of claim 1 , wherein the heart rate information is based on a change in skin color of the user calculated based on the plurality of images.

6 . The method of claim 1 , further comprising obtaining secondary heart rate information from a wrist-wearable device worn by the user.

7 . The method of claim 6 , further comprising:

aggregating the heart rate information and the secondary heart rate information to obtain aggregated heart rate information; and

presenting the aggregated heart rate information to the user.

8 . The method of claim 6 , further comprising:

in accordance with the determination that the heart rate information does not meet the one or more quality criteria and the secondary heart rate information meeting the one or more quality criteria, presenting the secondary heart rate information.

9 . A system, comprising:

an artificial-reality headset including an inward-facing camera and an illumination source; and

one or more processors that are in communication with the inward-facing camera, the one or more processors configured to perform operations for:

illuminating, via the illumination source of the artificial-reality headset, an eye of a user;

capturing, via the inward-facing camera of the artificial-reality headset, a plurality of images of a region of a face of the user, the region including the eye of the user, wherein:

a first image of the plurality of images includes a first position of a pupil in the eye; and

a second image of the plurality of images includes a second position of the pupil in the eye, the second position different than the first position;

determining heart rate information based on the plurality of images;

in accordance with a determination that the heart rate information meets one or more quality criteria, causing the heart rate information to be presented to the user, wherein the one or more quality criteria comprise at least one of:

the region of the face of the user being unobstructed; and

the illumination of the pupil being within a predetermined range; and

in accordance with a determination that the heart rate information does not meet the one or more quality criteria, forgoing causing the heart rate information to be presented to the user.

10 . The system of claim 9 , wherein the one or more processors are further configured to perform operations for:

determining eye-tracking information from the plurality of images; and

updating a user interface in accordance with the eye-tracking information.

11 . The system of claim 10 , wherein updating the user interface in accordance with the eye-tracking information includes updating a point of focus in the user interface based on a gaze direction of the user.

12 . The system of claim 9 , wherein the heart rate information is based on a change in dilation of the eye calculated based on the plurality of images.

13 . The system of claim 9 , wherein the heart rate information is based on a change in skin color of the user calculated based on the plurality of images.

14 . The system of claim 9 , the one or more processors further configured to perform the operations for:

obtaining secondary heart rate information from a wrist-wearable device worn by the user.

15 . The system of claim 14 , the one or more processors further configured to perform the operations for:

aggregating the heart rate information and the secondary heart rate information to obtain aggregated heart rate information; and

presenting the aggregated heart rate information to the user.

16 . The system of claim 14 , the one or more processors further configured to perform the operations for:

in accordance with the determination that the heart rate information does not meet the one or more quality criteria and the secondary heart rate information meeting the one or more quality criteria, presenting the secondary heart rate information.

17 . A non-transitory, computer-readable storage medium including instructions that, when executed by a system comprising one or more processors and memory, causes the system to perform operations for:

illuminating, via an illumination source of an artificial-reality headset, an eye of a user;

capturing, via an inward-facing camera of the artificial-reality headset, a plurality of images of a region of a face of the user, the region including the eye of the user, wherein:

a first image of the plurality of images includes a first position of a pupil in the eye; and

a second image of the plurality of images includes a second position of the pupil in the eye, the second position different than the first position;

determining heart rate information based on the plurality of images;

in accordance with a determination that the heart rate information meets one or more quality criteria, causing the heart rate information to be presented to the user, wherein the one or more quality criteria comprise at least one of:

the region of the face of the user being unobstructed; and

the illumination of the pupil being within a predetermined range; and

in accordance with a determination that the heart rate information does not meet the one or more quality criteria, forgoing causing the heart rate information to be presented to the user.

18 . The non-transitory, computer-readable storage medium of claim 17 , wherein the heart rate information is based on a change in dilation of the eye calculated based on the plurality of images.

19 . The non-transitory, computer-readable storage medium of claim 17 , the processor further including instructions that, when executed by the system cause the system to perform operations for:

obtaining secondary heart rate information from a wrist-wearable device worn by the user.

20 . The non-transitory, computer-readable storage medium of claim 19 , the processor further including instructions that, when executed by the system cause the system to perform operations for:

in accordance with the determination that the heart rate information does not meet the one or more quality criteria and the secondary heart rate information meeting the one or more quality criteria, presenting the secondary heart rate information.