IP Library Granted Patent US 12,743,152
Granted Patent B2
US 12,743,152 · App. 17/856,291 · Granted Sep 22, 2026

Systems, apparatus, articles of manufacture, and methods for eye gaze correction in camera image streams

Inventors: Glen J. Anderson (Beaverton, OR); Chia-Hung S. Kuo (Folsom, CA); Sangeeta Manepalli (Chandler, AZ); Passant Karunaratne (Chandler, AZ)
Assignee: Intel Corporation
G06F3/013G06T13/40G06V40/193H04L12/1818H04L12/1822G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,743,152
App. No.
17/856,291
Granted
Sep 22, 2026
Kind
B2
Abstract

Systems, apparatus, articles of manufacture, and methods for eye gaze correction in camera image streams are disclosed. An example apparatus disclosed herein includes timing circuitry to calculate a duration of time for which an eye gaze of a first user of a video conference is directed toward a second user of the video conference, the second user presented as an image via a video conference interface, the video conference interface presented by a display of an electronic device, and social feedback control circuitry to select an eye gaze time threshold based on content associated with the video conference interface, and in response to the duration satisfying the eye gaze time threshold, cause an alert to be presented on the display with the video conference interface.

Claims (47)

1 . An apparatus comprising:

machine readable instructions; and

at least one programmable circuit to instantiate:

timing circuitry to calculate a duration of time for which an eye gaze of a first user of a video conference is directed toward a second user of the video conference, the second user presented as an image via a video conference interface, the video conference interface presented by a display of an electronic device;

pupil dilation monitoring circuitry to determine a pupil dilation rate of the second user; and

social feedback control circuitry to:

select an eye gaze time threshold based on the pupil dilation rate and content associated with the video conference interface; and

in response to the duration of time satisfying the eye gaze time threshold, cause an alert to be presented on the display with the video conference interface.

2 . The apparatus of claim 1 , wherein the eye gaze is a corrected eye gaze associated with gaze corrected frames output for presentation to the second user.

3 . The apparatus of claim 2 , wherein one or more of the at least one programmable circuit is to instantiate gaze tracking circuitry to:

determine a direction of the eye gaze relative to a portion of the video conference interface; and

cause the gaze corrected frames to be output for presentation to the second user based on the direction of the eye gaze relative to the portion of the video conference interface.

4 . The apparatus of claim 1 , wherein one or more of the at least one programmable circuit is to instantiate speaker identification circuitry to identify the second user or a third user as a speaker, the social feedback control circuitry to select the eye gaze time threshold based on the identified speaker.

5 . The apparatus of claim 1 , wherein the social feedback control circuitry is to select the eye gaze time threshold based on a number of users in the video conference.

6 . The apparatus of claim 1 , wherein the alert includes a bounding box around at least a portion of the image of the second user.

7 . The apparatus of claim 1 , wherein the second user presented in the image is presented as an avatar in the image.

8 . A non-transitory machine readable storage medium comprising instructions to cause at least one programmable circuit to at least:

determine a direction of an eye gaze of a first participant of a video conference relative to a video conference interface presented on a display of a first electronic device;

cause a first gaze corrected frame to be output for transmission to a second electronic device associated with a second participant of the video conference based on the direction of the eye gaze, the video conference interface including an image of the second participant, the first gaze corrected frame including a corrected eye gaze for the first participant;

determine a pupil dilation rate of the second participant based on image data of the second participant, the image data associated with the video conference interface;

select an eye gaze threshold based on the pupil dilation rate;

monitor a duration of time for which the corrected eye gaze is associated with the second participant; and

cause an alert to be output at the first electronic device when the duration of time exceeds the eye gaze threshold.

9 . The non-transitory machine readable storage medium of claim 8 , wherein the instructions are to cause one or more of the at least one programmable circuit to:

identify one of the second participant or a third participant of the video conference as a speaker;

assign a first value to the eye gaze threshold when the second participant is identified as the speaker; and

assign a second value to the eye gaze threshold when the third participant is identified as the speaker, the second value different than the first value.

10 . The non-transitory machine readable storage medium of claim 8 , wherein the alert is a first alert, the image data is first image data and the instructions are to cause one or more of the at least one programmable circuit to:

detect an eye gaze of a third participant of the video conference relative to the first participant based on second image data of the third participant, the second image data associated with the video conference interface; and

cause a second alert to be output at the first electronic device based on the eye gaze of the third participant.

11 . The non-transitory machine readable storage medium of claim 8 , wherein the instructions are to cause one or more of the at least one programmable circuit to:

detect a change in the direction of the eye gaze of the first participant relative to the video conference interface; and

cause a second gaze corrected frame to be output for transmission to a third electronic device associated with a third participant of the video conference based on the change in the direction of the eye gaze, the video conference interface including an image of the third participant.

12 . The non-transitory machine readable storage medium of claim 11 , wherein the video conference includes a plurality of participants and the instructions are to cause one or more of the at least one programmable circuit to cause the second gaze corrected frame to be output for transmission to respective electronic devices associated with each participant of the video conference based on the change in the direction of the eye gaze.

13 . The non-transitory machine readable storage medium of claim 8 , wherein the alert includes an audio alert or a visual alert presented via the display.

14 . An apparatus comprising:

at least one memory;

machine readable instructions; and

at least one programmable circuit to at least one of instantiate or execute the machine readable instructions to:

output an indicator of a direction of an eye gaze of a first participant of a video conference relative to content presented via a video conference interface, the indicator to be presented with the video conference interface on a display of an electronic device;

determine a pupil dilation rate for a second participant of the video conference, the video conference interface including an image of the second participant; and

adjust a property of the indicator based on the pupil dilation rate and a change associated with one or more of content of the video conference interface or the direction of the eye gaze of the first participant relative to the content.

15 . The apparatus of claim 14 , wherein one or more of the at least one programmable circuit is to:

identify the second participant of the video conference as a speaker; and

adjust the property of the indicator in response to identifying the second participant as the speaker.

16 . The apparatus of claim 14 , wherein one or more of the at least one programmable circuit is to adjust the property of the indicator when a duration of time of the eye gaze exceeds an eye gaze threshold for maintaining the direction of the eye gaze of the first participant relative to the content.

17 . The apparatus of claim 14 , wherein the content of the video conference interface includes an avatar representing the second participant of the video conference.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2026
From: INTEL CORPORATION
To: INTEL PRODUCTS IP LLC
Reel/Frame 075991/0662 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: KARUNARATNE, PASSANT
To: INTEL CORPORATION
Reel/Frame 062593/0918 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2023
From: ANDERSON, GLEN J.; KUO, CHIA-HUNG S.; MANEPALLI, SANGEETA
To: INTEL CORPORATION
Reel/Frame 062522/0834 →
Continuity (1)
Related Publication 20220334638A1 · Oct 20, 2022
References Cited (22)
US 8243116B2 · Qvarfordt et al. · 2012 [cited by applicant]
US 9400553B2 · Kerr et al. · 2016 [cited by applicant]
US 9456244B2 · Felkai et al. · 2016 [cited by applicant]
US 9584766B2 · Pradeep et al. · 2017 [cited by applicant]
US 10893231B1 · Huffman et al. · 2021 [cited by applicant]
US 11024002B2 · Isikdogan et al. · 2021 [cited by applicant]
US 20090079816A1 · Qvarfordt · 2009 [cited by examiner]
US 20130120522A1 · Lian · 2013 [cited by examiner]
US 20220057861A1 · Petuchowski · 2022 [cited by applicant]
US 20220126201A1 · Ma · 2022 [cited by examiner]
US 20220141266A1 · Cossar et al. · 2022 [cited by applicant]
US 20230119205A1 · Agrawal · 2023 [cited by examiner]
Wu et al., “Evolution and Human Behavior,” ScienceDirect, vol. 35, Issue 3, pp. 211-218, May 2014, 8 pages. [cited by applicant]
Laidlaw et al., “Potential Social Interactions are Important to Social Attention,” PNAS, vol. 108, No. 14, Apr. 5, 2011, 6 pages. [cited by applicant]
Wohltjen et al., “Eye Contact Marks the Rise and Fall of Shared Attention in Conversation,” PNAS, vol. 118, No. 37, 2021, 8 pages. [cited by applicant]
Hsu et al., “Look at Me! Correcting Eye Gaze in Live Video Communication,” ACM Trans. Multimedia Comput. Commun. Appl., vol. 15, No. 2, Article 38, May 2019, 23 pages. [cited by applicant]
Krafka et al., “Eye Tracking for Everyone,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 27-30, 2016, 9 pages. [cited by applicant]
Ren et al., “Look, Listen and Learn—A Multimodal LSTM for Speaker Identification,” Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16), 2016, 7 pages. [cited by applicant]
Binetti et al., “Pupil Dilation as an Index of Preferred Mutual Gaze Duration,” Royal Society Open Science, 2016, 11 pages. [cited by applicant]
Isikdogan et al., “Eye Contact Correction using Deep Neural Networks,” ararXiv:1906.05378v2 [cs.CV], Dec. 26, 2019, 9 pages. [cited by applicant]
European Patent Office, “Extended European Search Report,” issued in connection with European Patent Application No. 23175271.8, dated Nov. 8, 2023, 9 pages. [cited by applicant]
European Patent Office, “Communication pursuant to Article 94(3) EPC,” issued in connection with European Patent Application No. 23175271.8, dated Jul. 22, 2025, 5 pages. [cited by applicant]