Media display device control based on eye gaze
Provided is an electronic device that captures a first image of a user. The electronic device determines a position of eye gaze of the user on a first UI element of a plurality of UI elements displayed on a first display screen of the electronic device, based on the first image. The electronic device selects the first UI element based on a determination of the position of the eye gaze on the first UI element for a time interval. The electronic device transmits a first control signal to a media display device, based on the selection of the first UI element. The electronic device receives a feedback image from the media display device. The feedback image indicates control of the media display device based on the first control signal. The electronic device controls the first display screen to display the feedback image with the plurality of UI elements.
1. An electronic device, comprising:
an image capturing device;
a first display screen configured to
display a plurality of user interface (UI) elements, wherein a selection of each of the plurality of UI elements controls a media display device communicably coupled to the electronic device; and
circuitry coupled to the image capturing device and the first display screen, wherein the circuitry is configured to:
control the image capturing device to capture a first image of a user of the electronic device;
determine a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user;
select the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval;
transmit a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements;
receive a feedback image from the media display device, based on the transmitted first control signal, wherein
the received feedback image indicates the control of the media display device based on the transmitted first control signal,
the received feedback image corresponds to media content displayed on a second display screen of the media display device, and
the received feedback image includes an image of an icon of the selected first UI element;
control the first display screen to display the received feedback image;
control the first display screen to display a subset of UI elements of the plurality of UI elements based on a type of the media content of the received feedback image;
control an overlay of the displayed subset of UI elements on the displayed feedback image that includes the image of the icon of the selected first UI element;
determine the position of the eye gaze of the user on a second UI element of the displayed subset of UI elements;
select the second UI element from the displayed subset of UI elements based on the determination of the position of the eye gaze on the second UI element; and
control, based on the selection of the second UI element, the first display screen to display information related to the media content displayed on the second display screen,
wherein the information related to the media content displayed on the second display screen includes at least one of a name or a summary of the displayed media content.
2. The electronic device according to claim 1 , wherein each UI element of the plurality of UI elements is associated with a different functionality associated with the media display device.
3. The electronic device according to claim 1 , wherein the circuitry is further configured to control a movement of a cursor on the plurality of UI elements corresponding to a change in the position of the eye gaze of the user on the plurality of UI elements.
4. The electronic device according to claim 1 , wherein the circuitry is further configured to highlight the first UI element based on the selection of the first UI element of the plurality of UI elements.
5. The electronic device according to claim 1 , wherein the feedback image received from the media display device corresponds to a UI icon to indicate the control of the media display device based on the transmitted first control signal.
6. The electronic device according to claim 1 , wherein the circuitry is further configured to control an opacity level of the displayed subset of UI elements that are overlaid on the displayed feedback image including the image of the icon of the selected first UI element.
7. The electronic device according to claim 1 , wherein the circuitry is further configured to:
control the first display screen to display the plurality of UI elements on a first portion of the first display screen; and
control the first display screen to display the received feedback image on a second portion of the first display screen, wherein the first portion is different from the second portion.
8. The electronic device according to claim 7 , wherein
the circuitry is further configured to control the first display screen to display the information, related to the media content displayed on the second display screen, on a third portion of the first display screen, and
the third portion is different from the first portion and the second portion.
9. The electronic device according to claim 1 , wherein the circuitry is further configured to determine at least one of a gesture associated with facial expression of the user or a gesture associated with a head of the user, to select the first UI element of the plurality of UI elements displayed on the first display screen.
10. The electronic device according to claim 1 , wherein the circuitry is further configured to render guidance information for the user, to control at least one configuration setting of the media display device through at least one UI element of the plurality of UI elements displayed on the first display screen.
11. A method, comprising:
in an electronic device which includes:
an image capturing device, and
a first display screen configured to display a plurality of user interface (UI) elements, wherein a selection of each of the plurality of UI elements controls a media display device communicably coupled to the electronic device:
controlling the image capturing device to capture a first image of a user of the electronic device;
determining a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user;
selecting the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval;
transmitting a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements;
receiving a feedback image from the media display device, based on the transmitted first control signal, wherein
the received feedback image indicates the control of the media display device based on the transmitted first control signal,
the received feedback image received from the media display device corresponds to media content displayed on a second display screen of the media display device, and
the received feedback image includes an image of an icon of the selected first UI element;
controlling the first display screen to display the received feedback image;
controlling the first display screen to display a subset of UI elements of the plurality of UI elements based on a type of the media content of the received feedback image;
controlling an overlay of the displayed subset of UI elements on the displayed feedback image that includes the image of the icon of the selected first UI element;
determining the position of the eye gaze of the user on a second UI element of the displayed subset of UI elements;
selecting the second UI element from the displayed subset of UI element based on the determination of the position of the eye gaze on the second UI element; and
controlling, based on the selection of the second UI element, the first display screen to display information related to the media content displayed on the second display screen,
wherein the information related to the media content displayed on the second display screen includes at least one of a name or a summary of the displayed media content.
12. The method according to claim 11 , further comprising controlling a movement of a cursor on the plurality of UI elements corresponding to a change in the position of the eye gaze of the user on the plurality of UI elements.
13. The method according to claim 11 , further comprising controlling an opacity level of the displayed subset of UI elements that are overlaid on the displayed feedback image including the image of the icon of the selected first UI element.
14. The method according to claim 11 , further comprising:
controlling the first display screen to display the plurality of UI elements on a first portion of the first display screen; and
controlling the first display screen to display the received feedback image on a second portion of the first display screen, wherein the first portion is different from the second portion.
15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an electronic device which includes an image capturing device and a first display screen, causes the electronic device to execute operations, the operations comprising:
controlling the first display screen to display a plurality of user interface (UI) elements, wherein a selection of each of the plurality of UI elements controls a media display device communicably coupled to the electronic device;
controlling the image capturing device to capture a first image of a user of the electronic device;
determining a position of an eye gaze of the user on a first UI element of the displayed plurality of UI elements, based on the captured first image of the user;
selecting the first UI element of the plurality of UI elements based on the determination of the position of the eye gaze on the first UI element for a time interval;
transmitting a first control signal to the media display device, based on the selection of the first UI element of the plurality of UI elements;
receiving a feedback image from the media display device, based on the transmitted first control signal, wherein
the received feedback image indicates the control of the media display device based on the transmitted first control signal,
the received feedback image received from the media display device corresponds to media content displayed on a second display screen of the media display device, and
the received feedback image includes an image of an icon of the selected first UI element;
controlling the first display screen to display the received feedback image;
controlling the first display screen to display a subset of UI elements of the plurality of UI elements based on a type of the media content of the received feedback image;
controlling an overlay of the displayed subset of UI elements on the displayed feedback image that includes the image of the icon of the selected first UI element;
determining the position of the eye gaze of the user on a second UI element of the displayed subset of UI elements;
selecting the second UI element from the displayed subset of UI elements based on the determination of the position of the eye gaze on the second UI element; and
controlling, based on the selection of the second UI element, the first display screen to display information related to the media content displayed on the second display screen,
wherein the information related to the media content displayed on the second display screen includes at least one of a name or a summary of the displayed media content.