Electronic device, and control method of electronic device
An electronic device according to the present invention includes: a processor, and a memory storing a program which, when executed by the processor, causes the electronic device to obtain information on a line-of-sight position of a user looking at a captured image, estimate, on a basis of the line-of-sight position of the user, an object to which a line of sight of the user is directed, and control, on a basis of at least one of a state of capturing the image or a state of an object in the image, whether to display a first item that indicates the estimated object.
1 . An electronic device comprising:
a processor; and
a memory storing a program which, when executed by the processor, causes the electronic device to
obtain information on a line-of-sight position of a user looking at a captured image,
estimate, on a basis of the line-of-sight position of the user, an object to which a line of sight of the user is directed, and
control, on a basis of at least one of a state of capturing the image or a state of an object in the image, whether to display a first item that indicates the estimated object, wherein
in a case of a failure in obtainment of information on the line-of-sight position of the user, control is performed such that
the first item is not displayed on a first image which is the image if the first item is not displayed on a second image captured before the first image, and
the first item is displayed on the first image at a same position as in the second image if the first item is displayed on the second image.
2 . The electronic device according to claim 1 , wherein in a case where the line-of-sight position of the user is located at a position away from the object in the image, control is performed to display a second item that indicates the line-of-sight position of the user.
3 . The electronic device according to claim 1 , wherein
control is performed to display the first item in a case where:
the user is paying attention to the estimated object;
an imaging area of the image is changed; or
an orientation of an image-capturing device that captures the image is changed.
4 . The electronic device according to claim 3 , wherein in a case where a movement amount of the line-of-sight position of the user in a predetermined time is less than a first threshold, or a case where a number of blinks in a predetermined time is less than a second threshold, it is determined that the user is paying attention to the estimated object.
5 . The electronic device according to claim 3 , wherein in a case where a zoom operation is performed, or a case where an amount of change in focal length caused by the zoom operation is greater than a third threshold, or a case where an amount of change in zoom magnification caused by the zoom operation is greater than a fourth threshold, it is determined that the imaging area of the image is changed.
6 . The electronic device according to claim 3 , wherein in a case where a pan operation or a tilt operation is performed, or a case where a movement amount of the imaging area caused by the pan operation or the tilt operation is greater than a fifth threshold, it is determined that the imaging area of the image is changed.
7 . The electronic device according to claim 3 , wherein in a state in which information on the line-of-sight position of the user is obtained, it is determined whether the orientation of the image-capturing device is changed.
8 . The electronic device according to claim 1 , wherein
control is performed to display the first item in a case where:
a number of objects in the image changes;
the number of objects in the image is two or more;
the estimated object is in accelerating or decelerating motion; or
the estimated object is not in focus.
9 . The electronic device according to claim 8 , wherein the number of objects is a number of objects of a predetermined type among objects in the image.
10 . The electronic device according to claim 8 , wherein the number of objects is a number of objects detected in an area including the estimated object.
11 . The electronic device according to claim 10 , wherein the area including the estimated object is determined on a basis of at least one of, when capturing the image, a focal length, a shooting distance or shooting mode information, or a size of the estimated object.
12 . The electronic device according to claim 8 , wherein in a case where the estimated object is in focus and the line-of-sight position of the user is detected on an object different from the object in focus, control is performed to display the first item.
13 . The electronic device according to claim 1 , wherein in a case where the obtainment of information on the line-of-sight position of the user fails and the first item is to be displayed on the image, display the first item, control is performed to display the first item in a different manner from a case where the obtainment of information on the line-of-sight position of the user is successful.
14 . A control method of an electronic device, comprising:
obtaining information on a line-of-sight position of a user looking at a captured image,
estimating, on a basis of the line-of-sight position of the user, an object to which a line of sight of the user is directed, and
controlling, on a basis of at least one of a state of capturing the image or a state of an object in the image, whether to display a first item that indicates the estimated object, wherein
in a case of a failure in obtainment of information on the line-of-sight position of the user, control is performed such that
the first item is not displayed on a first image which is the image if the first item is not displayed on a second image captured before the first image, and
the first item is displayed on the first image at a same position as in the second image if the first item is displayed on the second image.
15 . A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method of an electronic device, the control method comprising:
obtaining information on a line-of-sight position of a user looking at a captured image,
estimating, on a basis of the line-of-sight position of the user, an object to which a line of sight of the user is directed, and
controlling, on a basis of at least one of a state of capturing the image or a state of an object in the image, whether to display a first item that indicates the estimated object, wherein
in a case of a failure in obtainment of information on the line-of-sight position of the user, control is performed such that
the first item is not displayed on a first image which is the image if the first item is not displayed on a second image captured before the first image, and
the first item is displayed on the first image at a same position as in the second image if the first item is displayed on the second image.