Method of detecting region of interest on basis of gaze direction and electronic device therefor
Disclosed is an electronic device comprising a communication circuit, a memory, and a processor. The processor may be set to obtain an omnidirectional image, identify at least one face in the omnidirectional image, obtain at least one gaze direction from the at least one face, and generate at least one region of interest of the omnidirectional image on the basis of the at least one gaze direction. Also, various other embodiments specified throughout the present specification may also be possible.
1. An electronic device, comprising:
a communication circuitry;
a memory; and
a processor operatively connected to the communication circuitry and the memory, wherein the processor is configured to:
obtain an omnidirectional image;
identify at least one face from the omnidirectional image;
obtain at least one gaze from the at least one face; and
generate at least one second region of interest of the omnidirectional image based at least on the at least one gaze, wherein the at least one second region of interest corresponds to a region where the at least one gaze is oriented in a spherical space onto which the omnidirectional image is mapped.
2. The electronic device of claim 1 , wherein the processor is configured to identify a first face from the omnidirectional image and generate a region of the omnidirectional image, the region corresponding to a first gaze of the first face, as the second region of interest, and
wherein the first face is a face stored in the memory or a face performing a specified gesture.
3. The electronic device of claim 2 , wherein the processor is configured to generate the first face as a first interest of region.
4. The electronic device of claim 2 , wherein the processor is configured to move the second interest of region along movement of the first gaze.
5. The electronic device of claim 2 , wherein the processor is configured to set a direction corresponding to the first gaze to a default viewing direction.
6. The electronic device of claim 1 , wherein the processor is configured to:
recognize a plurality of faces from the omnidirectional image;
obtain a plurality of gazes from the plurality of faces; and
generate a first region corresponding to a first direction as the second region of interest based on the number of at least one first gaze corresponding to the first direction among the plurality of gazes.
7. The electronic device of claim 6 , wherein the processor is configured to:
when the number of the at least one first gaze is greater than or equal to a specified number or when the first direction is a direction where the number of gazes corresponding to the same direction among the plurality of gazes is the largest, generate the first region as the second region of interest.
8. The electronic device of claim 6 , wherein the processor is configured to:
when the number of the plurality of recognized faces is greater than or equal to the number of specified faces, generate the first region as the second region of interest based on the number of the at least one first gaze.
9. The electronic device of claim 1 , wherein the processor is configured to:
identify the at least one face by identifying a face with moving lips.
10. The electronic device of claim 1 , wherein the processor is configured to obtain the at least one gaze based on a normal for a plane, the normal being composed of a center point between two eyes and a mouth of the at least one face.
11. The electronic device of claim 1 , wherein the processor is configured to store information of the at least one generated second region of interest in metadata of the omnidirectional image.
12. The electronic device of claim 1 , further comprising:
a camera circuitry configured to obtain the omnidirectional image,
wherein the processor is configured to obtain the omnidirectional image using the camera circuitry.
13. The electronic device of claim 12 , wherein the processor is configured to transmit the obtained omnidirectional image and information of the at least one generated second region of interest to an external electronic device using the communication circuitry.
14. A method for generating a region of interest, the method comprising:
obtaining an omnidirectional image;
identifying at least one face from the omnidirectional image;
obtaining at least one gaze from the at least one face; and
generating at least one region of interest of the omnidirectional image based at least on the at least one gaze,
wherein the at least one second region of interest corresponds to a region where the at least one gaze is oriented in a spherical space onto which the omnidirectional image is mapped.