IP Library Granted Patent US 10,582,118
Granted Patent B2
US 10,582,118 · App. 16/294,339 · Granted Mar 3, 2020

Method and system for providing recommendation information related to photography

Inventors: Jae-ho Jung (Yongin-si, KR); Yeul-tak Sung (Anyang-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23222H04N1/00244H04N5/2258H04N5/2351H04N5/23218H04N5/232939H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,582,118
App. No.
16/294,339
Granted
Mar 3, 2020
Kind
B2
Abstract

An electronic apparatus and a method by which the electronic apparatus provides recommendation information related to photography are provided. The method includes detecting, by an electronic device, a face of a subject in a preview screen viewed by a camera of the electronic device and displayed on a display of the electronic device, identifying a current composition information of the preview screen based on the detected face of the subject within the preview screen, determining a recommended photographing composition based at least in part on the identified current composition information of the preview screen and a central composition information, and providing a visual composition guide on the display of the electronic device based on the determined recommended photographing composition, the visual composition guide including a current composition indicator and a recommended photographing composition indicator.

Claims (87)

1. A method for photographing a subject using a recommended photographing composition by an electronic device including a camera and a display, the method comprising:

tracking a face of the subject in a preview image, obtained from the camera and displayed on the display, as the preview image changes due to a movement of the electronic device;

obtaining information of the face of the subject being tracked in the preview image, the obtained information including at least one of an orientation or a position of the face of the subject being tracked in the preview image;

obtaining, using an Artificial Intelligence (AI) model, the recommended photographing composition based on the information of the face of the subject;

displaying an indicator guiding a user to move the electronic device such that the face of the subject is at a position in the preview image corresponding to the recommended photographing composition; and

photographing the subject, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

2. The method of claim 1 , wherein the recommended photographing composition is obtained based further on a golden ratio composition information.

3. The method of claim 1 , wherein the recommended photographing composition is obtained based further on a centered composition information.

4. The method of claim 1 , wherein the indicator includes a shape corresponding to a shape of at least part of a human body.

5. The method of claim 1 , further comprising:

identifying a number of one or more faces included in the preview image,

wherein the recommended photographing composition is obtained based further on the identified number of the one or more faces included in the preview image.

6. The method of claim 5 , wherein based on the number of the one or more faces being identified as singular, obtaining the recommended photographing composition using the AI model.

7. The method of claim 1 , further comprising:

presenting a direction indication for the movement of the electronic device according to the recommended photographing composition,

wherein the direction indication is presented by at least one of a graphical indication, a text indication, or a speech indication.

8. An electronic device for photographing a subject using a recommended photographing composition, the electronic device comprising:

a camera;

a display; and

at least one processor configured to:

track a face of the subject in a preview image, obtained from the camera and displayed on the display, as the preview image changes due to a movement of the electronic device;

obtain information of the face of the subject being tracked in the preview image, the obtained information including at least one of an orientation or a position of the face of the subject being tracked in the preview image;

obtain, using an Artificial Intelligence (AI) model, the recommended photographing composition based on the information of the face of the subject;

display an indicator guiding a user to move the electronic device such that the face of the subject is at a position in the preview image corresponding to the recommended photographing composition; and

photograph the subject, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

9. The electronic device of claim 8 , wherein the recommended photographing composition is obtained based further on a golden ratio composition information.

10. The electronic device of claim 8 , wherein the recommended photographing composition is obtained based further on a centered composition information.

11. The electronic device of claim 8 , wherein the indicator includes a shape corresponding to a shape of at least part of a human body.

12. The electronic device of claim 8 ,

wherein the at least one processor is further configured to:

identify a number of one or more faces included in the preview image, and

wherein the recommended photographing composition is obtained based further on the identified number of the one or more faces included in the preview image.

13. The electronic device of claim 12 , wherein based on the number of the one or more faces being identified as singular, the recommended photographing composition is obtained using the AI model.

14. The electronic device of claim 8 ,

wherein the at least one processor is further configured to:

present a direction indication for the movement of the electronic device according to the recommended photographing composition, and

wherein the direction indication is presented by at least one of a graphical indication, a text indication, or a speech indication.

15. A non-transitory computer computer-readable recording medium having recorded thereon a program, which when executed by at least one processor of an electronic device including a camera and a display, causes the least one processor to perform a method for photographing a subject using a recommended photographing composition, the method comprising:

tracking a face of the subject in a preview image, obtained from the camera and displayed on the display, as the preview image changes due to a movement of the electronic device;

obtaining information of the face of the subject being tracked in the preview image, the obtained information including at least one of an orientation or a position of the face of the subject being tracked in the preview image;

obtaining, using an Artificial Intelligence (AI) model, the recommended photographing composition based on the information of the face of the subject;

displaying an indicator guiding a user to move the electronic device such that the face of the subject is at a position in the preview image corresponding to the recommended photographing composition; and

photographing the subject, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

16. The non-transitory computer computer-readable recording medium of claim 15 , wherein the recommended photographing composition is obtained based further on a golden ratio composition information.

17. The non-transitory computer computer-readable recording medium of claim 15 , wherein the recommended photographing composition is obtained based further on a centered composition information.

18. The non-transitory computer computer-readable recording medium of claim 15 , wherein the first indicator includes a shape corresponding to a shape of at least part of a human body.

19. The non-transitory computer computer-readable recording medium of claim 15 ,

wherein the method further comprises:

identifying a number of one or more faces included in the preview image, and

wherein the recommended photographing composition is obtained based further on the identified number of the one or more faces included in the preview image.

20. The non-transitory computer computer-readable recording medium of claim 19 , wherein based on the number of the one or more faces being identified as singular, obtaining the recommended photographing composition by using the AI model.

21. The non-transitory computer computer-readable recording medium of claim 15 ,

wherein the method further comprises:

presenting a direction indication for the movement of the electronic device according to the recommended photographing composition, and

wherein the direction indication is presented by at least one of a graphical indication, a text indication, or a speech indication.

22. The non-transitory computer computer-readable recording medium of claim 15 , wherein the face of the subject in the preview image is tracked using the AI model.

23. The non-transitory computer computer-readable recording medium of claim 15 , wherein the subject is automatically photographed based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

24. The non-transitory computer computer-readable recording medium of claim 15 , wherein the AI model is trained by a plurality of images including a plurality of composition information for recommending a photographing composition.

25. The non-transitory computer computer-readable recording medium of claim 15 ,

wherein the method further comprises:

maintaining a position of the indicator in the preview image as the preview image changes due to the movement of the electronic device, and

wherein a distance between the indicator and the face of the subject in the preview image changes as the preview image changes due to the movement of the electronic device.

26. The non-transitory computer computer-readable recording medium of claim 15 , wherein the method further comprises:

discontinuing the display of the indicator, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

27. The non-transitory computer computer-readable recording medium of claim 15 , wherein the method further comprises:

visually indicator that the face of the subject is at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

28. The method of claim 1 , wherein the face of the subject in the preview image is tracked using the AI model.

29. The method of claim 1 , wherein the subject is automatically photographed based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

30. The method of claim 1 , wherein the AI model is trained by a plurality of images including a plurality of composition information for recommending a photographing composition.

31. The method of claim 1 , further comprising:

maintaining a position of the indicator in the preview image as the preview image changes due to the movement of the electronic device,

wherein a distance between the indicator and the face of the subject in the preview image changes as the preview image changes due to the movement of the electronic device.

32. The method of claim 1 , further comprising:

discontinuing the display of the indicator, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

33. The method of claim 1 , further comprising:

visually indicator that the face of the subject is at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

34. The electronic device of claim 8 , wherein the face of the subject in the preview image is tracked using the AI model.

35. The electronic device of claim 8 , wherein the subject is automatically photographed based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

36. The electronic device of claim 8 , wherein the AI model is trained by a plurality of images including a plurality of composition information for recommending a photographing composition.

37. The electronic device of claim 8 ,

wherein the at least one processor is further configured to:

maintaining a position of the indicator in the preview image as the preview image changes due to the movement of the electronic device, and

wherein a distance between the indicator and the face of the subject in the preview image changes as the preview image changes due to the movement of the electronic device.

38. The electronic device of claim 8 , wherein the at least one processor is further configured to:

discontinue the display of the indicator, based on the face of the subject being at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

39. The electronic device of claim 8 , wherein the at least one processor is further configured to:

visually indicate that the face of the subject is at the position in the preview image corresponding to the recommended photographing composition obtained using the AI model.

Priority Claims (1)
KR 10-2017-0164328 · Dec 1, 2017 · national
Continuity (2)
Continuation 16161761 · Oct 16, 2018
Related Publication 20190208117A1 · Jul 4, 2019