IP Library Granted Patent US 12,238,409
Granted Patent B2
US 12,238,409 · App. 17/988,207 · Granted Feb 25, 2025

Electronic device for obtaining image at user-intended moment and method for controlling the same

Inventor: Sungsoo Choi (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N23/632H04N23/667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,409
App. No.
17/988,207
Granted
Feb 25, 2025
Kind
B2
Abstract

The disclosure relates to an artificial intelligence (AI) system that simulates a function, such as cognition and judgment, of a human brain using a machine learning algorithm, such as deep learning, and an application thereof. According to an embodiment, an electronic device may include a touchscreen, a camera, a memory, and a processor, where the processor may receive information about an image capturing situation from a user, may obtain a target image based on the information about the image capturing situation using a first artificial intelligence module stored in the memory, may obtain feature information included in the target image using a second artificial intelligence module stored in the memory, may store the feature information in the memory, and may store an image related to the feature information in the memory based on obtaining the image related to the feature information through the camera.

Claims (55)

1. An electronic device comprising:

a camera;

memory; and

a processor,

wherein the memory stores instructions that, when executed by the processor, cause the electric device to:

receive information about an image capturing situation from a user,

obtain a target image based on the information about the image capturing situation using an artificial intelligence module,

obtain feature information comprised in the target image using the artificial intelligence module stored in the memory,

store the feature information in the memory, and

store an image related to the feature information in the memory based on obtaining the image related to the feature information through the camera.

2. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to display the target image on a touchscreen.

3. The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:

edit the target image based on a user manipulation for editing the target image displayed on the touchscreen in response to receiving the user manipulation, and

obtain feature information of the edited target image using the artificial intelligence module.

4. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to receive the information about the image capturing situation through at least one of a voice input of the user, a drawing input of the user, or an image input.

5. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:

store at least one of a target sound or a target action in the memory based on the information about the image capturing situation further comprising at least one of the target sound or the target action, and

store a video related to at least one of the target sound or the target action in the memory based on obtaining the video through the camera.

6. The electronic device of claim 5 , wherein the instructions, when executed by the processor, cause the electronic device to classify at least one of a sound or an action comprised in a plurality of frames obtained through a preview of a camera application, and

obtain the video through similarity between at least one of the classified sound or action and the at least one of the target sound or the target action.

7. The electronic device of claim 5 , wherein the instructions, when executed by the processor, cause the electronic device to classify at least one of a sound or an action comprised in a plurality of frames stored in the memory, and

obtain the video through similarity between at least one of the classified sound or action and the at least one of the target sound or the target action.

8. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to obtain the image related to the feature information among a plurality of frames obtained through a preview of a camera application.

9. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to obtain the image related to the feature information among a plurality of frames stored in the memory.

10. The electronic device of claim 1 , wherein the feature information comprises a one-dimensional feature vector.

11. A method for controlling an electronic device, the method comprising:

receiving information about an image capturing situation from a user;

obtaining, by an artificial intelligence module, a target image based on the information about the image capturing situation;

obtaining, by the artificial intelligence module, feature information comprised in the target image;

storing the feature information in memory; and

storing an image related to the feature information in the memory based on obtaining the image related to the feature information through a camera.

12. The method of claim 11 , further comprising:

displaying the target image on a touchscreen; and

editing the target image based on a user manipulation for editing the target image displayed on the touchscreen in response to receiving the user manipulation,

wherein the obtaining of the feature information comprises

obtaining feature information of the edited target image using the artificial intelligence module.

13. The method of claim 11 , wherein the receiving comprises receiving the information about the image capturing situation through at least one of a voice input of the user, a drawing input of the user, or an image input.

14. The method of claim 11 , further comprising:

storing at least one of a target sound or a target action in the memory based on the information about the image capturing situation further comprising at least one of the target sound or the target action; and

storing a video related to at least one of the target sound or the target action in the memory based on obtaining the video through the camera.

15. The method of claim 14 , wherein the storing of the video in the memory comprises:

classifying at least one of a sound or an action comprised in a plurality of frames obtained through a preview of a camera application; and

obtaining the video through similarity between at least one of the classified sound or action and the at least one of the target sound or the target action.

16. The method of claim 14 , wherein the storing of the video in the memory comprises:

classifying at least one of a sound or an action comprised in a plurality of frames stored in the memory; and

obtaining the video through similarity between at least one of the classified sound or action and the at least one of the target sound or the target action.

17. The method of claim 11 , wherein the storing the image in the memory comprises obtaining the image related to the feature information among a plurality of frames obtained through a preview of a camera application.

18. The method of claim 11 , wherein the storing the image in the memory comprises obtaining the image related to the feature information among a plurality of frames stored in the memory.

19. The method of claim 11 , wherein the feature information comprises a one-dimensional feature vector.

20. A method comprising:

capturing a video in a single-take mode, the single take mode collecting a plurality of frames for a predetermined time;

compressing the plurality of frames into low-dimensional vectors;

comparing feature information for each of the plurality of frames, wherein the feature information is obtained from a reference database based on information about an image capturing situation input from a user;

extracting at least one frame including a feature stored in the reference database among the plurality of frames collected for the predetermined time; and

storing the extracted at least one frame or suggesting the extracted at least one frame to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: CHOI, SUNGSOO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061794/0402 →
Priority Claims (2)
KR 10-2021-0158293 · Nov 17, 2021 · national
KR 10-2021-0179133 · Dec 14, 2021 · national
Continuity (2)
Continuation PCTKR2022017475 · Nov 8, 2022
Related Publication 20230156317A1 · May 18, 2023
References Cited (22)
US 10147216B1 · Miao · 2018 [cited by examiner]
US 10979625B2 · Lee · 2021 [cited by examiner]
US 20110029301A1 · Han et al. · 2011 [cited by applicant]
US 20160286132A1 · Kim et al. · 2016 [cited by applicant]
US 20180181827A1 · Kim et al. · 2018 [cited by applicant]
US 20180302568A1 · Kim et al. · 2018 [cited by applicant]
US 20180376050A1 · Endo · 2018 [cited by applicant]
US 20190244017A1 · Tai et al. · 2019 [cited by applicant]
US 20190253615A1 · Fukuya et al. · 2019 [cited by applicant]
US 20200184968A1 · Han et al. · 2020 [cited by applicant]
US 20210263961A1 · Kemertas · 2021 [cited by applicant]
US 20220101653A1 · Watanabe · 2022 [cited by applicant]
JP 2019118098A · 2019 [cited by applicant]
JP 2020136898A · 2020 [cited by applicant]
JP 682941281 · 2021 [cited by applicant]
KR 101876433B1 · 2018 [cited by applicant]
KR 20180116574A · 2018 [cited by applicant]
KR 20180119042A · 2018 [cited by applicant]
KR 102052830B1 · 2019 [cited by applicant]
WO 2021029648A1 · 2021 [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/KR2022/017475; International Filing Date Nov. 8, 2022; Date of Mailing Feb. 17, 2023; 9 Pages. [cited by applicant]
Extended European Search Report Issued in EP Application No. 22895954.0-1207, Mail Date Oct. 18, 2024, 9 Pages. [cited by applicant]