IP Library Granted Patent US 12,430,561
Granted Patent B2
US 12,430,561 · App. 18/459,179 · Granted Sep 30, 2025

Method and electronic device for providing text-related image

Inventor: Yusun Lim (Seongnam-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06N3/084G06F18/22G06F18/256G06N3/044G06N3/08G06N3/04G06N3/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,561
App. No.
18/459,179
Granted
Sep 30, 2025
Kind
B2
Abstract

An artificial intelligence (AI) system for simulating functions such as recognition, determination, and so forth of human brains by using a mechanical learning algorithm like deep learning, or the like, and an application thereof is provided. A method of providing a text-related image is provided. The method includes obtaining a text, determining at least one image related to the obtained text based on a degree of relatedness between a result of applying a first AI data recognition model to the obtained text and a result of applying a second AI data recognition model to a user-accessible image, and displaying the determined at least one image to a user.

Claims (55)

1. A method performed by an electronic device of providing an image, the method comprising:

receiving, by the electronic device, a first text entered by a user of the electronic device;

in response to receiving the first text, transmitting, by the electronic device to an external device via a communicator of the electronic device, the first text and a request for at least one image related to the first text;

after transmitting the first text and the request to the external device, receiving, by the electronic device from the external device, information of the at least one image related to the first text without the at least one image, wherein the information of the at least one image includes metadata determined by the external device based on the first text, wherein the metadata includes information about the at least one image for the electronic device to identify whether the at least one image is an image previously stored in memory and obtain the at least one image from the memory of the electronic device;

obtaining, by the electronic device, the at least one image based on the information of the at least one image; and

displaying, by the electronic device, the at least one image based on the information of the at least one image.

2. The method of claim 1 , wherein the at least one image related to the first text is at least one image corresponding to a context of the first text.

3. The method of claim 2 , wherein the at least one image corresponding to the context of the first text is obtained based on an artificial intelligence (AI) data recognition model stored in the external device.

4. The method of claim 1 , wherein the information of the at least one image comprises information for the electronic device to obtain the at least one image.

5. The method of claim 1 , wherein the information of the at least one image comprises at least one of an identification (ID) of the at least one image, a thumbnail image of the at least one image, or a stored location of the at least one image.

6. The method of claim 1 , further comprising:

receiving, by the electronic device, a user input of selecting an image from the at least one image being displayed; and

displaying, by the electronic device, the selected image together with the first text.

7. The method of claim 6 , further comprising:

receiving, by the electronic device, a second text entered by the user after displaying the selected image together with the first text;

transmitting, by the electronic device to the external device, the second text and a request for at least one image related to the second text;

receiving, by the electronic device from the external device, information of at least one image related to the second text, the at least one image related to the second text being at least one image corresponding to a context of a third text obtained by analyzing the first text, the selected image, and the second text; and

displaying, by the electronic device, the at least one image related to the second text based on the information of the at least one image related to the second text.

8. The method of claim 7 , wherein the at least one image corresponding to the context of the third text is obtained based on an artificial intelligence (AI) data recognition model stored in the external device.

9. The method of claim 1 , wherein the displaying of the at least one image comprises displaying the at least one image corresponding to a context of the first text in an order of a degree of relatedness with the first text.

10. The method of claim 1 , wherein only the information of the at least one image is received by the electronic device as a response to the transmitting of the first text and the request for the at least one image related to the first text to reduce a data transmission burden.

11. The method of claim 1 , wherein the information of the at least one image further includes at least one of a unique identifier (ID), a theme, a size, a creation date, a resolution, focusing, or global positioning system (GPS) information for obtaining the at least one image from the memory of the electronic device or a location of the at least one image stored in the external device to download the at least one image from the external device.

12. An electronic device comprising:

a user input interface for inputting text;

memory storing one or more computer programs;

a display;

a communicator configured to connect to an external device via a network; and

one or more processors communicatively coupled to the user input interface, the memory, the display, and the communicator,

wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

receive, via the user input interface, a first text entered by a user of the electronic device,

in response to receiving the first text, transmit, to the external device connected to the electronic device via a communicator of the electronic device, the first text and a request for at least one image related to the first text,

after transmitting the first text and the request to the external device, receive, from the external device, information of the at least one image related to the first text without the at least one image, wherein the information of the at least one image includes metadata determined by the external device based on the first text, wherein the metadata includes information about the at least one image for the electronic device to identify whether the at least one image is an image previously stored in the memory and obtain the at least one image from the memory of the electronic device,

obtain the at least one image based on the information of the at least one image, and

control the display to display the at least one image based on the information of the at least one image.

13. The electronic device of claim 12 , wherein the at least one image related to the first text is at least one image corresponding to a context of the first text.

14. The electronic device of claim 12 , wherein the information of the at least one image comprises information for the electronic device to obtain the at least one image.

15. The electronic device of claim 12 , wherein the information of the at least one image comprises at least one of an identification (ID) of the at least one image, a thumbnail image of the at least one image, or a stored location of the at least one image.

16. The electronic device of claim 12 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

receive a user input of selecting an image from the at least one image being displayed, and

control the display to display the selected image together with the first text.

17. The electronic device of claim 16 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

receive a second text entered by the user after displaying the selected image together with the first text,

transmit, to the external device via the communicator, the second text and a request for at least one image related to the second text,

receive, from the external device, information of at least one image related to the second text, the at least one image related to the second text being at least one image corresponding to a context of a third text obtained by analyzing the first text, the selected image, and the second text, and

control the display to display the at least one image related to the second text based on the information of the at least one image related to the second text.

18. The electronic device of claim 17 , wherein the at least one image corresponding to the context of the third text is obtained based on an artificial intelligence (AI) data recognition model stored in the external device.

19. The electronic device of claim 13 , wherein the at least one image corresponding to the context of the first text is obtained based on an artificial intelligence (AI) data recognition model stored in the external device.

20. The electronic device of claim 13 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

control the display to display the at least one image corresponding to the context of the first text in an order of a degree of relatedness with the first text.

21. One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to perform operations, the operations comprising:

receiving, by the electronic device, a first text entered by a user of the electronic device;

in response to receiving the first text, transmitting, by the electronic device to an external device via a communicator of the electronic device, the first text and a request for at least one image related to the first text;

after transmitting the first text and the request to the external device, receiving, by the electronic device from the external device, information of the at least one image related to the first text without the at least one image, wherein the information of the at least one image includes metadata determined by the external device based on the first text, wherein the metadata includes information about the at least one image for the electronic device to identify whether the at least one image is an image previously stored in memory and obtain the at least one image from the memory of the electronic device;

obtaining, by the electronic device, the at least one image based on the information of the at least one image; and

displaying, by the electronic device, the at least one image based on the information of the at least one image.

Priority Claims (2)
KR 10-2016-0175839 · Dec 21, 2016 · national
KR 10-2017-0148327 · Nov 8, 2017 · national
Continuity (4)
Continuation 17499320 · Oct 12, 2021
Continuation 16788827 · Feb 12, 2020
Continuation 15848473 · Dec 20, 2017
Related Publication 20230409919A1 · Dec 21, 2023
References Cited (23)
US 10503819B2 · Kang · 2019 [cited by applicant]
US 11200503B2 · Medlock et al. · 2021 [cited by applicant]
US 20060294476A1 · Buckley · 2006 [cited by examiner]
US 20070133947A1 · Armitage · 2007 [cited by examiner]
US 20140081633A1 · Badaskar · 2014 [cited by applicant]
US 20140161238A1 · Koyama · 2014 [cited by examiner]
US 20150088859A1 · Weissl et al. · 2015 [cited by applicant]
US 20150100561A1 · Li et al. · 2015 [cited by applicant]
US 20150161268A1 · Dasher et al. · 2015 [cited by applicant]
US 20150331929A1 · El-Saban et al. · 2015 [cited by applicant]
US 20160048326A1 · Kim et al. · 2016 [cited by applicant]
US 20160148072A1 · Chan et al. · 2016 [cited by applicant]
US 20160179844A1 · Shen · 2016 [cited by examiner]
US 20170262433A1 · Chester · 2017 [cited by examiner]
CN 105786978A · 2016 [cited by applicant]
KR 101300052B1 · 2013 [cited by applicant]
KR 1020140049354A · 2014 [cited by applicant]
KR 1020160021524A · 2016 [cited by applicant]
KR 1020160097352A · 2016 [cited by applicant]
Kuznetsova et al. “Collective Generation of Natural Image Descriptions”, Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 359-368 (Year: 2012). [cited by applicant]
Krishnamoorthy et al. “Generating Natural-Language Video Descriptions Using Text-Mined Knowledge”, vol. 27 No. 1 (2013): Twenty-Seventh AAAI Conference on Artificial Intelligence (Year: 2013). [cited by applicant]
Korean Office Action dated Nov. 30, 2021, issued in Korean Patent Application No. 10-2017-0148327. [cited by applicant]
Korean Notice Of Allowance dated May 4, 2022, issued in Korean Patent Application No. 10-2017-0148327. [cited by applicant]