IP Library Granted Patent US 12,591,349
Granted Patent B2
US 12,591,349 · App. 18/540,251 · Granted Mar 31, 2026

Method of processing content and electronic device thereof

Inventors: Kyung-Hwan Kim (Yongin-si, KR); Dong-Jeon Kim (Anyang-si, KR); Jin-Hong Jeong (Yongin-si, KR); Hye-Soon Jeong (Chilgok-gun, KR); Se-Jun Song (Seoul, KR); Yo-Han Lee (Seongnam-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/0481G06F3/0482G06F3/04842H04L67/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,591,349
App. No.
18/540,251
Granted
Mar 31, 2026
Kind
B2
Abstract

A method for processing contents at an electronic device is provided. The method includes generating a first content corresponding to a user input applied to content via the electronic device, and displaying a floating user interface (UI), which displays first scrap information on the first content, on a screen of the electronic device.

Claims (52)

1 . A portable communication device comprising:

a display;

memory storing one or more computer programs; and

one or more processors communicatively coupled with the display and the memory,

wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the portable communication device to:

display a first execution screen corresponding to a first application via the display;

generate a captured image corresponding to at least part of the first execution screen displayed via the display; and

based at least in part on determining that the captured image includes a portion corresponding to text, display, concurrently with the captured image, a user interface (UI) item for initiating text extraction from the captured image,

wherein the UI item is displayed on a second execution screen with the captured image and a plurality of icons corresponding to a plurality of commands, respectively, for processing the captured image, and

wherein, based at least in part on determining that the captured image does not include the portion corresponding to text, the UI item is not displayed and the plurality of icons are displayed on the second execution screen with the captured image.

2 . The portable communication device of claim 1 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the portable communication device to:

after generating the captured image, display a floating user interface corresponding to the captured image.

3 . The portable communication device of claim 2 , wherein the floating user interface includes a thumbnail of the captured image.

4 . The portable communication device of claim 1 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the portable communication device to:

receive a user input with respect to the UI item while the UI item is displayed concurrently with the captured image; and

based at least in part on the user input being received with respect to the UI item, initiate text extraction from the captured image.

5 . The portable communication device of claim 4 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the portable communication device to:

store in the memory at least part of the text extracted from the captured image.

6 . The portable communication device of claim 1 , wherein the second execution screen includes the at least part of the first execution screen.

7 . The portable communication device of claim 1 ,

wherein a size of the at least part of the first execution screen is smaller than a size of the second execution screen, and

wherein the at least part of the first execution screen is displayed in a middle region of the second execution screen.

8 . A method performed by a portable communication device, the method comprising:

displaying, by the portable communication device via a display of the portable communication device, a first execution screen corresponding to a first application;

generating, by the portable communication device, a captured image corresponding to at least part of the first execution screen displayed via the display; and

based at least in part on determining that the captured image includes a portion corresponding to text, displaying, by the portable communication device via the display concurrently with the captured image, a user interface (UI) item for initiating text extraction from the captured image,

wherein the UI item is displayed on a second execution screen with the captured image and a plurality of icons corresponding to a plurality of commands, respectively, for processing the captured image, and

wherein, based at least in part on determining that the captured image does not include the portion corresponding to text, the UI item is not displayed and the plurality of icons are displayed on the second execution screen with the captured image.

9 . The method of claim 8 , further comprising:

after generating the captured image, displaying, by the portable communication device via the display, a floating user interface corresponding to the captured image.

10 . The method of claim 9 , wherein the floating user interface includes a thumbnail of the captured image.

11 . The method of claim 8 , further comprising:

receiving, by the portable communication device, a user input with respect to the UI item while the UI item is displayed concurrently with the captured image; and

based at least in part on the user input being received with respect to the UI item, initiating text extraction from the captured image.

12 . The method of claim 11 , further comprising:

storing, by the portable communication device in a memory of the portable communication device, at least part of the text extracted from the captured image.

13 . One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of a portable communication device individually or collectively, cause the portable communication device to perform operations, the operations comprising:

displaying, by the portable communication device via a display of the portable communication device, a first execution screen corresponding to a first application;

generating, by the portable communication device, a captured image corresponding to at least part of the first execution screen displayed via the display; and

based at least in part on determining that the captured image includes a portion corresponding to text, displaying, by the portable communication device via the display concurrently with the captured image, a user interface (UI) item for initiating text extraction from the captured image,

wherein the UI item is displayed on a second execution screen with the captured image and a plurality of icons corresponding to a plurality of commands, respectively, for processing the captured image, and

wherein, based at least in part on determining that the captured image does not include the portion corresponding to text, the UI item is not displayed and the plurality of icons are displayed on the second execution screen with the captured image.

14 . The method of claim 8 , wherein the second execution screen includes the at least part of the first execution screen.

15 . The one or more non-transitory computer-readable storage media of claim 13 , the operations further comprising:

after generating the captured image, displaying, by the portable communication device via the display, a floating user interface corresponding to the captured image.

16 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the floating user interface includes a thumbnail of the captured image.

17 . The one or more non-transitory computer-readable storage media of claim 13 , the operations further comprising:

receiving, by the portable communication device, a user input with respect to the UI item while the UI item is displayed concurrently with the captured image; and

based at least in part on the user input being received with respect to the UI item, initiating text extraction from the captured image.

18 . The one or more non-transitory computer-readable storage media of claim 17 , the operations further comprising:

storing, by the portable communication device in a memory of the portable communication device, at least part of the text extracted from the captured image.

19 . The one or more non-transitory computer-readable storage media of claim 13 , wherein the second execution screen includes the at least part of the first execution screen.

Priority Claims (1)
KR 10-2014-0116514 · Sep 2, 2014 · national
Continuity (3)
Continuation 17097587 · Nov 13, 2020
Continuation 14843387 · Sep 2, 2015
Related Publication 20240118781A1 · Apr 11, 2024
References Cited (177)
US 6178270B1 · Taylor et al. · 2001 [cited by applicant]
US 6336125B2 · Noda · 2002 [cited by examiner]
US 6760728B1 · Osborn · 2004 [cited by applicant]
US 7559033B2 · Boss · 2009 [cited by examiner]
US 7568080B2 · Prahlad et al. · 2009 [cited by applicant]
US 7600198B2 · Gunderson et al. · 2009 [cited by applicant]
US 7954047B2 · Berger · 2011 [cited by examiner]
US 7966352B2 · Madan · 2011 [cited by examiner]
US 8650507B2 · Westerman · 2014 [cited by examiner]
US 8723824B2 · Myers et al. · 2014 [cited by applicant]
US 9092428B1 · Zhang et al. · 2015 [cited by applicant]
US 9098127B2 · Rana · 2015 [cited by examiner]
US 9165406B1 · Gray et al. · 2015 [cited by applicant]
US 9170714B2 · Wilhelm Martens et al. · 2015 [cited by applicant]
US 9201868B1 · Zhang et al. · 2015 [cited by applicant]
US 9237410B1 · Georghiou · 2016 [cited by examiner]
US 9429447B2 · Son et al. · 2016 [cited by applicant]
US 9645732B2 · Butcher · 2017 [cited by examiner]
US 9766694B2 · Jung · 2017 [cited by examiner]
US 10108584B2 · Song · 2018 [cited by examiner]
US 10409465B2 · Lei · 2019 [cited by examiner]
US 10645141B2 · Ko · 2020 [cited by examiner]
US 10915698B2 · Hicks · 2021 [cited by examiner]
US 20020037104A1 · Myers · 2002 [cited by examiner]
US 20020149699A1 · Mizobuchi · 2002 [cited by examiner]
US 20030103082A1 · Carroll · 2003 [cited by examiner]
US 20040252887A1 · Lim · 2004 [cited by examiner]
US 20050007455A1 · Yamazaki · 2005 [cited by examiner]
US 20060101347A1 · Runov et al. · 2006 [cited by applicant]
US 20060284981A1 · Erol et al. · 2006 [cited by applicant]
US 20070044013A1 · Hyatt · 2007 [cited by applicant]
US 20080002888A1 · Yuan · 2008 [cited by applicant]
US 20080082932A1 · Beumer · 2008 [cited by applicant]
US 20080086700A1 · Rodriguez · 2008 [cited by examiner]
US 20090052640A1 · Kovalenko · 2009 [cited by examiner]
US 20090055379A1 · Murtagh · 2009 [cited by examiner]
US 20090055778A1 · Abdelazim · 2009 [cited by examiner]
US 20090055842A1 · Murtagh · 2009 [cited by examiner]
US 20090077497A1 · Cho et al. · 2009 [cited by applicant]
US 20090089651A1 · Herberger · 2009 [cited by examiner]
US 20090125848A1 · Keohane · 2009 [cited by examiner]
US 20100122160A1 · Chirakansakcharoen · 2010 [cited by examiner]
US 20100171709A1 · Toyokawa · 2010 [cited by examiner]
US 20100195131A1 · Nakata · 2010 [cited by applicant]
US 20100199232A1 · Mistry · 2010 [cited by examiner]
US 20100210293A1 · Lim · 2010 [cited by examiner]
US 20100324887A1 · Dong · 2010 [cited by examiner]
US 20110035145A1 · Yamasaki · 2011 [cited by applicant]
US 20110081083A1 · Lee · 2011 [cited by examiner]
US 20110107206A1 · Walsh · 2011 [cited by examiner]
US 20110123115A1 · Lee · 2011 [cited by examiner]
US 20110231796A1 · Vigil · 2011 [cited by examiner]
US 20110267490A1 · Goktekin · 2011 [cited by examiner]
US 20120008864A1 · Kanatsu · 2012 [cited by examiner]
US 20120010995A1 · Skirpa · 2012 [cited by examiner]
US 20120023447A1 · Hoshino · 2012 [cited by examiner]
US 20120042272A1 · Hong et al. · 2012 [cited by applicant]
US 20120072833A1 · Song · 2012 [cited by examiner]
US 20120075180A1 · Hanazaki · 2012 [cited by examiner]
US 20120110486A1 · Sirpal · 2012 [cited by examiner]
US 20120124524A1 · Frank Szarfman · 2012 [cited by examiner]
US 20120131497A1 · Jitkoff · 2012 [cited by applicant]
US 20120144293A1 · Kim · 2012 [cited by examiner]
US 20120159334A1 · Messerly · 2012 [cited by examiner]
US 20120229397A1 · Cho · 2012 [cited by examiner]
US 20120302167A1 · Yun et al. · 2012 [cited by applicant]
US 20130011055A1 · You et al. · 2013 [cited by applicant]
US 20130013400A1 · Kim · 2013 [cited by applicant]
US 20130013987A1 · Kim · 2013 [cited by applicant]
US 20130024475A1 · Sappey · 2013 [cited by examiner]
US 20130046935A1 · Ramanathan · 2013 [cited by examiner]
US 20130104032A1 · Lee et al. · 2013 [cited by applicant]
US 20130104037A1 · Doan et al. · 2013 [cited by applicant]
US 20130117025A1 · Park et al. · 2013 [cited by applicant]
US 20130177295A1 · Cath · 2013 [cited by examiner]
US 20130182182A1 · Mountain · 2013 [cited by examiner]
US 20130187873A1 · Jeong · 2013 [cited by applicant]
US 20130232408A1 · Xu · 2013 [cited by examiner]
US 20130246039A1 · Duneau · 2013 [cited by examiner]
US 20130254714A1 · Shin et al. · 2013 [cited by applicant]
US 20130304815A1 · Puente et al. · 2013 [cited by applicant]
US 20130332878A1 · Sung · 2013 [cited by applicant]
US 20130346872A1 · Scott et al. · 2013 [cited by applicant]
US 20130346914A1 · Jeong · 2013 [cited by applicant]
US 20140053061A1 · Chasen · 2014 [cited by examiner]
US 20140062962A1 · Jang et al. · 2014 [cited by applicant]
US 20140071171A1 · Mcgowan · 2014 [cited by examiner]
US 20140075355A1 · Kim · 2014 [cited by examiner]
US 20140109004A1 · Sadhvani · 2014 [cited by examiner]
US 20140109019A1 · Rana · 2014 [cited by examiner]
US 20140123045A1 · Wilhelm Martens · 2014 [cited by examiner]
US 20140132535A1 · Kim · 2014 [cited by applicant]
US 20140136977A1 · Arun · 2014 [cited by examiner]
US 20140141836A1 · Rozumyanskiy et al. · 2014 [cited by applicant]
US 20140143664A1 · Tsang · 2014 [cited by examiner]
US 20140143681A1 · Chandra · 2014 [cited by examiner]
US 20140157169A1 · Kikin-gil · 2014 [cited by examiner]
US 20140168095A1 · Mesguich Havilio · 2014 [cited by examiner]
US 20140173460A1 · Kim · 2014 [cited by examiner]
US 20140188802A1 · Branton · 2014 [cited by examiner]
US 20140223372A1 · Dostie et al. · 2014 [cited by applicant]
US 20140258838A1 · Evers et al. · 2014 [cited by applicant]
US 20140280132A1 · Auger · 2014 [cited by examiner]
US 20140282106A1 · Smith et al. · 2014 [cited by applicant]
US 20140304280A1 · Oursbourn · 2014 [cited by examiner]
US 20140304599A1 · Alexandersson · 2014 [cited by applicant]
US 20140313143A1 · Jung et al. · 2014 [cited by applicant]
US 20140324943A1 · Antipa · 2014 [cited by examiner]
US 20140337699A1 · Tang · 2014 [cited by examiner]
US 20140372952A1 · Otero et al. · 2014 [cited by applicant]
US 20150012862A1 · Ikeda · 2015 [cited by examiner]
US 20150058369A1 · Kong et al. · 2015 [cited by applicant]
US 20150084855A1 · Song · 2015 [cited by examiner]
US 20150089356A1 · Baklanovs · 2015 [cited by examiner]
US 20150095855A1 · Bai · 2015 [cited by examiner]
US 20150116349A1 · Hamada · 2015 [cited by examiner]
US 20150169519A1 · Zhou · 2015 [cited by examiner]
US 20150207850A1 · Jitkoff · 2015 [cited by examiner]
US 20150254518A1 · Griffin · 2015 [cited by examiner]
US 20150338939A1 · Vong · 2015 [cited by examiner]
US 20160036966A1 · Ka · 2016 [cited by examiner]
US 20160055246A1 · Marcin · 2016 [cited by examiner]
US 20160062599A1 · Ko · 2016 [cited by examiner]
US 20160117854A1 · Ohtsuka · 2016 [cited by examiner]
US 20160140095A1 · Park et al. · 2016 [cited by applicant]
US 20160154686A1 · Huang · 2016 [cited by examiner]
US 20160171106A1 · Song · 2016 [cited by examiner]
US 20160210013A1 · Park et al. · 2016 [cited by applicant]
US 20160216862A1 · Turner · 2016 [cited by examiner]
US 20160266769A1 · Oursbourn · 2016 [cited by examiner]
US 20160328110A1 · Zhao et al. · 2016 [cited by applicant]
US 20170160905A1 · Lei · 2017 [cited by examiner]
US 20170220680A1 · Shattuck · 2017 [cited by applicant]
US 20170235445A1 · Kim et al. · 2017 [cited by applicant]
CN 101243706A · 2008 [cited by applicant]
CN 102567108A · 2012 [cited by applicant]
CN 102591562A · 2012 [cited by applicant]
CN 102768614A · 2012 [cited by applicant]
CN 102855079A · 2013 [cited by applicant]
CN 103092507A · 2013 [cited by applicant]
CN 103136181A · 2013 [cited by applicant]
CN 103324440A · 2013 [cited by applicant]
CN 103379212A · 2013 [cited by applicant]
CN 103389874A · 2013 [cited by applicant]
CN 103685626A · 2014 [cited by applicant]
CN 104077273A · 2014 [cited by applicant]
CN 104111772A · 2014 [cited by applicant]
KR 1020090029518A · 2009 [cited by applicant]
KR 1020090102886A · 2009 [cited by applicant]
KR 1020100030387A · 2010 [cited by applicant]
KR 1020120013810A · 2012 [cited by applicant]
KR 1020120021673A · 2012 [cited by applicant]
KR 1020120029608A · 2012 [cited by applicant]
KR 1020120076014A · 2012 [cited by applicant]
KR 1020130005057A · 2013 [cited by applicant]
KR 1020130016655A · 2013 [cited by applicant]
KR 1020130086409A · 2013 [cited by applicant]
KR 1020130143160A · 2013 [cited by applicant]
KR 1020140030391A · 2014 [cited by applicant]
KR 1020140062886A · 2014 [cited by applicant]
KR 1020140078031A · 2014 [cited by applicant]
Decision on Grant dated Dec. 26, 2023, issued in Chinese Application No. 202210534944.1. [cited by applicant]
XP055340871, Techsmith: Snagit 11 Snagit 11.4 Help; Retrieved from the internet: URL: hllps://assets.techsmith.com/Downloads/ua-tutorials-snagit-11/Snagit_ 11.pdf on Jan. 1, 2017; Jan. 14, 2014. [cited by applicant]
Chinese Office Action dated Jul. 2, 2020, issued in Chinese Patent Application No. 201580047151.5. [cited by applicant]
Chinese Office Action dated Oct. 28, 2021, issued in Chinese Patent Application No. 201580047151.5. [cited by applicant]
Chinese Office Action dated Jul. 14, 2023, issued in Chinese application No. 202210534944.1. [cited by applicant]
Korean Office Action dated Jul. 14, 2022, issued in Korean Patent Application No. 10-2022-0073958. [cited by applicant]
Chinese Office Action dated Jul. 1, 2021, issued in Chinese Patent Application No. 201580047151.5. [cited by applicant]
Chinese Office Action dated Jun. 10, 2023, issued in Chinese Patent Application No. 202210543522.0. [cited by applicant]
Indian Office Action dated Mar. 30, 2023, issued in Indian Application No. 201717011664. [cited by applicant]
Chinese Office Action dated Feb. 2, 2021, issued in Chinese Patent Application No. 201580047151.5. [cited by applicant]
Korean Office Action dated Feb. 16, 2021, issued in Korean Patent Application No. 10-2014-0116514. [cited by applicant]
Chinese Office Action dated Nov. 16, 2022, issued in Chinese Patent Application No. 202210543522.0. [cited by applicant]
Chinese Office Action dated Jan. 13, 2023, issued in Chinese Patent Application No. 202210534944. 1. [cited by applicant]
Korean Office Action dated Jun. 19, 2024, issued in Korean Application No. 10-2023-0014274. [cited by applicant]
Indian Office Action dated Apr. 4, 2025, issued in Indian Application No. 202318047507. [cited by applicant]
Indian Office Action dated Dec. 24, 2025, issued in Indian Application No. 202318047507. [cited by applicant]