IP Library › Granted Patent US 12,632,642
Granted Patent B2
US 12,632,642 · App. 18/098,478 · Granted May 19, 2026

Electronic device for displaying and modifying images, and control method

Inventor: Jihoon Lee (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F40/166G06F3/04883G06F3/167G06F40/40G06V20/635G10L25/57G06F2203/04803G09B5/065
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,632,642
App. No.
18/098,478
Granted
May 19, 2026
Kind
B2
Abstract

A control method for an electronic device includes displaying a video in a first area of a display; identifying a writing area, including at least one piece of writing information, from the video displayed in the first area; acquiring a first image corresponding to the identified writing area, so as to display the first image in a second area of the display; based on a change being detected in the at least one writing information, identifying a type of the change; and acquiring a second image formed by correcting a first image based on the type of the identified change, so as to display the second image in the second area.

Claims (38)

1 . A control method for an electronic device, the control method comprising:

displaying a video in a first area of a display;

identifying a writing area including at least one writing information in the video displayed in the first area;

acquiring a first image corresponding to the identified writing area and displaying the first image in a second area of the display;

based on a change being detected in the at least one writing information, identifying at least one of voice data or subtitle data, corresponding to the changed writing information;

identifying a type of the change based on at least one of the identified at least one of the voice data or the subtitle data, and at least one of a maintenance period of a deleted writing information or a size of an area corresponding to the changed writing information; and

acquiring a second image in which the first image is modified based on the identified type of the change and displaying the second image in the second area,

wherein the identifying the writing area comprises identifying a first sub-writing area in the writing area, and identifying a second sub-writing area in the writing area based on the at least one writing information in the second sub-writing area being located at least a predetermined distance from the first sub-writing area, and

wherein the acquiring the first image and displaying the first image in the second area of the display comprises sequentially displaying a first sub image corresponding to the first sub-writing area and a second sub image corresponding to the second sub-writing area, in the second area.

2 . The control method of claim 1 , wherein the change comprises adding new writing information to an area that includes the deleted writing information, and

the type of the change includes at least one of correcting a typographical error, explaining a changed content, and deleting to secure the writing area.

3 . The control method of claim 2 , wherein the acquiring the second image and displaying the second image in the second area further comprises generating the second image by replacing the writing information deleted from the first image with the added new writing information based on the type of the change being identified as the change to correct the typographical error.

4 . The control method of claim 2 , wherein the acquiring the second image and displaying the second image in the second area further comprises generating the second image including the writing information deleted from the first image, an indicator indicating the deleted writing information, and the added new writing information based on the type of the change being identified as the change to explain the changed content.

5 . The control method of claim 2 , wherein the acquiring the second image and displaying the same in the second area further includes generating the second image including the first image and the added new writing information based on the type of the change being identified as the change to secure the writing area.

6 . The control method of claim 1 , wherein the acquiring the second image and displaying the second image in the second area further comprises:

displaying the second image in a third area for handwriting recommendation while displaying the first image in the second area; and

changing the first image displayed in the second area to the second image and displaying the second image based on a user input for including the second image in the second area.

7 . The control method of claim 1 , wherein the acquiring the first image and displaying the first image in the second area of the display further comprises:

displaying the first sub image and the second sub image in a third area for handwriting recommendation; and

displaying an image selected from the first sub image and the second sub image in the second area.

8 . The control method of claim 1 , further comprising performing a drawing function based on a user input for drawing being detected on the second image displayed in the second area.

9 . An electronic device comprising:

a memory storing at least one instruction;

a display; and

a processor configured to execute the at least one instruction to:

control the display to display a video in a first area of the display,

identify a writing area including at least one writing information in the video displayed in the first area,

acquire a first image corresponding to the identified writing area and control the display to display the first image in a second area of the display,

based on detecting a change in the at least one writing information, identify at least one of voice data or subtitle data, corresponding to the changed writing information,

identify a type of the change based on at least one of the identified at least one of the voice data or the subtitle data, and at least one of a maintenance period of a deleted writing information or a size of an area corresponding to the changed writing information, and

acquire a second image in which the first image is modified based on the identified type of the change and control the display to display the second image in the second area,

wherein the processor is further configured to execute the at least one instruction to:

identify the writing area by identifying a first sub-writing area in the writing area, and identifying a second sub-writing area in the writing area based on the at least one writing information in the second sub-writing area being located at least a predetermined distance from the first sub-writing area, and

control the display to sequentially display a first sub image corresponding to the first sub-writing area and a second sub image corresponding to the second sub-writing area, in the second area.

10 . The electronic device of claim 9 , wherein the change comprises adding new writing information to an area that includes the deleted writing information, and

the type of the change comprises at least one of correcting a typographical error, explaining a changed content, and deleting to secure the writing area.

11 . The electronic device of claim 10 , wherein the processor is further configured to execute the at least one instruction to generate the second image by replacing the writing information deleted from the first image with the added new writing information based on identifying the type of the change as the change to correct the typographical error.

12 . The electronic device of claim 10 , wherein the processor is further configured to execute the at least one instruction to generate the second image including the writing information deleted from the first image, an indicator indicating the deleted writing information, and the added new writing information based on identifying the type of the change as the change to explain the changed content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2023
From: LEE, JIHOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 062413/0821 →
Priority Claims (1)
KR 10-2020-0092362 · Jul 24, 2020 · national
Continuity (2)
Continuation PCTKR2021007202 · Jun 9, 2021
Related Publication 20230153517A1 · May 18, 2023
References Cited (30)
US 8639032B1 · Voorhees · 2014 [cited by examiner]
US 10223928B2 · Nakatsu · 2019 [cited by applicant]
US 11003839B1 · Hatch · 2021 [cited by examiner]
US 11397506B2 · Takanashi · 2022 [cited by applicant]
US 20030124502A1 · Chou · 2003 [cited by examiner]
US 20150106098A1 · Inutsuka · 2015 [cited by examiner]
US 20170255446A1 · Malatesha · 2017 [cited by examiner]
US 20170285930A1 · Sykes · 2017 [cited by examiner]
US 20180032494A1 · Charles · 2018 [cited by examiner]
US 20180350121A1 · Samuel · 2018 [cited by examiner]
US 20210004136A1 · Takanashi · 2021 [cited by examiner]
JP 2003241630A · 2003 [cited by applicant]
JP 2019128850A · 2019 [cited by applicant]
JP 2019212000A · 2019 [cited by applicant]
KR 1019990074180A · 1999 [cited by applicant]
KR 100386842B1 · 2003 [cited by applicant]
KR 100395883B1 · 2003 [cited by applicant]
KR 1020070005761A · 2007 [cited by applicant]
KR 20070005761A · 2007 [cited by examiner]
KR 1020120101206A · 2012 [cited by applicant]
KR 1020130087871A · 2013 [cited by applicant]
KR 1020150000595A · 2015 [cited by applicant]
KR 1020160058433A · 2016 [cited by applicant]
KR 101843133B1 · 2018 [cited by applicant]
KR 101928524B1 · 2018 [cited by applicant]
WO 0244830A2 · 2002 [cited by applicant]
International Search Report (PCT/ISA/210) issued Sep. 17, 2021 by the International Searching Authority in International Patent Application No. PCT/KR2021/007202. [cited by applicant]
Written Opinion (PCT/ISA/237) issued Sep. 17, 2021 by the International Searching Authority in International Patent Application No. PCT/KR2021/007202. [cited by applicant]
“Mega Study Smart Learning”, 2022, megastudyEdu Co., Ltd, 8 pages total, https://play.google.com/store/apps/details?id=net.megastudy.smartplay.main&hl=ko. [cited by applicant]
Communication dated Jan. 6, 2025 issued by the Korean Intellectual Property Office in Korean Patent Application No. 10-2020-0092362. [cited by applicant]