IP Library Granted Patent US 12,626,432
Granted Patent B2
US 12,626,432 · App. 18/306,634 · Granted May 12, 2026

Electronic device and method for providing augmented reality content

Inventors: Yoonjung Choi (Suwon-si, KR); Jiyoung Kang (Suwon-si, KR); Younghak Oh (Suwon-si, KR); Jaehyun Han (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T11/60G06F3/011G06F3/03545G06F3/04883G06T11/001G06T13/00G06V20/20G06V40/10H04N5/2628H04N23/632G06F2203/04803G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,626,432
App. No.
18/306,634
Granted
May 12, 2026
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a camera, a touch panel, a display, a communication circuit, at least one processor operatively connected with the camera, the touch panel, the display, and the communication circuit, and a memory operatively connected with the at least one processor The memory stores one or more instructions, when executed, causing the at least one processor to display a first image captured by the camera and a second image received from an external electronic device through the communication circuit on the display, display first augmented reality content on the first image, display second augmented reality content on the second image, and display an animation effect of the first augmented reality content using the second augmented reality content based on a user input through the touch panel.

Claims (77)

1 . An electronic device, comprising:

a camera;

a touch panel;

a display;

a communication circuit;

at least one processor operatively connected with the camera, the touch panel, the display, and the communication circuit; and

a memory operatively connected with the at least one processor,

wherein the memory stores one or more instructions, when executed, causing the at least one processor to:

display a first image captured by the camera and a second image received from an external electronic device through the communication circuit on the display,

receive a drawing input of a first user of the electronic device on the displayed first image,

display first augmented reality content obtained by the electronic device based on the drawing input of the first user of the electronic device on the displayed first image,

display second augmented reality content obtained by the external electronic device based on a drawing input of a second user of the external electronic device on the second image, and

display an animation effect of the first augmented reality content using the second augmented reality content based on a user input through the touch panel.

2 . The electronic device of claim 1 ,

wherein the first augmented reality content is generated based on the drawing input of the first user, and

wherein the second augmented reality content is generated based on the drawing input of the second user and is transmitted from the external electronic device through the communication circuit.

3 . The electronic device of claim 2 , wherein the drawing input of the first user or the drawing input of the second user comprises an input using a stylus pen.

4 . The electronic device of claim 1 , wherein the instructions further cause the at least one processor to:

identify at least one object included in the first augmented reality content and the second augmented reality content, and

display the animation effect corresponding to the identified at least one object among animation effects specified according to objects, in response to the user input.

5 . The electronic device of claim 1 ,

wherein the animation effect comprises at least one animation effect for the same object, and

wherein the instructions further cause the at least one processor to:

display the animation effect corresponding to the user input among the at least one animation effect.

6 . The electronic device of claim 1 ,

wherein the first image comprises a preview image obtained by the camera, and

wherein the second image comprises a preview image obtained by a camera of the external electronic device.

7 . The electronic device of claim 1 , wherein the instructions further cause the at least one processor to:

identify a body part of a first user where the first augmented reality content is displayed from the first image, and

display the first augmented reality content on a body part of a second user, the body part corresponding to the body part of the first user, on the second image.

8 . The electronic device of claim 7 , wherein the instructions further cause the at least one processor to:

identify a body part of the second user where the second augmented reality content is displayed from the second image, and

display the second augmented reality content on a body part of the first user, the body part corresponding to the body part of the second user, on the first image.

9 . The electronic device of claim 1 ,

wherein the instructions further cause the at least one processor to:

transmit the first augmented reality content to the external electronic device through the communication circuit.

10 . The electronic device of claim 1 ,

wherein the camera comprises a first camera disposed towards the same direction as a direction where a display area of the display is exposed and a second camera disposed towards a direction opposite to the direction of the first camera, and

wherein the instructions further cause the at least one processor to:

display a third image captured by the first camera, a fourth image captured by the second camera, and a fifth image in which the third image and the fourth image are synthesized with each other,

display third augmented reality content on the fifth image as the third augmented reality content is displayed on the third image based on a user input through the touch panel and display fourth augmented reality content on the fifth image as the fourth augmented reality content is displayed on the fourth image based on a user input through the touch panel, and

store the fifth image where at least one of the third augmented reality content or the fourth augmented reality content is displayed.

11 . The electronic device of claim 10 , wherein the instructions further cause the at least one processor to:

recognize a specified body part of a user from the third image or the fourth image, and

change a location where the third augmented reality content or the fourth augmented reality content is displayed on the fifth image based on interaction using the specified body part or display an animation effect of the third augmented reality content or an animation effect of the fourth augmented reality content.

12 . The electronic device of claim 1 , further comprising:

a sensor,

wherein the instructions further cause the at least one processor to:

detect, by the sensor, proximity of a body part of a user or a stylus pen to the display using the sensor, and

activate and display a user interface for generating augmented reality content on the display based on an input using the body part of the user or the stylus pen, based on the detected result of the sensor.

13 . The electronic device of claim 12 ,

wherein the user interface comprises a color selection element and a virtual pen selection element, and

wherein the instructions further cause the at least one processor to:

change at least one of a color or a line type of the augmented reality content based on a user input through the user interface.

14 . The electronic device of claim 12 ,

wherein the display comprises a flexible display, and

wherein the instructions further cause the at least one processor to:

sense a change in display size using the sensor, and

adjust the user interface to correspond to the display size.

15 . The electronic device of claim 14 , wherein the instructions further cause the at least one processor to:

change a size or layout of at least one element included in the user interface to correspond to the display size.

16 . A method for providing augmented reality content, performed by an electronic device, comprises:

displaying a first image captured by a camera of the electronic device and a second image received from an external electronic device through a communication circuit of the electronic device;

receiving a drawing input of a first user of the electronic device on the displayed first image,

displaying first augmented reality content obtained by the electronic device based on the drawing input of the first user of the electronic device on the displayed first image on a display of the electronic device;

displaying second augmented reality content obtained by the external electronic device based on a drawing input of a second user of the external electronic device on the second image; and

displaying an animation effect of the first augmented reality content using the second augmented reality content based on a user input through a touch panel of the electronic device.

17 . The method of claim 16 ,

wherein the first augmented reality content is generated based on the drawing input of the first user, and

wherein the second augmented reality content is generated based on the drawing input of the second user and is transmitted from the external electronic device through the communication circuit.

18 . The method of claim 17 , wherein the drawing input of the first user or the drawing input of the second user comprises an input using a stylus pen.

19 . The method of claim 16 , further comprising:

identifying at least one object included in the first augmented reality content and the second augmented reality content; and

displaying the animation effect corresponding to the identified at least one object among animation effects specified according to objects, in response to the user input.

20 . The method of claim 16 ,

wherein the animation effect comprises at least one animation effect for the same object, and

wherein the displaying of the animation effect comprises a preview image obtained by a camera of the external electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2023
From: CHOI, YOONJUNG; KANG, JIYOUNG; OH, YOUNGHAK; HAN, JAEHYUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063434/0159 →
Priority Claims (1)
KR 10-2020-0178885 · Dec 18, 2020 · national
Continuity (2)
Continuation PCTKR2021019060 · Dec 15, 2021
Related Publication 20230260177A1 · Aug 17, 2023
References Cited (38)
US 9313451B2 · Kim et al. · 2016 [cited by applicant]
US 9445043B2 · Turbell · 2016 [cited by applicant]
US 10057305B2 · Woolsey et al. · 2018 [cited by applicant]
US 10559111B2 · Sachs et al. · 2020 [cited by applicant]
US 10643664B1 · Taine et al. · 2020 [cited by applicant]
US 10937240B2 · Anderson · 2021 [cited by applicant]
US 10950275B2 · Taine et al. · 2021 [cited by applicant]
US 10977873B2 · Lee et al. · 2021 [cited by applicant]
US 11081142B2 · Taine et al. · 2021 [cited by applicant]
US 11169686B2 · Kim et al. · 2021 [cited by applicant]
US 11450050B2 · Berger et al. · 2022 [cited by applicant]
US 11465044B2 · Kim et al. · 2022 [cited by applicant]
US 11867904B2 · Choi · 2024 [cited by examiner]
US 20140380186A1 · Kim · 2014 [cited by examiner]
US 20160127682A1 · Turbell · 2016 [cited by examiner]
US 20200074705A1 · Berger · 2020 [cited by examiner]
US 20210192858A1 · Lee et al. · 2021 [cited by applicant]
US 20220343574A1 · Berger et al. · 2022 [cited by applicant]
CN 110536094A · 2019 [cited by applicant]
JP 2019121362A · 2019 [cited by applicant]
JP 6553212B2 · 2019 [cited by applicant]
KR 1020120120858A · 2012 [cited by applicant]
KR 20120120858A · 2012 [cited by examiner]
KR 1020130010590A · 2013 [cited by applicant]
KR 20130010590A · 2013 [cited by examiner]
KR 1020130101823A · 2013 [cited by applicant]
KR 1020140089146A · 2014 [cited by applicant]
KR 1020140147497A · 2014 [cited by applicant]
KR 1020160086560A · 2016 [cited by applicant]
KR 1020170078785A · 2017 [cited by applicant]
KR 1020170112406A · 2017 [cited by applicant]
KR 101961241B1 · 2019 [cited by applicant]
KR 101970352B1 · 2019 [cited by applicant]
KR 102142262B1 · 2020 [cited by applicant]
KR 102145748B1 · 2020 [cited by applicant]
KR 102364275B1 · 2022 [cited by applicant]
International Search Report dated Mar. 23, 2022, issued in International Patent Application No. PCT/KR2021/019060. [cited by applicant]
Korean Office Action dated Sep. 1, 2025, issued in a Korean Patent Application No. 10-2020-0178885. [cited by applicant]