IP Library › Granted Patent US 12,322,149
Granted Patent B2
US 12,322,149 · App. 17/720,790 · Granted Jun 3, 2025

Electronic device for implementing metaverse environment using drawing motion and method for operating the same

Inventors: Jeongwook Park (Paju-si, KR); Hwanseok Choi (Paju-si, KR); Hyojin Kim (Paju-si, KR); Jungwoo Choi (Seoul, KR); Youngsun Seo (Seoul, KR)
Assignees: WOONGJIN THINKBIG CO., LTD.; ARTYGENSPACE CO., LTD.
G06V10/255G06T11/203G06T13/80G06T19/006G06V10/761
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,149
App. No.
17/720,790
Granted
Jun 3, 2025
Kind
B2
Abstract

A method for operating an electronic device is provided. The method comprises displaying, on a display, a content including at least one area where a graphic object may be placed, obtaining at least one image, identifying a line drawing and at least one marker, based on the at least one image, identifying a first graphic object corresponding to the identified line drawing and the at least one identified marker among a plurality of pre-stored graphic objects, and displaying the first graphic object on a first area of the content corresponding to a position of at least one of the line drawing or the at least one marker.

Claims (46)

1. A method for operating an electronic device, the method comprising:

displaying, on a display of the electronic device, a content including at least one area where a graphic object is placeable;

obtaining, using a camera of the electronic device, at least one image;

identifying a line drawing and a marker from the at least one image, the line drawing including a line drawn on a real paper by a user, the marker including an image representing a real object, wherein at least a portion of the marker overlaps at least a portion of the line drawing;

identifying, among a plurality of pre-stored graphic objects, a first graphic object corresponding to a combination of a figure which the identified line drawing represents and the real object which the image included in the identified marker represents; and

displaying the first graphic object on a first area of the content corresponding to a position of at least one of the line drawing or the marker,

wherein the at least one image is not displayed on the display.

2. The method of claim 1 ,

wherein the electronic device stores information about a first line drawing and at least one first marker associated with each of the plurality of graphic objects, and

wherein the method further comprises identifying the first graphic object among the plurality of graphic objects, based on comparison between the information about the first line drawing and the at least one first marker and the information about the line drawing and the marker.

3. The method of claim 1 , further comprising:

obtaining at least one first image after displaying the first graphic object;

identifying at least one color marker placed on the line drawing from the at least one first image; and

setting a color of the first graphic object based on the at least one identified color marker.

4. The method of claim 3 , further comprising:

identifying a position of the at least one color marker placed on the line drawing; and

setting the color of a portion of the first graphic object corresponding to the position.

5. The method of claim 4 , further comprising:

obtaining at least one second image after displaying the first graphic object;

identifying a character marker from the at least one second image and displaying a virtual avatar corresponding to the character marker on the content; and

when a position of the character marker corresponds to the line drawing, applying an animation effect associated with the first graphic object to the virtual avatar.

6. The method of claim 5 , further comprising determining the animation effect based on information about the at least one-marker.

7. The method of claim 1 , further comprising:

registering the content with a server, wherein an authority for using the first graphic object is set;

identifying access, to the content, of an external electronic device;

receiving a purchase request for the first graphic object by the external electronic device; and

selling the first graphic object based on the purchase request, wherein the authority for using the first graphic object is set to the external electronic device.

8. A non-transitory computer-readable medium storing a program code executable by a processor of an electronic device, wherein when executed, the program code enables the processor to:

display, on a display of the electronic device, a content including at least one area where a graphic object is placeable;

obtain, using a camera of the electronic device, at least one image;

identify a line drawing and a marker from the at least one image, the line drawing including a line drawn on a real paper by a user, the marker including an image representing a real object, wherein at least a portion of the marker overlaps at least a portion of the line drawing;

identify, among a plurality of pre-stored graphic objects, a first graphic object corresponding to a combination of a figure which the identified line drawing represents and the real object which the image included in the identified marker represents; and

display the first graphic object on a first area of the content corresponding to a position of at least one of the line drawing or the marker,

wherein the at least one image is not displayed on the display.

9. The non-transitory computer-readable medium of claim 8 , storing information about a first line drawing and at least one first marker associated with each of the plurality of graphic objects, and wherein when executed, the program code enables the processor to identify the first graphic object among the plurality of graphic objects based on comparison between the information about the first line drawing and the at least one first marker and the information about the line drawing and the marker.

10. The non-transitory computer-readable medium of claim 8 , wherein when executed, the program code enables the processor to:

obtain at least one first image after displaying the first graphic object;

identify at least one color marker placed on the line drawing from the at least one first image; and

set a color of the first graphic object based on the at least one identified color marker.

11. The non-transitory computer-readable medium of claim 10 , wherein when executed, the program code enables the processor to:

identify a position of the at least one color marker placed on the line drawing; and

set the color of a portion of the first graphic object corresponding to the position.

12. The non-transitory computer-readable medium of claim 11 , wherein when executed, the program code enables the processor to:

obtain at least one second image after displaying the first graphic object;

identify a character marker from the at least one second image and display a virtual avatar corresponding to the character marker on the content; and

when a position of the character marker corresponds to the line drawing, apply an animation effect associated with the first graphic object to the virtual avatar.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2022
From: PARK, JEONGWOOK; CHOI, HWANSEOK; KIM, HYOJIN; CHOI, JUNGWOO; SEO, YOUNGSUN
To: WOONGJIN THINKBIG CO., LTD.; ARTYGENSPACE CO., LTD.
Reel/Frame 059601/0278 →
Priority Claims (2)
KR 10-2021-0193210 · Dec 30, 2021 · national
KR 10-2022-0035125 · Mar 22, 2022 · national
Continuity (1)
Related Publication 20230215127A1 · Jul 6, 2023
References Cited (27)
US 6954728B1 · Kusumoto et al. · 2005 [cited by applicant]
US 7348978B2 · Nagata · 2008 [cited by examiner]
US 7882222B2 · Dolbier et al. · 2011 [cited by applicant]
US 11073917B1 · Choi · 2021 [cited by examiner]
US 12019850B2 · Chanda · 2024 [cited by examiner]
US 20090077161A1 · Hamilton et al. · 2009 [cited by applicant]
US 20100321540A1 · Woo et al. · 2010 [cited by applicant]
US 20110141501A1 · Shirata · 2011 [cited by examiner]
US 20120075484A1 · Kawamoto · 2012 [cited by examiner]
US 20120218299A1 · Hayakawa · 2012 [cited by examiner]
US 20130257907A1 · Matsui · 2013 [cited by examiner]
US 20160103830A1 · Cheong · 2016 [cited by examiner]
US 20170095737A1 · Nishikawa · 2017 [cited by examiner]
US 20190279407A1 · McHugh et al. · 2019 [cited by applicant]
US 20210064858A1 · Batra · 2021 [cited by examiner]
US 20210264681A1 · Kitamura · 2021 [cited by examiner]
US 20240078352A1 · Krauthamer · 2024 [cited by examiner]
KR 100912264B1 · 2009 [cited by applicant]
KR 101221169 · 2013 [cited by applicant]
KR 101678994B1 · 2016 [cited by applicant]
KR 1020190106769A · 2019 [cited by applicant]
KR 1020200060202A · 2020 [cited by applicant]
KR 1020200066130A · 2020 [cited by applicant]
KR 102222599B1 · 2021 [cited by applicant]
KR 102297708B1 · 2021 [cited by applicant]
Korean Office Action dated Jan. 10, 2023, issued in Korean Patent Application No. 10-2022-0035125. [cited by applicant]
Korean Decision on Grant dated May 25, 2023, issued in Korean Patent Application No. 10-2022-0035125. [cited by applicant]