IP Library › Granted Patent US 12,112,444
Granted Patent B2
US 12,112,444 · App. 17/426,538 · Granted Oct 8, 2024

Electronic device and graphic object control method of electronic device

Inventors: Yejin Kim (Gyeonggi-do, KR); Yoonjeong Kang (Gyeonggi-do, KR); Iseul Yu (Gyeonggi-do, KR); Heeyul Kim (Gyeonggi-do, KR); Sanghyun Park (Gyeonggi-do, KR); Jongil Jeong (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
G06T19/20G06T7/70G06T13/40G06T15/205G06T19/006G06V20/30G06V40/161G06V40/169G06T2207/30201G06V20/647G06V40/103G06V40/16G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,112,444
App. No.
17/426,538
Granted
Oct 8, 2024
Kind
B2
Abstract

An electronic device includes a camera, a display, and a processor, wherein the processor is configured to acquire an image using the camera, determine a 3D graphic object corresponding to an object included in the acquired image, and apply the determined 3D graphic object to a 3D avatar and display the same.

Claims (66)

1. An electronic device comprising:

a camera;

a display;

a processor; and

memory storing instructions that, when executed by the processor, cause the electronic device to:

obtain an image using the camera;

analyze an object comprised in the obtained image to detect category information and attribute information about the object to identify a type of the object;

determine a two-dimensional (2D) icon indicating the type of the object corresponding to the category information;

determine a first three-dimensional (3D) graphic object corresponding to the attribute information;

simultaneously display the 2D icon indicating the type of the object and the obtained image;

apply the first 3D graphic object to a 3D avatar to display the 3D avatar;

while the 3D avatar is being displayed on the display, obtain the image using the camera when a personalization item generation is selected with the displayed 3D avatar:

store the first 3D graphic object without the 3D avatar, as a personalization item of the 3D avatar;

analyze context information that can be identified in connection with a plurality of applications of the electronic device;

determine, as a recommended item, a second 3D graphic object related to the context information among personalization items of the 3D avatar;

display the second 3D graphic object determined as the recommended item:

apply the second 3D graphic object determined as the recommended item to the 3D avatar to display the 3D avatar; and

change and display a background screen of the 3D avatar based on the context information.

2. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:

detect a 2D graphic image from an image comprising a body part when obtaining the image using the camera; and

apply the 2D graphic image to a portion of the 3D avatar corresponding to the body part to display the 3D avatar.

3. The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:

display at least one recommended graphic image related to the 2D graphic image; and

apply a recommended graphic image selected by a user to the portion of the 3D avatar corresponding to the body part to display the 3D avatar.

4. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:

recognize a face when obtaining the image using the camera, wherein the image comprises a whole body;

determine the 3D avatar corresponding to the recognized face;

determine a plurality of objects in the image and position information about each of the plurality of objects;

determine a plurality of 3D graphic objects corresponding to the plurality of objects; and

apply the plurality of 3D graphic objects to a position of the 3D avatar corresponding to the position information about each of the plurality of objects to display the 3D avatar.

5. The electronic device of claim 4 , wherein the instructions, when executed by the processor, cause the electronic device to store the plurality of 3D graphic objects as the personalization items of the 3D avatar.

6. The electronic device of claim 1 , wherein the processor is further configured to:

identify the object comprised in the obtained image based on a selection by a user.

7. The electronic device of claim 1 , wherein the first 3D graphic object applied to the 3D avatar is displayed at a location of the 3D avatar that is selected by a user.

8. A graphic object control method of an electronic device, the method comprising:

obtaining an image using a camera;

analyzing an object comprised in the obtained image to detect category information and attribute information about the object to identify a type of the object;

determining a two-dimensional (2D) icon indicating the type of the object corresponding to the category information;

determining a first three-dimensional (3D) graphic object corresponding to the attribute information;

simultaneously displaying the 2D icon indicating the type of the object and the obtained image;

applying the determined 3D graphic object to a 3D avatar to display the 3D avatar;

while the 3D avatar is being displayed on the display, obtaining the image using the camera when a personalization item generation is selected with the displayed 3D avatar:

storing the 3D graphic object without the 3D avatar, as a personalization item of the 3D avatar;

analyzing context information that can be identified in connection with a plurality of applications of the electronic device;

determining, as a recommended item, a second 3D graphic object related to the context information among personalization items of the 3D avatar;

displaying the second 3D graphic object determined as the recommended item;

applying the second 3D graphic object determined as the recommended item to the 3D avatar to display the 3D avatar; and

changing and displaying a background screen of the 3D avatar based on the context information.

9. The graphic object control method of claim 8 , further comprising:

detecting a (2D) graphic image from an image comprising a body part when obtaining the image using the camera; and

applying the 2D graphic image to a portion of the 3D avatar corresponding to the body part to display the 3D avatar.

10. The graphic object control method of claim 9 , further comprising:

displaying at least one recommended graphic image related to the 2D graphic image; and

applying a recommended graphic image selected by a user to the portion of the 3D avatar corresponding to the body part to display the 3D avatar.

11. The graphic object control method of claim 8 , further comprising:

recognizing a face when obtaining the image using the camera, wherein the image comprises a whole body;

determining the 3D avatar corresponding to the recognized face;

determining a plurality of objects in the image and position information about each of the plurality of objects;

determining a plurality of 3D graphic objects corresponding to the plurality of objects;

applying the plurality of 3D graphic objects to a position of the 3D avatar corresponding to the position information about each of the plurality of objects to display the 3D avatar; and

storing the plurality of 3D graphic objects as the personalization items of the 3D avatar.

12. The graphic object control method of claim 8 , further comprising:

storing the plurality of 3D graphic objects as the personalization items of the 3D avatar.

13. The graphic object control method of claim 8 , further comprising:

identifying the object comprised in the obtained image based on a selection by a user.

14. The graphic object control method of claim 8 , wherein the first 3D graphic object applied to the 3D avatar is displayed at a location of the 3D avatar that is selected by a user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2021
From: KIM, YEJIN; KANG, YOONJEONG; YU, ISEUL; KIM, HEEYUL; PARK, SANGHYUN; JEONG, JONGIL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 057031/0042 →
Priority Claims (1)
KR 10-2019-0010405 · Jan 28, 2019 · national
Continuity (1)
Related Publication 20220122309A1 · Apr 21, 2022