Method for providing virtual image corresponding to digital item, and augmented reality device

1 . A method of providing a virtual image corresponding to a digital item, the method comprising:

generating the virtual image corresponding to the digital item owned by a user of an augmented reality device, the generating comprising:

determining whether an image is extractable from the digital item by confirming the presence of a graphic information in the digital item;

based on a determination that the image is extractable from the digital item, extracting the image from the digital item for use as the virtual image; and

based on a determination that no image is extractable from the digital item, generating an image in two dimensions (2D) or three dimensions (3D) based on metadata including a title or a file format of the digital item for use as the virtual image;

obtaining mapping location information of a real world object to which the generated virtual image is to be mapped;

mapping and rendering the virtual image based on the obtained mapping location information; and

displaying the rendered virtual image on a display of the augmented reality device according to public setting information.

2 . The method of claim 1 , wherein the generating of the image based on attributes of the digital item for the virtual image comprises:

providing a list of digital items;

analyzing attributes of a digital item selected by the user;

providing a prototype list of the virtual image based on the analyzed attributes; and

generating the virtual image according to a prototype selected by the user.

3 . The method of claim 2 , wherein the providing of the prototype list comprises:

determining whether there is an image to be extracted from the selected digital item;

based on an image being extractable from the selected digital item, extracting the image from the selected digital item, and based on no image being extractable from the selected digital item, generating an image based on the attributes of the selected digital item; and

providing the prototype list of the virtual image based on the extracted image or the generated image.

4 . The method of claim 3 , wherein the generating of the virtual image according to the prototype selected by the user comprises:

determining whether the prototype selected by the user is in a three-dimensional form; and

based on the selected prototype being in the three-dimensional form, generating a three-dimensional virtual image by using an augmented reality fitting library, and based on the selected prototype not being in the three-dimensional form, generating a two-dimensional virtual image according to the selected prototype.

5 . The method of claim 1 , wherein the obtaining of the mapping location information comprises:

obtaining a real world object model corresponding to the real world object; and

placing the virtual image at a predetermined marker location corresponding to the obtained real world object model.

6 . The method of claim 1 , wherein the mapping and rendering of the virtual image comprises:

adjusting, according to the user's input, the virtual image placed based on the obtained mapping location information; and

readjusting the adjusted virtual image according to a change in coordinates of the obtained mapping location information.

7 . The method of claim 1 , wherein the displaying of the rendered virtual image according to the public setting information comprises:

displaying a menu for receiving a user input for the public setting information;

obtaining the public setting information according to the user input; and

displaying the rendered virtual image according to the obtained public setting information,

wherein the public setting information comprises at least one of an item to be disclosed from among metadata items of the digital item corresponding to the rendered virtual image, a condition for disclosing the rendered virtual image, or an access right for the rendered virtual image.

8 . The method of claim 1 , further comprising transmitting information about the rendered virtual image to a server providing an augmented reality service,

wherein the information about the rendered virtual image comprises graphic information of the virtual image and mapping location information of the real world object.

9 . The method of claim 8 , further comprising:

receiving, from the server providing the augmented reality service, information about a virtual image related to another real world object and rendered by another augmented reality device; and

displaying the virtual image related to the other real world object on the display based on the received information about the virtual image related to the other real world object.

10 . The method of claim 1 , wherein the digital item is a digital asset selected from a product being purchased or traded on a virtual world platform, user-generated content (UGC), and a non-fungible token (NFT).

11 . One or more non-transitory computer-readable storage media storing computer-executable instructions that, when executed by one or more processors individually or collectively, cause an augmented reality device to perform operations of providing a virtual image corresponding to a digital item, the operations comprising:

generating the virtual image corresponding to the digital item owned by a user of an augmented reality device, the generating of the virtual image comprising:

determining whether an image is extractable from the digital item by confirming the presence of a graphic information in the digital item;

based on a determination that the image is extractable from the digital item, extracting the image from the digital item for use as the virtual image; and

based on a determination that no image is extractable from the digital item, generating an image in two dimensions (2D) or three dimensions (3D) based on metadata including a title or a file format of the digital item for use as the virtual image;

obtaining mapping location information of a real world object to which the generated virtual image is to be mapped;

mapping and rendering the virtual image based on the obtained mapping location information; and

displaying the rendered virtual image on a display of the augmented reality device according to public setting information.

12 . The one or more non-transitory computer-readable storage media of claim 11 , wherein the generating of the image based on attributes of the digital item for the virtual image comprises:

providing a list of digital items;

analyzing attributes of a digital item selected by the user;

providing a prototype list of the virtual image based on the analyzed attributes; and

generating the virtual image according to a prototype selected by the user.

13 . An augmented reality device providing a virtual image corresponding to a digital item, the augmented reality device comprising:

memory storing one or more computer programs;

a camera;

a display engine;

a display;

a gaze tracking sensor; and

one or more processors communicatively coupled to the camera, the display engine, the display, and the gaze tracking sensor,

wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

control the display engine to generate a virtual image corresponding to a digital item owned by a user of the augmented reality device, the generation being operations comprising:

determining whether an image is extractable from the digital item by confirming the presence of a graphic information in the digital item;

based on a determination that the image is extractable from the digital item, extracting the image from the digital item for use as the virtual image; and

based on a determination that no image is extractable from the digital item, generating an image in two dimensions (2D) or three dimensions (3D) based on metadata including a title or a file format of the digital item for use as the virtual image,

obtain mapping location information of a real world object, to which the generated virtual image is to be mapped, by using the camera and the gaze tracking sensor,

map and render the virtual image based on the obtained mapping location information by controlling the display engine, and

display the rendered virtual image on the display according to public setting information.

14 . The augmented reality device of claim 13 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

control the display engine to provide a list of digital items through the display,

analyze attributes of a digital item selected by the user,

control the display engine and provide a prototype list of the virtual image through the display based on the analyzed attributes, and

control the display engine and generate the virtual image according to a prototype selected by the user.

15 . The augmented reality device of claim 14 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

determine whether there is an image to be extracted from the selected digital item,

based on an image being extractable from the selected digital item, extract the image from the selected digital item, and based on no image being extractable from the selected digital item, generate an image based on the attributes of the selected digital item, and

provide the prototype list of the virtual image based on the extracted image or the generated image.

16 . The augmented reality device of claim 15 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

determine whether the prototype selected by the user is in a three-dimensional form, and

based on the selected prototype being in the three-dimensional form, generate a three-dimensional virtual image by using an augmented reality fitting library, and based on the selected prototype not being in the three-dimensional form, generate a two-dimensional virtual image according to the selected prototype.

17 . The augmented reality device of claim 13 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

obtain a real world object model corresponding to the real world object by using the camera and the gaze tracking sensor, and

place the virtual image at a predetermined marker location corresponding to the obtained real world object model, thereby obtaining mapping location information of the real world object.

18 . The augmented reality device of claim 17 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

control the display engine to adjust the placed virtual image according to the user's input based on the obtained mapping location information; and

perform rendering of the virtual image by readjusting the adjusted virtual image according to a change in coordinates of the obtained mapping location information.

19 . The augmented reality device of claim 18 ,

wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

by executing the one or more instructions,

display, on the display, a menu for receiving a user input for the public setting information,

obtain the public setting information according to the user input, and

display the rendered virtual image on the display according to the obtained public setting information, and

wherein the public setting information comprises at least one of an item to be disclosed from among metadata items of the digital item corresponding to the rendered virtual image, a condition for disclosing the rendered virtual image, or an access right for the rendered virtual image.

20 . The augmented reality device of claim 13 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

transmit information about the rendered virtual image to a server providing an augmented reality service,

wherein the information about the rendered virtual image comprises graphic information of the virtual image and mapping location information of the real world object.

21 . The augmented reality device of claim 20 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the augmented reality device to:

receive, from the server providing the augmented reality service, information about a virtual image related to another real world object and rendered by another augmented reality device, and

display the virtual image related to the other real world object on the display based on the received information about the virtual image related to the other real world object.