Image display device for displaying virtual reality image, and display method therefor
An example image display device may include a display; a sensor unit; a communication unit; a memory; and a processor. The processor may control the sensor unit to obtain a first position of at least one external device, and a second position of a user, control the sensor unit to recognize a gesture of the user with respect to the at least one external device, control the communication unit to transmit, to a server, sensing data associated with the first position, the second position, and the gesture of the user with respect to the at least one external device, control the communication unit to receive, from the server, a first virtual scenario that is selected, based on the sensing data, from among a plurality of virtual scenarios associated with the at least one external device, and control the display to display a virtual reality image that reflects the first virtual scenario.
1 . An image display device comprising:
a display;
a sensor;
a communication circuit; and
memory storing one or more instructions; and
at least one processor, comprising processing circuitry,
wherein the one or more instructions, when executed by the at least one processor, cause the image display device to:
obtain, via the sensor, a first position of at least one external device, and a second position of a user,
recognize a gesture of the user directed to the at least one external device,
transmit, to a server, via the communication circuit, sensing data associated with the first position, the second position, and the gesture of the user,
receive, from the server, via the communication circuit, a first virtual scenario selected, based on the sensing data, from among a plurality of virtual scenarios associated with the at least one external device, and
display, via the display, a virtual reality image that reflects the first virtual scenario.
2 . The image display device of claim 1 , wherein memory stores identification information associated with a type of the at least one external device.
3 . The image display device of claim 1 , wherein the sensor comprises an ultra-wideband (UWB) sensor.
4 . The image display device of claim 3 , wherein the UWB sensor is configured to obtain the first position by detecting a first tag attached to the at least one external device, and obtain the second position by detecting a second tag attached to the user.
5 . The image display device of claim 1 , wherein the sensor comprises at least one of an image sensor, a distance sensor, a time-of-flight (ToF) sensor, or an orientation sensor.
6 . The image display device of claim 5 , wherein the memory stores one or more instructions which, when executed by at least one processor, cause the image display device to receive, from the server, via the communication circuit, the first virtual scenario selected by determining, based on the gesture, an intention of the user.
7 . The image display device of claim 1 , wherein the plurality of virtual scenarios comprises virtual scenarios associated with guidance on use of a function of the at least one external device, an internal structure of the at least one external device when disassembled, replacement of a part in the at least one external device, and/or repair of the at least one external device.
8 . The image display device of claim 1 , wherein
the sensing data is input into a model of the server to be used to train the model to learn, from the sensing data, a frequency of proximity between a hand of the user performing the gesture and the at least one external device, a shape of the hand, and a position pattern between the hand and the at least one external device, and
the first virtual scenario is selected from among the plurality of virtual scenarios using the trained model.
9 . The image display device of claim 1 , wherein the memory stores one or more instructions which, when executed by at least one processor, cause the image display device to display, via the display, the virtual reality image showing at least one of a method of using the at least one external device, a method of disassembling the at least one external device, a method of replacing a part in the at least one external device, or a method of repairing the at least one external device, according to the first virtual scenario.
10 . The image display device of claim 1 , wherein the memory stores one or more instructions which, when executed by at least one processor, cause the image display device to display, via the display, the virtual reality image showing a modified form of the at least one external device according to the first virtual scenario.
11 . A display method of an image display device, the method comprising:
obtaining, via a sensor of the image display device, a first position of at least one external device, and a second position of a user;
recognizing a gesture of the user directed to the at least one external device;
transmitting, to a server, via a communication circuit of the image display device, sensing data associated with the first position, the second position, and the gesture of the user;
receiving, from the server, via the communication circuit, a first virtual scenario selected, based on the sensing data, from among a plurality of virtual scenarios associated with the at least one external device; and
displaying, on a display of the image display device, a virtual reality image that reflects the first virtual scenario.
12 . The method of claim 11 , wherein memory of the image display device stores identification information associated with a type of the at least one external device.
13 . The method of claim 11 , wherein the sensor unit comprises an ultra-wideband (UWB) sensor.
14 . The method of claim 13 , wherein the UWB sensor is configured to obtain the first position by detecting a first tag attached to the at least one external device, and obtain the second position by detecting a second tag attached to the user.
15 . The display-method of claim 11 , wherein the sensor comprises at least one of an image sensor, a distance sensor, a time-of-flight (ToF) sensor, or an orientation sensor.
16 . A non-transitory computer-readable storage medium storing instructions which, when executed by at least one processor of an image display device, cause the image display device to:
obtain, via a sensor of the image display device, a first position of at least one external device, and a second position of a user;
recognize a gesture of the user directed to the at least one external device;
transmit, to a server, via a communication circuit of the image display device, sensing data associated with the first position, the second position, and the gesture of the user;
receive, from the server, via the communication circuit, a first virtual scenario selected, based on the sensing data, from among a plurality of virtual scenarios associated with the at least one external device; and
display, on a display of the image display device, a virtual reality image that reflects the first virtual scenario.
17 . The image display device of claim 1 , wherein the memory stores one or more instructions which, when executed by at least one processor, cause the image display device to:
obtain, via the sensor, the first position of the at least one external device by detecting a first tag attached to the at least one external device, and
obtain, via the sensor, the second position of the user by detecting a second tag attached to the user.
18 . The method of claim 11 , wherein the obtaining of the first position of the at least one external device and the second position of the user comprises:
obtaining, via the sensor, the first position of the at least one external device by detecting a first tag attached to the at least one external device, and
obtaining, via the sensor, the second position of the user by detecting a second tag attached to the user.