Display device and operation method thereof
A display device includes a display, an image receiver configured to receive video content having a first style, a memory storing one or more instructions and including one or more neural networks, and at least one processor configured to execute the one or more instructions stored in the memory to execute the one or more instructions to obtain a feature corresponding to a second style, transfer, by the one or more neural networks, a style of frame images of the video content from the first style to the second style based on the feature, and control the display to display frame images having the second style.
1 . A display device comprising:
a display;
an image receiver configured to receive game content having a first style;
a memory storing one or more instructions and comprising one or more neural networks; and
at least one processor configured to execute the one or more instructions stored in the memory to:
obtain a first feature information of a first frame image among frame images of the game content;
obtain a feature corresponding to a second style;
transfer, by using the one or more neural networks, a style of the first frame image from the first style to the second style based on the first feature information and the feature; and
control the display to display the first frame images image having the second style,
wherein the transferring the style of the first frame image includes converting an appearance of characters or a background style in the first frame image while maintaining content features of the characters or background in the first frame image, and
wherein the at least one processor is further configured to execute the one or more instructions to, based on a scene of the first frame image being different from a scene of a previous frame image, extract the first feature information of the first frame image by using a first neural network.
2 . The display device of claim 1 , wherein the memory is configured to store at least one of a plurality of features or a plurality of style images corresponding to a plurality of styles,
wherein the display device further comprises a wireless communication interface configured to receive a user input for selecting one of the plurality of styles, and
wherein the at least one processor is further configured to obtain the feature corresponding to the one of the plurality of styles selected in the user input.
3 . The display device of claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to:
obtain a style image having the second style; and
extract the feature from the style image via a feature extraction network.
4 . The display device of claim 3 , further comprising a communication interface configured to communicate with an external device,
wherein the at least one processor is further configured to execute the one or more instructions to control the communication interface to receive the style image from the external device.
5 . The display device of claim 1 , further comprising;
a wireless communication interface configured to receive a user input for switching an operation of the display device to a game mode,
wherein the at least one processor is further configured to execute the one or more instructions to:
control the display device to operate in the game mode based on the user input for switching the operation of the display device to the game mode; and
provide a user interface for selecting the feature based on the display device operating in the game mode.
6 . The display device of claim 5 , wherein the at least one processor is further configured to execute the one or more instructions to control the display to display a style settings menu for selecting one of a plurality of styles based on the display device operating in the game mode.
7 . The display device of claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to:
obtain the first frame image having the style transferred to the second style by inputting the first feature information and the feature to a second neural network.
8 . The display device of claim 7 , wherein the at least one processor is further configured to execute the one or more instructions to extract, by a third neural network, the feature from a style image corresponding to the second style.
9 . The display device of claim 7 , wherein the at least one processor is further configured to execute the one or more instructions to:
obtain a downscaled version of a second frame image that is included in a same scene as the first frame image; and
obtain the second frame image having the style transferred to the second style by inputting the first feature information, the feature, and the downscaled version of the second frame image to the second neural network.
10 . An operation method of a display device, the operation method comprising:
receiving game content having a first style;
obtaining a first feature information of a first frame image among frame images of the game content;
obtaining a feature corresponding to a second style;
transferring, by using one or more neural networks, a style of the first frame image from the first style to the second style based one on the first feature information and the feature; and
displaying the first frame image having the second style,
wherein the transferring the style of the first frame image includes converting an appearance of characters or a background style in the first frame image while maintaining content features of the characters or background in the first frame image, and
wherein the obtaining the first feature information of the first frame image includes based on a scene of the first frame image being different from a scene of a previous frame image, extracting the first feature information of the first frame image by using a first neural network.
11 . The operation method of claim 10 , further comprising:
storing at least one of a plurality of features or a plurality of style images, corresponding to a plurality of styles; and
receiving a user input for selecting one of the plurality of styles,
wherein the obtaining of the feature corresponding to the second style comprises obtaining the feature corresponding to the one of the plurality of styles selected in the user input.
12 . The operation method of claim 10 , further comprising
obtaining a style image having the second style, and
wherein the obtaining of the feature corresponding to the second style comprises extracting the feature from the style image via a feature extraction network.
13 . The operation method of claim 12 , wherein the obtaining of the style image corresponding to the second style further comprises receiving the style image from an external device.
14 . The operation method of claim 10 , further comprising:
receiving a user input for switching an operation of the display device to a game mode;
operating, by the display device, in the game mode based on the user input; and
providing a user interface for selecting the feature based on the display device operating in the game mode.
15 . A non-transitory computer-readable recording medium having stored thereon a program for performing the operation method of claim 10 .