Method, device and computer program for providing image search information
The present invention relates to a method, device and computer program for providing image search information. The method for an electronic device to provide image search information according to the present invention comprises: a step of generating a query by using an image if a predetermined query generation event occurs while playing the image; a step of transmitting the query to a server; and a step of receiving a search result corresponding to the query from the server and displaying same on a screen, wherein the search result is a search result of at least one object included in the image. A purpose of the invention is to provide a method, device and program for providing image search information, allowing the search of a product similar to a product exposed in an image, without an additional input of a search word.
1. A method of providing video search information by an electronic device, the method comprising:
displaying a time remaining to generate a query on a screen when a pause event is detected during reproduction of a video; and
determining that a first query generation event is made when there is no user input before the remaining time reaches 0;
based on a determination that the first query generation event was made during reproduction of the video, generating the query using the video;
transmitting the query to a server; and
receiving a search result corresponding to the query from the server and displaying the search result on the screen,
wherein the search result is a search result including product information or advertisement information of one or more objects included in the video.
2. The method of claim 1 , wherein the query includes at least one piece of object information extracted from a video frame displayed on a screen, an image in one area included in the video frame, a plurality of video frames which satisfy a preset condition based on the screen, or one frame of the video.
3. The method of claim 2 , wherein the object information includes at least one piece of image feature information extracted from the video or label information learned to correspond to a specific object.
4. The method of claim 1 , wherein the generating of the query comprises determining that a second query generation event is made when a preset time passes or a search event is generated after a pause event is generated during the reproduction of the video.
5. The method of claim 1 , wherein the generating of the query comprises determining that a second query generation event is made when a search event is generated during the reproduction of the video.
6. The method of claim 1 , wherein the generating of the query comprises:
capturing the video when a voice control mode activation command is received during the reproduction of the video; and
generating the query using the captured image when a search event is generated in a voice control mode.
7. The method of claim 1 , wherein the generating of the query comprises:
extracting one or more objects from a video frame displayed on a paused screen; and
generating a query including the one or more objects.
8. The method of claim 7 , wherein the extracting of the objects comprises extracting one area including image feature information learned to correspond to a specific object through a pre-stored learning model as an object to be searched for and attaching a label corresponding to the image feature information to the object to be searched for.
9. The method of claim 7 , wherein the extracting of the objects comprises:
extracting image feature information from the video frame;
partitioning one area within the video frame according to a preset reference using the extracted image feature information; and
configuring the partitioned area as an object to be searched for.
10. The method of claim 1 , wherein the displaying of the search result on the screen comprises preferentially displaying, on the screen, a search result of an object including a label which is equal or similar to that of an object for which a user has searched using a search log of the user.
11. A non-transitory computer-readable medium comprising instructions executable by the processor to:
display a time remaining to generate a query on a screen when a pause event is detected during reproduction of a video;
determine that a query generation event is made when there is no user input before the remaining time reaches 0;
based on a determination that the query generation event was made during reproduction of the video, generate the query using the video;
transmit the query to a server; and
receive a search result corresponding to the query from the server and display the search result on the screen,
wherein the search result is a search result including product information or advertisement information of one or more objects included in the video.