Display apparatus, content recognizing method thereof, and non-transitory computer readable recording medium

1. A display apparatus comprising:

a display;

a memory storing a fingerprint which is obtained based on a characteristic of a content, and information regarding the content corresponding to the fingerprint;

a transceiver; and

at least one processor configured to:

identify a characteristic of a screen of a currently reproduced content on the display and obtain a fingerprint,

search presence/absence of a stored fingerprint matching the obtained fingerprint in the memory,

identify, based on a result of the searching, whether to transmit a query comprising the obtained fingerprint to a server through the transceiver to request information on the currently reproduced content,

estimate a probability that a type of the currently reproduced content has been changed using a data recognition model that uses the information on the currently reproduced content,

change a content recognition period based on the estimated probability that the type of the currently reproduced content has changed,

determine a time to transmit the query to the server through the transceiver based on the changed content recognition period, and

control the transceiver to transmit the query based on the determined time,

wherein the content recognition period is a time period between transmissions to the server.

2. The display apparatus of claim 1 , wherein the at least one processor is further configured to:

recognize, based on the stored fingerprint matching the obtained fingerprint being found in the memory, the currently reproduced content based on information on a content corresponding to the stored fingerprint, and

control, based on the stored fingerprint matching the obtained fingerprint not being found in the memory, the transceiver to transmit the query comprising the fingerprint to the server to request the information on the currently reproduced content.

3. The display apparatus of claim 2 , wherein the at least one processor is further configured to control, based on the stored fingerprint matching the obtained fingerprint not being found in the memory, the transceiver to receive the information on the currently reproduced content and one or more additional fingerprints of the currently reproduced content from the server.

4. The display apparatus of claim 1 , wherein the at least one processor is further configured to:

recognize a content in every first period based on the currently reproduced content being an advertisement content, and

recognize a content in every second period which is longer than the first period based on the currently reproduced content being a broadcast program content.

5. The display apparatus of claim 3 , wherein the at least one processor is further configured to: change a quantity of fingerprints of the currently reproduced content to be received according to the estimated probability that the type of the currently reproduced content has been changed.

6. The display apparatus of claim 2 , wherein the at least one processor is further configured to:

predict a content to be reproduced next based on a viewing history, and

request information on the predicted content from the server.

7. The display apparatus of claim 3 , wherein the at least one processor is further configured to:

receive additional information related to the currently reproduced content from the server, and

control the display to display the received additional information with the currently reproduced content.

8. A method for recognizing a content of a display apparatus, the method comprising:

identifying a characteristic of a screen of a currently reproduced content and obtaining a fingerprint;

searching whether a stored fingerprint matching the obtained fingerprint is stored in the display apparatus;

identifying, based on a result of the searching, whether to transmit a query comprising the obtained fingerprint to a server to request information on the currently reproduced content;

estimating a probability that a type of the currently reproduced content has changed using a data recognition model that uses the information on the currently reproduced content;

changing a content recognition period based on the estimated probability that the type of the currently reproduced content has changed;

determining a time to transmit the query to the server through a transceiver based on the changed content recognition period; and

transmitting the query based on the determined time,

wherein the content recognition period is a time period between transmissions to the server.

9. The method of claim 8 , wherein the identifying of whether to transmit the query to the server comprises:

recognizing, based on the stored fingerprint matching the obtained fingerprint being found in the display apparatus, the currently reproduced content based on information on a content corresponding to the stored fingerprint, and

transmitting, based on the stored fingerprint matching the obtained fingerprint not being found in the display apparatus, the query comprising the fingerprint to the server for requesting the information on the currently reproduced content.

10. The method of claim 9 , further comprising receiving, based on the stored fingerprint matching the obtained fingerprint not being found in the display apparatus, the information on the currently reproduced content and fingerprints of the currently reproduced content from the server.

11. The method of claim 8 , wherein the changing of the content recognition period comprises:

recognizing a content in every first period based on the currently reproduced content being an advertisement content, and

recognizing a content in every second period which is longer than the first period based on the currently reproduced content being a broadcast program content.

12. The method of claim 10 , further comprising: changing a quantity of fingerprints of the currently reproduced content to be received according to the estimated probability that the type of the currently reproduced content has been changed.

13. The method of claim 9 , further comprising:

predicting a content to be reproduced next based on a viewing history; and

requesting information on the predicted content from the server.

14. The method of claim 10 , further comprising:

receiving additional information related to the currently reproduced content from the server; and

displaying the received additional information with the currently reproduced content.

15. A display apparatus comprising:

a display configured to reproduce a content;

a memory; and

at least one processor configured to control the display and the memory,

wherein the at least one processor, when the display apparatus is executed, is configured to:

estimate a type of a currently reproduced content by applying a content recognition result derived by the at least one processor based on a characteristic of a screen of the currently reproduced content applied to a data recognition model, and

extract at least one of a content recognition period or a quantity of fingerprints requested from an external server, and

wherein the data recognition model is learned using content information and a content type.

16. The display apparatus of claim 15 ,

wherein the data recognition model comprises a set of algorithms for estimating a probability that the currently reproduced content is changed using the content information of the content, and

wherein the content information includes at least one of a content reproducing time, a content reproducing channel, or the type of the currently reproduced content.

17. The display apparatus of claim 1 , wherein the currently reproduced content is at least one of video information or audio information.