Display apparatus with intelligent user interface
A display apparatus includes presence detection circuitry for detecting an individual in proximity to the display apparatus; a display for displaying video content and a user interface; a processor in communication with the user input circuitry, the display, and the search history database; and non-transitory computer readable media in communication with the processor that stores instruction code. The instruction code is executed by the processor and causes the processor to: a) determine, from the presence detection circuitry, a user in proximity of the display apparatus; b) determine one or more program types associated with the user; c) determine available programs that match the predicted one or more programs; and d) update the user interface to depict a listing of one or more of the available programs that match the predicted one or more programs.
1. A display apparatus comprising:
a user input circuitry for receiving user commands;
a display for displaying video content and a user interface;
a communication interface for obtaining the video content from one or more servers via Internet, a cable network or a satellite network;
at least one processor in communication with the user input circuitry, the display and the communication interface;
and a non-transitory computer readable media in communication with the at least one processor that stores instruction codes, which when executed by the at least one processor, cause the at least one processor to:
display a video from the one or more servers on the display;
while displaying the video, receive a first search command by voice from the user input circuitry to search for a particular type of video content;
determine video content of the particular type associated with the first search command;
update the user interface to depict a plurality of controls, each with a unique identifier, corresponding to the video content of the particular type and displaying for selection, wherein the plurality of controls depicted on the user interface at least includes a first control,
the first control corresponds to an image that represents an input source, and the input source includes an HDMI input source, wherein while the video is being displayed:
an HDMI illustration image illustrating the HDMI input source and text of “HDMI” are shown on the user interface over the displaying video, and an image of a first unique identifier is shown on or near the image of the HDMI input source on the user interface;
receive a second search command by voice-specifying a unique identifier for selecting a control from the plurality of controls that are associated with the particular type of the video content;
in response to the voice-specified unique identifier, display information associated with the selected control;
determine information of display apparatus usage, the information of display apparatus usage including:
times of usage of the display apparatus; program types viewed on the display apparatus; lists of specific users of the display apparatus; and specific characteristics of the display apparatus including a volume, a contrast, and a brightness of the display apparatus;
after the information of display apparatus usage is determined, determine a smart appliance state of at least one or more smart appliances, based on a relation between the display apparatus usage and states of the one or more smart appliances that are coupled to the display apparatus via the communication circuitry;
and adjust, via a communication circuitry of the display apparatus, the at least one or more smart appliances according to the determined smart appliance state of the at least one or more smart appliances.
2. The display apparatus according to claim 1 , wherein the at least one processor is further configured to:
determine types of controls, through machine learning, for displaying the plurality of controls on the user interface, based at least in part on a history of search commands and selections specified by the user that are stored in a support database or maintained within a support server.
3. The display apparatus according to claim 1 , wherein, in addition to the first control, the plurality of controls further includes one or more of a second control, a third control, and a fourth control displaying for selection on user interface, wherein:
the second control corresponds to an image that represents an actor associated with the particular type of the video content,
the third control corresponds to an image that represents an instant message associated with the particular type of the video content, and
the fourth control corresponds to an image that represents a scene associated with the particular type of the video content.
4. The display apparatus according to claim 3 , wherein when the first search command searches for a show, the scene provided through the fourth control includes:
a scene from a movie that the user frequently watches, or
a scene from a movie that is associated with types of shows the user watches.
5. The display apparatus according to claim 1 , wherein
the video content of the particular type associated with the first search command is determined by machine learning based on metadata associated with the first search command.
6. The display apparatus according to claim 1 , wherein the at least one processor is further configured to:
after receiving the first search command related to the particular type of video content and before receiving the second search command by voice-specifying the unique identifier for selecting the control:
determine one or more potential search commands to refine the first search command, wherein the one or more potential search commands are determined utilizing metadata through machine learning according to the particular type of the video content.
7. The display apparatus according to claim 6 , wherein the at least one processor is further configured to:
update the user interface to depict the one or more potential search commands in text, and
receive a third search command, that is selected from the one or more potential search commands, for searching a plurality of types of video content within the particular type of video content of the first search command.
8. The display apparatus according to claim 1 , wherein the at least one processor is further configured to:
determine whether a user is in proximity of the display apparatus;
pause the video content, if the user is determined to not be in proximity of the display apparatus and if the video content is not already paused; and
resume the video content, if the user is determined to be in proximity of the display apparatus and if the video content is not already resumed.
9. The display apparatus according to claim 1 , wherein the at least one processor is further configured to:
determine whether a user is in proximity of the display apparatus;
determine one or more program types associated with the user, if a user is determined to be in proximity of the display apparatus;
determine programs that are available for watching at time of user detection or within a predetermined time later; and
update the user interface to present information related to available programs that match the user associated program types.
10. The display apparatus according to claim 1 , wherein:
the information of display apparatus usage further includes at least one of: the display apparatus being set to a movie channel, picture controls of the display apparatus having been set to a cinema mode, and the display apparatus being used in an evening on a Friday night; and
the states of the one or more smart appliances include whether a smart light is on, off, or dimmed to a particular setting; whether smart drapes are partially closed; or whether blinds are closed.
11. The display apparatus according to claim 1 , wherein the display apparatus is a television.
12. An interactive method for a display apparatus comprising:
displaying a video from one or more servers on a display of the display apparatus, wherein the display apparatus is configured to communicate with the one or more servers via Internet, a cable network or a satellite network;
while displaying the video, receiving a first search command by voice from a user input circuitry to search for a particular type of video content;
determining video content of the particular type associated with the first search command;
updating a user interface to depict a plurality of controls, each with a unique identifier, corresponding to the video content of the particular type and displaying for selection,
wherein the plurality of controls depicted on the user interface at least includes a first control,
the first control corresponds to an image that represents an input source, and the input source includes an HDMI input source, wherein
while the video is being displayed: an HDMI illustration image illustrating the HDMI input source and text of “HDMI” are shown on the user interface over the displaying video, and an image of a first unique identifier is shown on or near the image of the HDMI input source on the user interface;
receiving a second search command by voice-specifying a unique identifier for selecting a control from the plurality of controls that are associated with the particular type of the video content;
in response to the voice-specified unique identifier, displaying information associated with the selected control;
determining information of display apparatus usage, the information of display apparatus usage including:
times of usage of the display apparatus; program types viewed on the display apparatus; lists of specific users of the display apparatus; and specific characteristics of the display apparatus including a volume, a contrast, and a brightness of the display apparatus;
after the information of display apparatus usage is determined, determining a smart appliance state of at least one or more smart appliances, based on a relation between the display apparatus usage and states of the one or more smart appliances that are coupled to the display apparatus via the communication circuitry;
and adjusting, via a communication circuitry of the display apparatus, the at least one or more smart appliances according to the determined smart appliance state of the at least one or more smart appliances.
13. The method according to claim 12 , further comprising:
determining types of controls, through machine learning, for displaying the plurality of controls on the user interface, based at least in part on a history of search commands and selections specified by the user that are stored in a support database or maintained within a support server.
14. The method according to claim 12 , wherein, in addition to the first control, the plurality of controls further includes one or more of a second control, a third control, and a fourth control displaying for selection on user interface, wherein:
the second control corresponds to an image that represents an actor associated with the particular type of the video content,
the third control corresponds to an image that represents an instant message associated with the particular type of the video content, and
the fourth control corresponds to an image that represents a scene associated with the particular type of the video content.
15. The method according to claim 14 , wherein when the first search command searches for a show, the scene provided through the fourth control includes:
a scene from a movie that the user frequently watches, or
a scene from a movie that is associated with types of shows the user watches.
16. The method according to claim 12 , wherein
the video content of the particular type associated with the first search command is determined by machine learning based on metadata associated with the first search command.
17. The method according to claim 12 , further comprising:
after receiving the first search command related to the particular type of video content and before receiving the second search command by voice-specifying the unique identifier for selecting the control:
determining one or more potential search commands to refine the first search command, wherein the one or more potential search commands are determined utilizing metadata through machine learning according to the particular type of the video content.
18. The method according to claim 17 , further comprising:
updating the user interface to depict the one or more potential search commands in text, and
receiving a third search command, that is selected from the one or more potential search commands, for searching a plurality of types of video content within the particular type of video content of the first search command.
19. The method according to claim 12 , further comprising:
determining whether a user is in proximity of the display apparatus;
pausing the video content, if the user is determined to not be in proximity of the display apparatus and if the video content is not already paused; and
resuming the video content, if the user is determined to be in proximity of the display apparatus and if the video content is not already resumed.
20. The method according to claim 12 , further comprising:
determining whether a user is in proximity of the display apparatus;
determining one or more program types associated with the user, if a user is determined to be in proximity of the display apparatus;
determining programs that are available for watching at time of user detection or within a predetermined time later; and
updating the user interface to present information related to available programs that match the user associated program types.