Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
View Patent ↗An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence. Applications of the interface and system include a VCR, medical device, vehicle control system, audio device, environmental control system, securities trading terminal, and smart house. The system optionally includes an actuator for effecting the environment of operation, allowing closed-loop feedback operation and automated learning.
1. A method of providing a device input, comprising:
receiving a user input for selection of media content;
storing information relating to a sequence of a plurality of the received user inputs in a memory;
predicting, with an automated processor, a subsequent user media content selection, based on at least the stored information;
deriving feedback at least implicitly from the user relating to the predicted user media content selection;
modifying, with the automated processor, the predicted user media content selection based on at least the at least implicitly derived feedback; and
employing the modified predicted user media content selection as a device input for controlling the device.
2. The method according to claim 1 , wherein the user input is received from a user interface device which comprises a plurality of manually depressible keys.
3. The method according to claim 1 , wherein the user input and feedback are received through a direct manipulation-type user interface pointing device.
4. The method according to claim 1 , wherein the user input and feedback are received through a plurality of elements having corresponding alphanumeric mapping and a pointing device.
5. The method according to claim 1 , wherein the device comprises a microphone for receiving a voice user input.
6. The method according to claim 1 , wherein the device comprises a microphone and a video input.
7. The method according to claim 1 , wherein the user input comprises voice input.
8. The method according to claim 1 , wherein the memory stores information relating to a timing of a user input, and the predicted user media content selection is generated based on at least the respective timing of each of a plurality of prior received user inputs from which feedback is derived.
9. The method according to claim 1 , wherein said device input controls a telecommunication function of a telephone.
10. The method according to claim 1 , further comprising a flat panel graphic display for presenting the predicted user data input to the user.
11. The method according to claim 1 , further comprising a user touch responsive input device configured to receive the user input.
12. The method according to claim 1 , wherein the predicted user media content selection comprises a plurality of available media content selections concurrently presented to the user hierarchically.
13. The method according to claim 1 , wherein the feedback is derived from at least image analysis.
14. The method according to claim 1 , wherein the device input controls communications through a communications network interface.
15. The method according to claim 1 , wherein the device input controls communications through a telephone communications network interface.
16. The method according to claim 1 , wherein the automated processor predicts a plurality of user content selections concurrently presented to the user, ordered based on at least a probability that the user will agree with the prediction.
17. The method according to claim 1 , further comprising identifying a user, and storing a user identifier in association with the stored information.
18. A non-transitory computer readable storage medium storing instructions for controlling a programmable processor to perform the method of claim 1 .
19. A device having a user interface, comprising:
an input port configured to receive a user input for selection of media content;
a memory configured to store information relating to a sequence of a plurality of the received user inputs;
an automated processor configured to:
predict a subsequent user media content selection based on at least the stored information and a status of the device;
derive feedback at least implicitly from the user relating to the predicted user media content selection;
modify the predicted user media content selection based on at least the implicitly derived feedback; and
an output port, configured to present a signal responsive to the modified predicted user media content selection.
20. The device according to claim 19 , wherein the user input receives signals from at least a plurality of manually depressible keys.
21. The device according to claim 19 , wherein the user input receives signals from at least a direct manipulation-type user interface pointing device.
22. The device according to claim 19 , wherein the user input receives signals from at least a plurality of elements having corresponding alphanumeric mapping and a pointing device.
23. The device according to claim 19 , wherein the device comprises a microphone configured to receive voice as the user input.
24. The device according to claim 19 , wherein the device comprises a microphone and a video input.
25. The device according to claim 19 , wherein the user input comprises voice information.
26. The device according to claim 19 , wherein the memory is configured to store information relating to a timing of a respective user input, and the predicted user media content selection is generated based on at least a stored respective timing of each of a plurality of user inputs from which feedback is derived.
27. The device according to claim 19 , wherein said output port is configured to control a telecommunication function of a telephone.
28. The device according to claim 19 , further comprising a flat panel graphic display configured to present the predicted user content selection to the user.
29. The device according to claim 19 , further comprising a user touch responsive input device configured to receive the user input.
30. The device according to claim 19 , wherein the predicted subsequent user media content selection comprises a plurality of available media content selections which are concurrently presented to the user hierarchically.
31. The device according to claim 19 , wherein the automated processor is configured to derive the feedback from at least image analysis is.
32. The device according to claim 19 , wherein the output port is configured to control communications through a communications network interface.
33. The device according to claim 19 , wherein the output port is configured to control communications through a telephone communications network interface.
34. The device according to claim 19 , wherein the automated processor is configured to predict the user media content selection based on at least a predicted probability that the user will agree with the prediction.
35. The device according to claim 19 , further comprising a memory location for storing a user identifier.
36. A method for receiving a user input, comprising:
receiving usage data representing a plurality of user media content selections over a period of time;
predicting, with an automated processor, a desired user media content selection based on at least a historical time sequence of the plurality of the received usage data and a status of a device;
presenting the predicted desired media content selection to the user;
receiving implicit feedback from the user relating to a correspondence of the predicted desired media content selection with the user's media current content preference, derived from at least a probabilistic analysis of the usage data;
modifying, with the automated processor, the predicted desired media content selection based on at least the received implicit feedback; and
storing the modified predicted desired media content selection in a memory.