Heterogeneous tactile sensing via multiple sensor types using spatial information processing acting on initial image processed data from each sensor
View Patent ↗Sensor arrangements and signal processing for touch-based user interfaces comprising multiple sensor types and other arrangements so as to create user interface output signals responsive to touch. Various types of sensors and other measurement arrangements can include capacitive tactile sensor arrays, optical tactile sensor arrays, proximity sensor arrays, pressure sensor arrays, and video cameras. In one approach, spatial information processing acts on initial image processing data acting separately on the data or measurements provided by each sensor. At least one software algorithm comprises at least one of a functional partition (wherein some user interface output signals are derived only from a pre-specified sensor), decision-based selection (wherein some user interface output signals are selectively derived from a selected sensor), or spatial information processing (wherein user interface output signals are obtained from threshold testing, conditional testing, vector quantization, algorithms employing parameterized calculations, algorithms employing compensation calculations and operations, artificial neural networks, etc.).
1. A system for implementing a user interface, the system comprising:
a processor for executing instructions;
a first tactile sensing arrangement for providing a plurality of tactile sensing measurements to the processor, wherein a first tactile sensing measurements is in response to receiving tactile input provided by an object; and
a secondary information sensing arrangement for providing secondary information to the processor, wherein the secondary information is in response: a second tactile sensing arrangement providing another tactile sensing measurement,
wherein the second tactile sensing arrangement is separate from the first tactile sensing arrangement;
wherein the processor is configured to execute instructions to:
in response to a combination of the first tactile sensing measurements when the object is in physical contact with the first tactile sensing arrangement and the secondary information from the second tactile sensing arrangement when the object is to be measured by the secondary information sensing arrangement,
generate user interface output signals, wherein the user interface output signals are produced from spatial information processing acting on one or more values arranged to be provided by first initial image processing of the first tactile sensing measurements and second initial image processing of the secondary information when the object is in physical contact with the first tactile sensing arrangement.
2. The system of claim 1 , wherein the first tactile sensing arrangement is a capacitive tactile sensor and the secondary information sensing arrangement comprises second tactile input provided from an optical tactile sensor.
3. The system of claim 1 , wherein the first tactile sensing arrangement is an optical tactile sensor and the secondary information sensing arrangement comprises second tactile input provided from a capacitive tactile sensor.
4. The system of claim 1 , wherein the first tactile sensing arrangement is a proximity sensor.
5. The system of claim 1 , wherein the first tactile sensing arrangement is a pressure sensor.
6. The system of claim 1 , wherein the first tactile sensing arrangement is a video camera.
7. The system of claim 1 wherein the secondary information sensing arrangement comprises at least one video camera.
8. The system of claim 2 wherein the secondary information sensing arrangement further comprises at least one video camera.
9. The system of claim 3 wherein the secondary information sensing arrangement further comprises at least one video camera.
10. The system of claim 1 wherein the secondary information sensing arrangement comprises at least two video cameras.
11. The system of claim 1 further comprising a functional partition to generate first user interface output signals based on a combination of tactile sensing measurements and secondary information from a first set of tactile sensing arrangements and secondary information sensing arrangements, and to generate second user interface output signals based on a combination of tactile sensing measurements and secondary information from a second set of tactile sensing arrangements and secondary information sensing arrangements.
12. The system of claim 10 further comprising an internal decision arrangement to select one set from the first and second sets of tactile sensing arrangements and secondary information sensing arrangements, the selection made responsive to corresponding measurements by at least a subset of the first and second sets of tactile sensing arrangements.
13. The system of claim 10 further comprising an external decision arrangement to select one set from the first and second sets of tactile sensing arrangements and secondary information sensing arrangements, the selection made responsive to measurements by a third set of tactile sensing arrangements and secondary information sensing arrangements.
14. The system of claim 1 wherein the instructions comprise threshold testing.
15. The system of claim 1 wherein the instructions comprise conditional testing.
16. The system of claim 1 wherein the instructions comprise vector quantization.
17. The system of claim 1 wherein the instructions comprise parameterized calculations.
18. The system of claim 1 wherein the instructions comprise compensation calculations.
19. The system of claim 1 wherein the instructions comprise compensation operations.
20. The system of claim 1 wherein the instructions comprise processing related to an artificial neural network.