Cascaded touch to wake for split architecture
Aspects of the disclosure are related to a touch controller for use in a device having a processor and a touch sensor panel, the touch controller being coupled to the processor and the touch sensor panel, and further comprising: an analog front-end (AFE), wherein the AFE is configured to generate raw touch image data based on electrical signals generated by the touch sensor panel in response to one or more detected touches thereto; a coarse processing element configured to, in response to the processor being set to a sleep mode, coarsely process the raw touch image data to generate sparse data; and an embedded memory configured to store at least the sparse data, wherein the touch controller is configured to transmit a signal to the processor to wake the processor up and transmit the stored sparse data and new touch image data to the processor, wherein the processor performs gesture recognition based on the sparse data and the new touch image data.
1. A touch controller for use in a device having a processor and a touch sensor panel, the touch controller being coupled to the processor and the touch sensor panel, and further comprising:
an analog front-end (AFE), wherein the AFE is configured to generate raw touch image data based on electrical signals generated by the touch sensor panel in response to one or more detected touches thereto;
a coarse processing element configured to, in response to the processor being set to a sleep mode, coarsely process the raw touch image data to generate sparse data and configured to estimate a probability that the raw touch image data is representative of a gesture drawn by a user; and
an embedded memory configured to store at least the sparse data,
wherein the touch controller is configured to transmit a signal to the processor to wake the processor up and transmit the stored sparse data and new touch image data to the processor,
wherein the processor performs gesture recognition based on the sparse data and the new touch image data.
2. The touch controller of claim 1 , wherein the new touch image data is new raw touch image data.
3. The touch controller of claim 1 , wherein the sparse data comprises at least two-dimensional coordinates with associated identifiers.
4. The touch controller of claim 1 , wherein the sparse data comprises locations of touch blobs.
5. The touch controller of claim 1 , wherein the coarse processing element estimates the probability that the raw touch image data is representative of a gesture drawn by a user based on one or more of: a curvature of a touch segment, a length of a touch segment, a location of a touch, a duration of a touch, a fractal dimension of captured signals, or any combination thereof.
6. The touch controller of claim 1 , wherein the transmitting of the signal to the processor to wake the processor up is in response to an estimated probability that the raw touch image data is representative of a gesture drawn by a user being above a predetermined threshold.
7. The touch controller of claim 1 , wherein the coarse processing element is further to determine one of a stroke length, a curve, a finger presence, or a finger size.
8. The touch controller of claim 1 , wherein the stored sparse data indicates at least (A) a plurality of locations from the raw touch image data or (B) a relation among a plurality of locations from the raw touch image data.
9. A method for coarsely processing raw touch image data, comprising:
generating at an analog front-end (AFE) of a touch controller raw touch image data based on electrical signals generated by a touch sensor panel in response to one or more detected touches thereto;
in response to a processor being set to a sleep mode, coarsely processing the raw touch image data at a coarse processing element of the touch controller to generate sparse data;
at the coarse processing element of the touch controller, estimating a probability that the raw touch image data is representative of a gesture drawn by a user;
storing the sparse data in an embedded memory of the touch controller;
transmitting a signal to the processor to wake the processor up; and
transmitting the stored sparse data and new touch image data to the processor,
wherein the processor performs gesture recognition based on the sparse data and the new touch image data.
10. The method of claim 9 , wherein the new touch image data is new raw touch image data.
11. The method of claim 9 , wherein the sparse data comprises at least two-dimensional coordinates with associated identifiers.
12. The method of claim 9 , wherein the sparse data comprises locations of touch blobs.
13. The method of claim 9 , wherein the estimating of the probability that the raw touch image data is representative of a gesture drawn by a user is based on one or more of: a curvature of a touch segment, a length of a touch segment, a location of a touch, a duration of a touch, a fractal dimension of captured signals, or any combination thereof.
14. The method of claim 9 , wherein the transmitting of the signal to the processor to wake the processor up is in response to an estimated probability that the raw touch image data is representative of a gesture drawn by a user being above a predetermined threshold.
15. The method of claim 9 , further comprising determining one of a stroke length, a curve, a finger presence, or a finger size.
16. The method of claim 9 , wherein the stored sparse data indicates at least (A) a plurality of locations from the raw touch image data or (B) a relation among a plurality of locations from the raw touch image data.
17. An apparatus for coarsely processing raw touch image data, comprising:
means for generating raw touch image data based on electrical signals generated by a touch sensor panel in response to one or more detected touches thereto;
means for, in response to a processor being set to a sleep mode, coarsely processing the raw touch image data to generate sparse data and for estimating a probability that the raw touch image data is representative of a gesture drawn by a user;
means for storing the sparse data in an embedded memory of the touch controller;
means for transmitting a signal to the processor to wake the processor up; and
means for transmitting the stored sparse data and new touch image data to the processor, wherein the processor performs gesture recognition based on the sparse data and the new touch image data.
18. The apparatus of claim 17 , wherein the new touch image data is new raw touch image data.
19. The apparatus of claim 17 , wherein the sparse data comprises at least two-dimensional coordinates with associated identifiers.
20. The apparatus of claim 17 , wherein the sparse data comprises locations of touch blobs.
21. The apparatus of claim 17 , wherein the estimating of the probability that the raw touch image data is representative of a gesture drawn by a user is based on one or more of: a curvature of a touch segment, a length of a touch segment, a location of a touch, a duration of a touch, a fractal dimension of captured signals, or any combination thereof.
22. The apparatus of claim 17 , wherein the transmitting of the signal to the processor to wake the processor up is in response to an estimated probability that the raw touch image data is representative of a gesture drawn by a user being above a predetermined threshold.
23. The apparatus of claim 17 , wherein the stored sparse data indicates at least (A) a plurality of locations from the raw touch image data or (B) a relation among a plurality of locations from the raw touch image data.
24. A non-transitory computer-readable medium comprising code which, when executed by a processor, causes the processor to perform a method comprising:
generating at an analog front-end (AFE) of a touch controller raw touch image data based on electrical signals generated by a touch sensor panel in response to one or more detected touches thereto;
in response to a processor being set to a sleep mode, coarsely processing the raw touch image data at a coarse processing element of the touch controller to generate sparse data;
at the coarse processing element of the touch controller, estimating a probability that the raw touch image data is representative of a gesture drawn by a user;
storing the sparse data in an embedded memory of the touch controller;
transmitting a signal to the processor to wake the processor up; and
transmitting the stored sparse data and new touch image data to the processor,
wherein the processor performs gesture recognition based on the sparse data and the new touch image data.
25. The non-transitory computer-readable medium of claim 24 , wherein the new touch image data is new raw touch image data.
26. The non-transitory computer-readable medium of claim 24 , wherein the sparse data comprises at least two-dimensional coordinates with associated identifiers.
27. The non-transitory computer-readable medium of claim 24 , wherein the sparse data comprises locations of touch blobs.
28. The non-transitory computer-readable medium of claim 24 , wherein the estimating of the probability that the raw touch image data is representative of a gesture drawn by a user is based on one or more of: a curvature of a touch segment, a length of a touch segment, a location of a touch, a duration of a touch, a fractal dimension of captured signals, or any combination thereof.
29. The non-transitory computer-readable medium of claim 24 , wherein the transmitting of the signal to the processor to wake the processor up is in response to an estimated probability that the raw touch image data is representative of a gesture drawn by a user being above a predetermined threshold.
30. The non-transitory computer-readable medium of claim 24 , wherein the stored sparse data indicates at least (A) a plurality of locations from the raw touch image data or (B) a relation among a plurality of locations from the raw touch image data.