System and method for stylus detection
In some examples, an electronic device including a touch screen can sense a stylus proximate to the touch screen. For example, the user can draw or write with the stylus to create a simulated drawing or simulated handwriting displayed on the touch screen. In some examples, the electronic device can sense a series of “points” corresponding to the location of the stylus over time while the drawing/writing input was provided. In some situations, noise in the stylus data can cause the electronic device not to sense one or more noisy points included in the drawing or handwriting input. In some examples, the electronic device can interpolate the noisy points based on sensed points before and/or after the time of the skipped points.
1. A method performed by an electronic device including memory and one or more processors coupled to a touch screen, the method comprising:
sensing stylus data corresponding to movement of a stylus proximate to the touch screen, wherein the stylus data includes a plurality of points and sensing the stylus data includes sensing a first point at a first time and sensing a second point at a second time, wherein the second point was sensed after sensing the first point without sensing points between the first point and the second point;
calculating a difference between the first time and the second time;
determining that the difference between the first time and the second time is less than or equal to a predefined time threshold;
in response to determining that that the difference between the first time and the second time is less than or equal to a predefined time threshold, displaying, using the touch screen, a drawing including a portion corresponding to the first point and the second point;
sensing second stylus data corresponding to movement of the stylus proximate to the touch screen, wherein the second stylus data includes a second plurality of points and sensing the second stylus data includes sensing a third point at a third time and sensing a fourth point at a fourth time, wherein the fourth point was sensed after sensing the third point without sensing points between the third point and the fourth point;
calculating a difference between the third time and the fourth time;
determining that the difference between the third time and the fourth time is greater than the predetermined time threshold; and
in response to determining that the difference between the third time and the fourth time is greater than the predefined time threshold, displaying, using the touch screen, a second drawing including a portion corresponding to the third point, the fourth point, and one or more interpolated points, the one or more interpolated points based at least on the third point.
2. The method of claim 1 , wherein the one or more interpolated points are further based on the fourth point.
3. The method of claim 1 , wherein the one or more interpolated points are further based on one or more points sensed prior to sensing the third point.
4. The method of claim 1 , wherein the one or more interpolated points are not sensed based on points sensed after sensing the fourth point.
5. The method of claim 1 , wherein the one or more interpolated points are not sensed based on one or more points sensed after sensing the third point.
6. The method of claim 1 , further comprising:
in response to determining that the difference between the third time and the fourth time is greater than the predefined time threshold:
determining, based on the difference between the third time and the fourth time, a number of points skipped between the third point and the fourth point, wherein the one or more interpolated points have a same number as the number of points skipped between the third point and the fourth point.
7. An electronic device in communication with a touch screen, the electronic device comprising:
memory; and
one or more processors coupled to the memory and configured to perform a method comprising:
sensing stylus data corresponding to movement of a stylus proximate to the touch screen, wherein the stylus data includes a plurality of points and sensing the stylus data includes sensing a first point at a first time and sensing a second point at a second time, wherein the second point was sensed after sensing the first point without sensing points between the first point and the second point;
calculating a difference between the first time and the second time;
in accordance with a determination that the difference between the first time and the second time is less than or equal to a predefined time threshold, displaying, using the touch screen, a drawing including a portion corresponding to the first point and the second point; and
in accordance with a determination that the difference between the first time and the second time is greater than the predetermined time threshold, displaying, using the touch screen, a drawing including a portion corresponding to the first point, the second point, and one or more interpolated points, the one or more interpolated points based at least on the first point.
8. The electronic device of claim 7 , wherein the one or more interpolated points are further based on the second point.
9. The electronic device of claim 7 , wherein the one or more interpolated points are further based on one or more points sensed prior to sensing the first point.
10. The electronic device of claim 7 , wherein the one or more interpolated points are not sensed based on points sensed after sensing the second point.
11. The electronic device of claim 7 , wherein the one or more interpolated points are not sensed based on one or more points sensed after sensing the first point.
12. The electronic device of claim 7 , wherein the method further comprises:
in accordance with the determination that the difference between the first time and the second time is greater than the predetermined time threshold:
determining, based on the difference between the first time and the second time, a number of points skipped between the first point and the second point, wherein the one or more interpolated points have a same number as the number of points skipped between the first point and the second point.
13. The electronic device of claim 7 , wherein locations of the one or more interpolated points are determined using one or more of polynomial interpolation, Bezier interpolation, a neural network, continuous embedding techniques, and/or an autoregressive recurrent model.
14. A non-transitory computer readable storage medium storing instructions that, when executed by an electronic device including memory and one or more processors, the electronic device in communication with a touch screen, cause the electronic device to perform a method comprising:
sensing stylus data corresponding to movement of a stylus proximate to the touch screen, wherein the stylus data includes a plurality of points and sensing the stylus data includes sensing a first point at a first time and sensing a second point at a second time, wherein the second point was sensed after sensing the first point without sensing points between the first point and the second point;
calculating a difference between the first time and the second time;
in accordance with a determination that the difference between the first time and the second time is less than or equal to a predefined time threshold, displaying, using the touch screen, a drawing including a portion corresponding to the first point and the second point; and
in accordance with a determination that the difference between the first time and the second time is greater than the predetermined time threshold, displaying, using the touch screen, a drawing including a portion corresponding to the first point, the second point, and one or more interpolated points, the one or more interpolated points based at least on the first point.
15. The non-transitory computer readable storage medium of claim 14 , wherein the one or more interpolated points are further based on the second point.
16. The non-transitory computer readable storage medium of claim 14 , wherein the one or more interpolated points are further based on one or more points sensed prior to sensing the first point.
17. The non-transitory computer readable storage medium of claim 14 , wherein the one or more interpolated points are not sensed based on points sensed after sensing the second point.
18. The non-transitory computer readable storage medium of claim 14 , wherein the one or more interpolated points are not sensed based on one or more points sensed after sensing the first point.
19. The non-transitory computer readable storage medium of claim 14 , wherein the method further comprises:
in accordance with the determination that the difference between the first time and the second time is greater than the predetermined time threshold:
determining, based on the difference between the first time and the second time, a number of points skipped between the first point and the second point, wherein the one or more interpolated points have a same number as the number of points skipped between the first point and the second point.
20. The non-transitory computer readable storage medium of claim 14 , wherein locations of the one or more interpolated points are determined using one or more of polynomial interpolation, Bezier interpolation, a neural network, continuous embedding techniques, and/or an autoregressive recurrent model.