Pen input device and method for tracking pen position
View Patent ↗The pen input device has both a movement detection system and a position detection system that collectively track the position of the pen input device during a writing operation on a writing surface. The pen input device has a writing tip capable of performing a writing operation in contact with the writing surface. A controller is operable to activate the movement detection system continuously during the writing operation and to activate the position detection system intermittently during the writing operation. The movement detection system is operable to determine movement data that represent changes between successive positions of the writing tip. The position detection system is operable to determine position data that represents a position of the writing tip on the writing surface.
1. A pen input device, comprising:
a writing tip capable of performing a writing operation in contact with a writing surface;
a movement detection system operable to generate movement data representing changes between successive positions of said writing tip on said writing surface, said movement detection system including a first optical image sensor for capturing successive movement images in response to light returned from said writing surface and for producing movement image data representing said successive movement images and a movement detection engine configured to produce movement data using said movement image data derived from said successive movement images captured using said first optical image sensor;
a position detection system operable to determine a position of said writing tip on said writing surface, said position detection system including a second optical image sensor for capturing a position image in response to light returned from said writing surface and for producing position image data representing said position image and a position detection engine configured to produce position data using said position image data derived from said position image captured using said second optical image sensor, said position detection system being configured to determine said position data representing said position of said writing tip on said writing surface using marks made on said writing surface by at least two writing operations as a positional reference, wherein each of said two writing operations includes said writing tip being in contact with said writing surface followed by said writing tip not being in contact with said writing surface; and
a controller operable to activate said movement detection system continuously during said writing operation and to activate said position detection system intermittently during said writing operation.
2. The pen input device of claim 1 , wherein said movement detection system comprises:
transfer optics for transferring said light returned by said writing surface to said first optical image sensor.
3. The pen input device of claim 2 , wherein said position detection system comprises:
image transfer optics for transferring said light returned from said writing surface to said second optical image sensor.
4. The pen input device of claim 3 , further comprising a processor operable to process said movement image data and said position image data to produce said movement data and position data, respectively, said position data representing said position of said writing tip.
5. The pen input device of claim 4 , wherein said processor comprises a movement detection engine operable to derive said movement data from said movement image data.
6. The pen input device of claim 4 , wherein said processor comprises a position detection engine operable to determine said position data from said position image data.
7. The pen input device of claim 1 , wherein said controller is operable to activate said position detection system at the beginning of said writing operation.
8. The pen input device of claim 7 , wherein said controller is operable to activate said position detection system additionally at the end of said writing operation.
9. The pen input device of claim 8 , further comprising a buffer operable to store said movement data during said at least two writing operations.
10. The pen input device of claim 1 , wherein said controller is operable to activate said position detection system to determine no more than two positions of said writing tip during said writing operation.
11. The pen input device of claim 1 , wherein said controller is operable to activate said position detection system at spatially-separated positions of said writing tip during said writing operation.
12. The pen input device of claim 1 , wherein said controller further provides a link to associate said movement data with said position data obtained during each writing operation performed by said pen input device.
13. The pen input device of claim 12 , additionally comprising memory for storing said movement data, said position data and said link.
14. The pen input device of claim 1 , wherein marks on said surface made by at least two writing operations function as a positional reference with respect to which said position detection system determines said position data.
15. The pen input device of claim 1 , further comprising a proximity sensor operable to provide to said controller a proximity signal indicating a state of contact of said writing tip with said writing surface.
16. A method for capturing the position of the writing tip of a pen input device on a writing surface during a writing operation, the method comprising:
determining movement data while the writing tip contacts the writing surface during the writing operation, said movement data representing changes between successive positions of said writing tip on said writing surface, said determining said movement data comprises acquiring successive movement images using a first optical image sensor, producing movement image data representing said successive movement images, and determining said movement data from said movement image data using a movement detection engine that produces said movement data using said movement image data derived from said successive movement images captured using said first optical image sensor;
determining position data at least once during said writing operation as part of a position detecting operation that is activated intermittently during said writing operation, said position data representing a position of said writing tip on said writing surface, said determining said position data comprises acquiring a position image using a second optical image sensor, producing position image data representing said position image, and determining said position data from said position image data using a position detection engine that produces said position data using said position image data derived from said position image captured using said second optical image sensor, said determining said position data includes using marks made on said writing surface by at least two writing operations as a positional reference, wherein each of said two writing operations includes said writing tip being in contact with said writing surface followed by said writing tip not being in contact with said writing surface; and
linking said position data and said movement data.
17. The method of claim 16 , wherein:
said determining said position data additionally comprises determining said position data after movement data for at least two writing operations has been determined; and
marks made on said writing surface by said at least two writing operations function as a positional reference with respect to which said position data is determined.
18. The method of claim 16 , wherein said determining said position data comprises determining said position data at the beginning of said writing operation.
19. The method of claim 18 , additionally comprising determining additional position data at the end of said writing operation, said additional positional data representing a position of said writing tip at said end of said writing operation.
20. The method of claim 16 , wherein:
the method additionally comprises determining additional position data during said writing operation; and
said positional data and said additional positional data represent respective spatially-separated positions of said writing tip during said writing operation.
21. The method of claim 20 , wherein:
said writing operation writes a stroke on said writing surface; and
said method additionally comprises determining an orientation of said stroke relative to said writing surface using said position data and said additional position data.
22. The method of claim 16 , additionally comprising:
detecting contact of said writing tip with said writing surface; and
performing said determining said movement data and said determining said position data in response to said detecting said contact.
23. The method of claim 16 , additionally comprising:
detecting timing of successive contacts of said writing tip with said writing surface; and
performing character recognition at least in part in response to said timing of said successive contacts.