System for software interaction using printed forms and sensing device
A system for enabling user interaction with computer software which includes a printer and sensing device. The printer receives print data and prints a form by printing information related to at least one text field coincident with coded data indicative of the text field, receiving indicating data from the sensing device and transferring the indicating data to a computer system to allow the interaction to be interpreted. The sensing device has an image sensor for capturing images of the coded data when moved relative to the text field, and a processor which identifies the coded data from the captured images, determines an orientation and position, within the captured images, of the coded data, decodes the coded data, and generates the indicating data using the decoded coded data and the determined orientation and position.
1. A system for enabling user interaction with computer software, the system including a printer for:
receiving print data;
printing a form, using the print data, by printing:
information related to at least one text field; and,
coded data at least partially indicative of the at least one text field, the coded data being coincident with the information;
receiving indicating data from a sensing device, the sensing device, when moved in an operative position relative to the at least one text field, sensing the coincident coded data and generating the indicating data using the sensed coded data, the indicating data being at least partially indicative of movement of the sensing device relative to the at least one text field; and
transferring the indicating data to a computer system to allow the interaction to be interpreted,
wherein the system includes the sensing device, the sensing device comprising:
(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the interface surface; and
(b) a processor adapted to:
(i) identify at least some of the coded data from at least one of the captured images;
(ii) determine an orientation and position, within at least one of the captured images, of at least some of the coded data;
(iii) decode at least some of the coded data; and
(iv) generate the indicating data using at least some of the decoded coded data and the determined orientation and position.
2. The system of claim 1 , wherein the movement is indicative of a hand-written text input, and wherein the computer system is for performing text recognition on the handwritten user input, thereby to generate computer text.
3. The system of claim 1 , wherein the sensing device includes a data store for storing a sensing device identifier, and wherein the sensing device generates the indicating data using the identifier.
4. The system of claim 1 , wherein the computer system is for:
generating the identity;
recording an association between the generated identity and the layout; and,
causing generation the coded data using the generated identity.
5. The system of claim 1 , wherein the computer system is for:
determining the information;
determining an identity, the identity being at least partially indicative of the at least one text field;
determining a layout defining an arrangement for at least one of:
coded data at least partially indicative of the identity; and,
the information; and,
generating the print data, the print data being at least partially indicative of:
the identity;
the layout; and
the information.
6. The system of claim 5 , wherein the layout includes at least one of:
a page description indicative of an arrangement of the information; and,
a map indicative of an arrangement of the coded data.