IP Library Granted Patent US 8,884,930
Granted Patent B2
US 8,884,930 · App. 13/486,330 · Granted Nov 11, 2014

Graphical display with optical pen input

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,884,930
App. No.
13/486,330
Granted
Nov 11, 2014
Kind
B2
Abstract

Methods and apparatuses of obtaining user input. A display of an optical tracking grid is initiated on an electronic graphical display. Changes are determined among images of at least a portion of the optical tracking grid that are captured by a tracking pen device. Based on the determined changes in the images, a movement of a portion of the tracking pen device is determined. A data set characterizing movement is produced in response to determining the movement.

Claims (89)

1. A method of obtaining user input, the method comprising:

initiating a display of an optical tracking grid on an electronic graphical display, wherein the electronic graphical display comprises a touch sensitive screen input;

detecting the optical tracking grid within a plurality of images of at least a portion of the optical tracking grid that are captured by a tracking pen device;

disabling, based on the detecting the optical tracking grid, the touch sensitive screen input;

determine changes among the plurality of images;

determining, based on the changes, a movement of a portion of the tracking pen device; and

producing, in response to determining the movement, a data set characterizing movement.

2. The method of claim 1 , the method further comprising:

displaying on the electronic graphical display, in response to producing the data set, a representation of the movement.

3. The method of claim 1 , further comprising communicating, in response to producing the data set, the data set from the tracking pen device to a controller of the electronic graphical display.

4. The method of claim 1 , wherein the optical tracking grid comprises a plurality of encoded dot fields, each respective encoded dot field in the plurality of encoded dot fields having a particular configuration that is associated with a location of the respective encoded dot field on the optical tracking grid.

5. The method of claim 1 , further comprising:

detecting pressure being applied to a tip of the tracking pen device, and

wherein at least one of the determining changes among images, determining a movement, and the producing the data set is performed in further response to the detecting pressure being applied.

6. The method of claim 1 , further comprising:

detecting pressure being applied to a tip of the tracking pen device, and

wherein the initiating the display of the optical tracking grid is in response to the detecting pressure being applied.

7. The method of claim 6 , the method further comprising:

disabling, in response to the detecting pressure being applied, the touch sensitive screen input.

8. The method of claim 1 ,

wherein the optical tracking grid comprises a plurality of geometric shapes, the plurality of geometric shapes having an arrangement relative to one another in the optical tracking grid, each geometric shape in the plurality of geometric shapes having a respective size,

wherein the images of at least a portion of the optical tracking grid comprise a plurality of captured images, each respective captured image capturing a respective portion of the optical tracking grid that is smaller than a respective size of at least one of the plurality of geometric shapes, and

wherein determining the movement further comprises determining, based upon the arrangement of the plurality of the geometric shapes within the optical tracking grid, a respective location of each respective portion of the optical tracking grid captured by each respective captured image.

9. The method of claim 8 , wherein the display further presents an indication of prior locations on the display of the portion of the optical tracking pen,

wherein at least a subset of the captured images further capture the indication of prior locations,

wherein the determining the movement is further based upon the indication of prior locations captured within the at least the subset of the captured images.

10. The method of claim 8 , wherein determining the location of the respective portion of the optical tracking grid captured in each respective captured image is based upon characteristics of portions of the geometric shapes captured within the respective portion.

11. A tracking pen device, comprising:

a tracking pen body;

a data transmitter configured to:

send a grid enable signal to an electronic graphical display to initiate a display of an optical tracking grid thereon, wherein the electronic graphical display comprises a touch sensitive screen input; and

send a touch sensitive screen input disable signal to the electronic graphical display to disable the touch sensitive screen input;

an image capturing device, fixedly mounted to the tracking pen body, the image capturing device configured to capture a sequence of images of at least a portion of the optical tracking grid relative to the tracking pen body;

an optical processor configured to:

detect, within the images, the optical tracking grid;

determine changes among the sequence of images;

determine, based on the changes, a movement of the tracking pen body; and

determine, in response to determining the movement, a data set characterizing movement, and

wherein the data transmitter is further configured to send the touch sensitive screen input disable signal in response to a detection of the optical tracking grid within the images.

12. The tracking pen device of claim 11 , the data transmitter further configured to communicate, in response to a determination of the data set, the data set to a controller of the electronic graphical display.

13. The tracking pen device of claim 11 , wherein the optical tracking grid comprises a plurality of encoded dot fields, each respective encoded dot field in the plurality of encoded dot fields having a particular configuration that is associated with a location of the respective encoded dot field on the optical tracking grid,

wherein the optical processor is further configured to determine a location of the tracking pen body relative to the optical tracking grid by identifying at least one encoded dot field, and

wherein the optical processor is configured to determine the movement based at least in part on the location.

14. The tracking pen device of claim 11 , further comprising:

a tip pressure sensor configured to detect pressure being applied to a tip of the tracking pen device, and

wherein the optical processor is configured to determine at least one of changes among the images, the movement, and the data set, in response to a detection of the pressure being applied by the tip pressure sensor.

15. The tracking pen device of claim 11 , further comprising:

a tip pressure sensor configured to detect pressure being applied to a tip of the tracking pen device, and

wherein the data transmitter is configured to send the grid enable signal in response to a detection of the pressure being applied by the tip pressure sensor.

16. The tracking pen device of claim 15 ,

wherein the data transmitter is further configured to send, in response to a detection of the pressure being applied by the tip pressure sensor, a touch sensitive screen input disable signal to the electronic graphics display to disable the touch sensitive screen input.

17. The tracking pen device of claim 11 ,

wherein the optical tracking grid comprises an arrangement of a plurality of geometric shapes, each geometric shape within the arrangement of the plurality of geometric shapes being displayed at a respective particular location on the electronic graphical display, each geometric shape in the plurality of geometric shapes having a respective size,

wherein the sequence of images comprises a plurality of captured images, each captured image capturing a respective portion of the optical tracking grid that is smaller than a respective size of at least one of the plurality of geometric shapes, and

wherein determining the movement further comprises determining, based upon the arrangement of the plurality of the geometric shapes within the optical tracking grid, a respective portion of the optical tracking grid captured by each captured image, the respective portion.

18. A touch sensitive electronic graphical display, comprising:

a display body;

an electronic graphical display physically coupled to the display body the electronic graphical display further comprising a touch sensitive screen input;

a graphical display controller configured to control operation of the electronic graphical display;

a tracking pen body movable relative to the display body;

a data transmitter physically coupled to the tracking pen body, the data transmitter configured to:

send a grid enable signal to the graphical display controller to initiate a display of an optical tracking grid on the electronic graphical display;

an image capturing device, fixedly mounted to the tracking pen body, the image capturing device configured to capture a sequence of images of at least a portion of the optical tracking grid relative to the tracking pen body;

an optical processor, communicatively coupled to the graphical display controller, the optical processor configured to:

detect, within the images, the optical tracking grid;

determine changes among the sequence of images;

determine, based on the changes, a movement of the tracking pen body;

determine, in response to determining the movement, a data set characterizing movement; and

send the data set to the graphical display controller, and

wherein the data transmitter is further configured to send, in response to a detection of the optical tracking grid, the touch sensitive screen input disable signal.

19. The touch sensitive electronic graphical display of claim 18 , wherein the optical tracking grid comprises a plurality of encoded dot fields, each respective encoded dot field in the plurality of encoded dot fields having a particular configuration that is associated with a location of the respective encoded dot field on the optical tracking grid,

wherein the optical processor is further configured to determine a location of the tracking pen body relative to the optical tracking grid by identifying at least one encoded dot field, and

wherein the optical processor is configured to determine the movement based at least in part on the location.

20. The touch sensitive electronic graphical display of claim 18 , further comprising:

a tip pressure sensor, coupled to the tracking pen body, the tip pressure sensor configured to detect pressure being applied to a tip of the tracking pen body, and

wherein the optical processor is configured to determine at least one of changes among the images, the movement, and the data set, in response to a detection of the pressure being applied by the tip pressure sensor.

21. The touch sensitive electronic graphical display of claim 18 , further comprising:

a tip pressure sensor, coupled to the tracking pen body, the tip pressure sensor configured to detect pressure being applied to a tip of the tracking pen body, and

wherein the data transmitter is configured to send the grid enable signal in response to a detection of the pressure being applied by the tip pressure sensor.

22. The touch sensitive electronic graphical display of claim 21 ,

wherein the data transmitter is further configured to send, in response to a detection of the pressure being applied by the tip pressure sensor, a touch sensitive screen input disable signal to the graphical display controller to disable the touch sensitive screen input.

23. A computer readable non-transitory storage medium having computer readable program code embodied therewith, the computer readable program code comprising instructions for:

initiating a display of an optical tracking grid on an electronic graphical display, wherein the electronic graphical display comprises a touch sensitive screen input;

detecting the optical tracking grid within a plurality of images of at least a portion of the optical tracking grid that are captured by a tracking pen device;

disabling, based on the detecting the optical tracking grid, the touch sensitive screen input;

determining changes among the plurality of images;

determining, based on the changes, a movement of a portion of the tracking pen device; and

producing, in response to determining the movement, a data set characterizing movement.

24. The computer readable non-transitory storage medium of claim 23 , wherein the optical tracking grid comprises a plurality of encoded dot fields, each respective encoded dot field in the plurality of encoded dot fields having a particular configuration that is associated with a location of the respective encoded dot field on the optical tracking grid.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064271/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
CHANGE OF NAME Recorded Aug 13, 2014
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 033541/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2012
From: PAUL, BINUSH KUMAR; KEIP, PAUL ROBIN
To: RESEARCH IN MOTION LIMITED
Reel/Frame 028782/0430 →