IP Library Granted Patent US 9,411,433
Granted Patent B2
US 9,411,433 · App. 14/283,884 · Granted Aug 9, 2016

Whiteboard display

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,411,433
App. No.
14/283,884
Granted
Aug 9, 2016
Kind
B2
Abstract

A method includes receiving an image of a display surface from a pointing device having a camera with a field of view wider than a tip of the pointing device, processing the received image to identify an area on the display surface within the field of view of the camera, and identifying a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface.

Claims (53)

1. A method comprising:

receiving an image of a display surface from a pointing device having a camera with a field of view wider than a tip of the pointing device;

processing the received image to identify an area on the display surface within the field of view of the camera; and

identifying a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface, wherein processing the received image to identify an area on the display surface comprises:

detecting markers displayed on the display surface corresponding to unique hashed mapped zones;

transforming pixel information in each mapped zone in the field of view into a hash; and

comparing the hashes to known hashes to identify a mapped zone corresponding to the position of the tip of the pointing device.

2. The method of claim 1 wherein the image is received via processing circuitry that processes the image, identifies the position of the tip of the pointing device, and drives the display.

3. The method of claim 1 wherein pixel information transformed into the hash comprises pixel brightness and color depth.

4. The method of claim 1 wherein the markers comprise a marker pixel in each zone.

5. The method of claim 4 wherein marker pixel is less discernible to a human user.

6. The method of claim 1 wherein a pixel pattern is added to each zone having a non-unique hash until the hash for each zone is unique.

7. The method of claim 6 wherein each zone on the display has a hash stored in a memory device as the known hashes.

8. The method of claim 1 and further comprising:

receiving tilt information from the pointing device; and

using the tilt information in combination with the unique hashed mapped zones within the field of view of the camera to determine a position of the tip of the pointing device in such zones.

9. The method of claim 1 and further comprising dynamically adjusting a size of the zone to optimize accuracy of pen tip position, and to accommodate different resolutions of displays.

10. A non-transitory machine readable storage device having instructions for execution by a processor of the machine to perform:

receiving an image of a display surface from a pointing device having a camera with a field of view wider than a tip of the pointing device;

processing the received image to identify an area on the display surface within the field of view of the camera; and

identifying a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface, wherein processing the received image to identify an area on the display surface comprises:

detecting markers displayed on the display surface corresponding to unique hashed mapped zones;

transforming pixel information in each mapped zone in the field of view into a hash: and

comparing the hashes to known hashes to identify a mapped zone corresponding to the position of the tip of the pointing device.

11. The non-transitory machine readable storage device of claim 10 wherein pixel information transformed into the hash comprises pixel brightness and color depth and wherein the markers comprise a marker pixel in each zone.

12. The non-transitory machine readable storage device of claim 10 wherein each zone on the display has a hash stored in a memory device as the known hashes.

13. The non-transitory machine readable storage device of claim 10 wherein the machine readable storage device comprises instructions for execution by a processor of the machine to further perform:

receiving tilt information from the pointing device; and

using the tilt information in combination with the unique hashed mapped zones within the field of view of the camera to determine a position of the tip of the pointing device in such zones.

14. A device comprising:

a processor; and

a memory device having a program stored thereon for execution by the processor to:

receive an image of a display surface from a pointing device having a camera with a field of view wider than a tip of the pointing device;

process the received image to identify an area on the display surface within the field of view of the camera; and

identify a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface, wherein processing the received image to identify an area on the display surface comprises:

detecting markers displayed on the display surface corresponding to unique hashed mapped zones;

transforming pixel information in each mapped zone in the field of view into a hash; and

comparing the hashes to known hashes to identify a mapped zone and look up zone coordinates associated with the zone, wherein the position of the tip of the pen is calculated from the zone coordinates.

15. The device of claim 14 wherein pixel information transformed into the hash comprises pixel brightness and color depth and wherein the markers comprise a marker pixel in each zone.

16. The device of claim 14 wherein each zone on the display has a hash stored in a memory device as the known hashes and its zone coordinate.

17. The device of claim 14 wherein the memory device program causes the processor to further:

receive tilt information from the pointing device; and

use the tilt information in combination with the unique hashed mapped zones within the field of view of the camera to determine a position of the tip of the pointing device in such zones.

18. A device comprising:

a display;

a processor operatively coupled to the display; and

a memory device having a program stored thereon for execution by the processor to:

receive an image of a display surface from a camera of a pointing device, the image having a field of view wider than a tip of the pointing device;

process the received image to identify an area on the display surface within the field of view of the camera; and

identify a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface, wherein processing the received image to identify an area on the display surface comprises:

detecting markers displayed on the display surface corresponding to unique hashed mapped zones;

transforming pixel information in each mapped zone in the field of view into a hash: and

comparing the hashes to known hashes to identify a mapped zone and look up zone coordinates associated with the zone, wherein the position of the tip of the pen is calculated from the zone coordinates.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2019
From: LENOVO (SINGAPORE) PTE. LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 049689/0419 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2014
From: LI, SCOTT WENTAO; BAI, ZHENGLONG; VANBLON, RUSSELL SPEIGHT; FLORES, AXEL RAMIREZ; NOVAK, JOSHUA NEIL
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 033087/0984 →