IP Library Granted Patent US 9,058,067
Granted Patent B2
US 9,058,067 · App. 12/415,306 · Granted Jun 16, 2015

Digital bookclip

Inventors: Andy Van Schaack (Nashville, TN); Jim Marggraff (Lafayette, CA)
Assignee: Livescribe
G06F3/03545G06F3/0317G06F3/04883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,058,067
App. No.
12/415,306
Granted
Jun 16, 2015
Kind
B2
Abstract

The described embodiments present a system and method for obtaining a portion of a digital document from a printed version of the document. Locations where a smart pen device interacts with a digital bookclip aligned relative the printed document are identified via coordinate sets. A digital document associated with the printed document and the coordinate sets from the smart pen device and digital bookclip are used to identify locations in the digital documents corresponding to locations in the printed document. Data from the identified locations in the digital documents is retrieved and presented to a user and can then be copied, saved, mailed electronically, and/or printed to a new paper document.

Claims (67)

1. A pen-based computing system for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, the system comprising:

a digital bookclip comprising a physical material encoded with a pattern, the physical material distinct from the printed document;

a smart pen device comprising:

an imaging system configured to capture an interaction of the smart pen device with the digital bookclip by reading the encoded pattern of the digital bookclip, the smart pen device capturing a beginning location on the digital bookclip corresponding to a beginning of the interaction and an end location on the digital bookclip corresponding to an end of the interaction;

a database storing a digital representation of the printed document; and

a memory storing computer program code configured to be executed by a processor coupled to the smart pen device, the computer program code including instructions for:

accessing the digital representation of the printed document from the database using the document identifier,

determining a vertical or horizontal orientation of the digital bookclip with respect to the printed document;

receiving the captured beginning and end locations corresponding to the interaction of the smart pen with the digital bookclip;

identifying a selected first portion of the digital representation of the printed document based on the determined orientation of the digital bookclip with respect to the printed document and the beginning location and the end location of the digital bookclip captured when the digital bookclip is aligned with the printed document; and

retrieving the portion of the digital representation of the printed document.

2. The pen-based computing system of claim 1 , wherein retrieving the portion of the digital representation of the printed document corresponding to the selection by the smart pen device comprises: transmitting the portion of the digital representation to a device, printing the portion of the digital representation, or emailing the portion of the digital representation to an email address.

3. The pen-based computing system of claim 1 , wherein the digital bookclip further comprises a control region, wherein the smart pen communicates its location on the digital bookclip to the processor responsive to the smart pen device interacting with the control region.

4. The pen-based computing system of claim 1 , wherein the digital bookclip further comprises a numeric keypad, wherein the document identifier is identified responsive to an interaction of the smart pen with the numeric keypad.

5. The pen-based computing system of claim 1 , wherein the digital bookclip is aligned to a page of the printed document.

6. The pen-based computing system of claim 1 , wherein the digital bookclip being aligned to the printed document comprises:

manually aligning a vertical dimension of the digital bookclip with a vertical dimension of the page and manually aligning a horizontal position of the digital bookclip aligned with a specified position on the page.

7. The pen-based computing system of claim 6 , wherein the specified position on the page comprises a corner of the page.

8. The pen-based computing system of claim 1 , wherein the digital bookclip is a physically separate object from the printed document.

9. The system of claim 1 , wherein the physical material is opaque.

10. The system of claim 1 , wherein:

the smart pen device comprises a display system configured to display a first notice response to the smart pen device capturing the beginning location on the digital bookclip and a second notice responsive to the smart pen device capturing the end location on the digital bookclip; and

the computer program code additionally includes instructions for displaying at least a sub-portion of the digital representation of the printed document using the display system.

11. The system of claim 1 , wherein identifying a selected portion of the digital representation of the printed document based comprises:

identifying a beginning of a sentence corresponding to the beginning location captured on the digital bookclip and identifying an ending of a sentence corresponding to the end location captured on the digital bookclip; and

selecting the portion of the digital representation between the identified beginning of the sentence and the identified end of the sentence.

12. The system of claim 1 , comprising:

selecting an append button;

capturing a second beginning location on the digital bookclip corresponding to a beginning of a second interaction with the digital bookclip and a second end location on the digital bookclip corresponding to an end of the second interaction with the digital bookclip;

identifying a second portion of the digital document based on the second beginning location and the second end location of the second interaction; and

appending the second portion of the digital document to the selected first portion of the digital document.

13. A method for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, and a page of the printed document aligned with a digital bookclip in a predetermined manner, the method comprising:

receiving the document identifier associated with the printed document;

determining a vertical or horizontal orientation of the digital bookclip with respect to the printed document, wherein the digital bookclip comprises a physical material encoded with a pattern, the physical material distinct from the printed document;

using an imaging system of a data clipping device, capturing a beginning location on the digital bookclip corresponding to a beginning of an interaction with the data clipping device and an end location on the digital bookclip corresponding to an end of the interaction with the data clipping device;

identifying a selected portion of the page of the printed document based on the determined orientation of the digital bookclip with respect to the printed document and the beginning location and the end location of the interaction captured when the digital bookclip is aligned with the page of the printed document;

communicating the selected portion of the page of the printed document and the document identifier to a digital document retrieval system, that is configured to located a digital document associated with the document identifier and retrieve a portion of the digital document associated with the portion of the page of the printed document; and

receiving from the digital document retrieval system the portion of the digital document associated with the portion of the page of the printed document.

14. The method of claim 13 , wherein a vertical dimension of the digital bookclip is aligned with a vertical dimension of the page; and

wherein a horizontal position of the digital bookclip is aligned with a specified position on the page.

15. The method of claim 14 , wherein the horizontal position on the page comprises a corner of the page.

16. The method of claim 13 , wherein the digital bookclips a physically separate object from the printed document.

17. The method of claim 13 , wherein the data clipping device comprises a smart pen device.

18. A method for obtaining a digital representation of a region of a printed document including one or more pages, the method comprising:

receiving a document identifier associated with the printed document;

capturing, by an image sensor of a smart pen, a sequence of characters during a single vertical gesture of the smart pen, the single vertical gesture of the smart pen intersecting a plurality of horizontally oriented text on the printed document, the sequence of characters below and within view of the smart pen device during the single vertical gesture;

using optical character recognition to identify the sequence of characters captured during the single vertical gesture;

retrieving a digital document associated with the document identifier;

comparing the sequence of characters captured during the single vertical gesture with data included in the digital document; and

responsive to finding a sequence of characters in the data of the digital document matching the sequence of characters captured during the single vertical gesture, retrieving a portion of the digital document corresponding to the plurality of lines of horizontally oriented text data on the printed document.

19. The method of claim 18 wherein the single vertical gesture of the smart pen device comprises a vertical drag.

20. The method of claim 18 wherein comparing the sequence of characters captured during the single vertical gesture comprises:

generating one or more sequences of characters from data included in the digital document; and

comparing the sequence of characters captured during the single vertical gesture with the one or more sequences of characters from data included in the digital document.

21. A non-transitory computer-readable storage medium storing instructions configured to be executed by a processor coupled to a smart pen device, the instructions for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, the instructions including instructions for:

receiving the document identifier associated with the printed document;

determining a vertical or horizontal orientation of a digital bookclip with respect to the printed document, wherein the digital bookclip comprises a physical material encoded with a pattern, the physical material distinct from the printed document;

identifying a selected portion of a page of the printed document based on the determined orientation of the digital bookclip and a beginning location and an end location of an interaction of a data clipping device with the digital bookclip captured when the digital bookclip is aligned with the page of the printed document;

transmitting the selected portion of the page and the document identifier to a digital document store for locating a digital document associated with the document identifier.

22. The non-transitory computer readable storage medium of claim 21 , wherein identifying the portion of the page of the printed document associated with the selection received from the data clipping device comprises:

determining a paper coordinate system associated with the digital bookclip;

determining a coordinate set associated with a location on the digital bookclip accessed by the data clipping device; and

identifying the coordinate set associated with the location on the digital bookclip accessed by the data clipping device in the digital coordinate system.

23. The non-transitory computer readable storage medium of claim 21 , wherein retrieving the portion of the digital document associated with the portion of the page of the printed document comprises:

identifying a coordinate set associated with the selection of the one or more locations, the coordinate set specifying a relative position of the selection of the one or more locations on the digital bookclip;

identifying a line number included in the digital document associated with the document identifier associated with the coordinate set associated with the selection of the one or more locations, the line number identifying a line of text in the digital document; and

retrieving the line of text in the digital document.

Assignments (3)
SECURITY INTEREST Recorded May 29, 2015
From: LIVESCRIBE INC.
To: OPUS BANK
Reel/Frame 035797/0132 →
SECURITY AGREEMENT Recorded Apr 5, 2011
From: LIVESCRIBE INC.
To: SILICON VALLEY BANK
Reel/Frame 026079/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2009
From: VAN SCHAACK, ANDY; MARGGRAFF, JIM
To: LIVESCRIBE, INC.
Reel/Frame 022777/0664 →
Continuity (2)
Provisional Application 61042196 · Apr 3, 2008
Related Publication 20090267923A1 · Oct 29, 2009