IP Library › Granted Patent US 12,481,423
Granted Patent B2
US 12,481,423 · App. 18/467,153 · Granted Nov 25, 2025

Writing utensil attachment to digitize handwriting

Inventors: Patricia Anne Lally (Apex, NC); Joseph McKeever (Wallkill, NY); David Forrler (Stamford, CT); Jia Zhu (Singapore, SG); Christianne Phillips (Oakland, CA)
Assignee: International Business Machines Corporation
G06F3/04883G06F3/0346G06F3/03545G06F3/0483G06F16/116
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,481,423
App. No.
18/467,153
Granted
Nov 25, 2025
Kind
B2
Abstract

A method for real-time digital transcription of handwriting and drawings. The method includes attaching a stroke motion recognition (SMR) device to a scribing implement. The method further includes detecting strokes of the scribing implement based on movements of the SMR and transmitting the strokes, and their relative locations, on a predetermined page to an application on a recording device communicatively connected to the SMR. The method further includes reproducing the strokes in their relative locations on a digital page corresponding to the predetermined page and storing the digital page on a persistent storage device.

Claims (51)

1 . A computer-implemented method for real-time digital transcription of handwriting and drawings, the computer-implemented method comprising:

detecting one or more relative locations of one or more handwritten strokes made by any sort of a typical scribing implement within a pre-set border of a page, via an externally adjustable short-range wireless stroke motion recognition (SMR) device which is removable and can be re-attached to the typical scribing implement, wherein the SMR device has transmitter sensors and receiver sensors to capture the one or more handwritten strokes in real-time, and wherein detecting the one or more handwritten strokes further comprises:

setting the SMR device, which is attached to the typical scribing implement, to page border mode;

defining the pre-set border of the page based on tracing a border of the page with the typical scribing implement containing the SMR device; and setting the SMR device to stroke detect mode;

converting the one or more handwritten strokes from within the border of the page, in real-time, to one or more relative locations of a corresponding digital page;

moving, automatically, to a next page when the one or more handwritten strokes of the typical scribing implement are detected beyond the pre-set border of the page; and

storing the corresponding digital page on a persistent storage device.

2 . The computer-implemented method of claim 1 , further comprising:

transmitting the one or more handwritten strokes and the one or more relative locations of the one or more handwritten strokes, on the page, to an application on a recording device communicatively connected to the SMR.

3 . The computer-implemented method of claim 2 , wherein the application changes to a next page based on a predetermined motion of the SMR or an automatic determination of a full page.

4 . The computer-implemented method of claim 1 , wherein the detecting further comprises:

setting the SMR to erase mode based on rotating the SMR one hundred eighty degrees;

erasing recorded strokes by swiping the SMR over the recorded strokes at an approximately forty-five degree angle; and

setting the SMR to stroke detect mode.

5 . The computer-implemented method of claim 2 , wherein the digital page stored on the persistent storage device includes editing functionality incorporated in the application.

6 . The computer-implemented method of claim 2 , wherein the application can reformat the digital page to a preferred format comprising a portable document format (PDF), a Microsoft Word application format, a text format, and an extensible markup language (XML) format.

7 . The computer-implemented method of claim 2 , wherein the application shares a reformatted file as part of a text message or an e-mail.

8 . A computer program product, comprising a non-transitory tangible storage device having program code embodied therewith, the program code executable by a processor of a computer to perform a method, the method comprising:

detecting one or more relative locations of one or more handwritten strokes made by any sort of a typical scribing implement within a pre-set border of a page, via an externally adjustable short-range wireless stroke motion recognition (SMR) device which is removable and can be re-attached to the typical scribing implement, wherein the SMR device has transmitter sensors and receiver sensors to capture the one or more handwritten strokes in real-time, and wherein detecting the one or more handwritten strokes further comprises:

setting the SMR device, which is attached to the typical scribing implement, to page border mode;

defining the pre-set border of the page based on tracing a border of the page with the typical scribing implement containing the SMR device; and

setting the SMR device to stroke detect mode;

converting the one or more handwritten strokes from within the border of the page, in real-time, to one or more relative locations of a corresponding digital page;

moving, automatically, to a next page when the one or more handwritten strokes of the typical scribing implement are detected beyond the pre-set border of the page; and

storing the corresponding digital page on a persistent storage device.

9 . The computer program product of claim 8 , further comprising:

transmitting the one or more handwritten strokes and the one or more relative locations of the one or more handwritten strokes, on the page, to an application on a recording device communicatively connected to the SMR.

10 . The computer program product of claim 9 , wherein the application changes to a next page based on a predetermined motion of the SMR or an automatic determination of a full page.

11 . The computer program product of claim 8 , wherein the detecting further comprises:

setting the SMR to erase mode based on rotating the SMR one hundred eighty degrees;

erasing recorded strokes by swiping the SMR over the recorded strokes at an approximately forty-five degree angle; and

setting the SMR to stroke detect mode.

12 . The computer program product of claim 9 , wherein the digital page stored on the persistent storage device includes editing functionality incorporated in the application.

13 . A computer system, comprising:

one or more computer devices each having one or more processors and one or more tangible storage devices; and

a program embodied on at least one of the one or more storage devices, the program having a plurality of program instructions for execution by the one or more processors, the program instructions comprising instructions for:

detecting one or more relative locations of one or more handwritten strokes made by any sort of a typical scribing implement within a pre-set border of a page, via an externally adjustable short-range wireless stroke motion recognition (SMR) device which is removable and can be re-attached to the typical scribing implement, wherein the SMR device has transmitter sensors and receiver sensors to capture the one or more handwritten strokes in real-time, and wherein detecting the one or more handwritten strokes further comprises:

setting the SMR device, which is attached to the typical scribing implement, to page border mode;

defining the pre-set border of the page based on tracing a border of the page with the typical scribing implement containing the SMR device; and

setting the SMR device to stroke detect mode;

converting the one or more handwritten strokes from within the border of the page, in real-time, to one or more relative locations of a corresponding digital page;

moving, automatically, to a next page when the one or more handwritten strokes of the typical scribing implement are detected beyond the pre-set border of the page; and

storing the corresponding digital page on a persistent storage device.

14 . The computer system of claim 13 , further comprising:

transmitting the one or more handwritten strokes and the one or more relative locations of the one or more handwritten strokes, on the page, to an application on a recording device communicatively connected to the SMR.

15 . The computer system of claim 14 , wherein the application changes to a next page based on a predetermined motion of the SMR or an automatic determination of a full page.

16 . The computer system of claim 13 , wherein the detecting further comprises:

setting the SMR to erase mode based on rotating the SMR one hundred eighty degrees;

erasing recorded strokes by swiping the SMR over the recorded strokes at an approximately forty-five degree angle; and

setting the SMR to stroke detect mode.

17 . The computer system of claim 14 , wherein the digital page stored on the persistent storage device includes editing functionality incorporated in the application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: LALLY, PATRICIA ANNE; MCKEEVER, JOSEPH; FORRLER, DAVID; ZHU, JIA; PHILLIPS, CHRISTIANNE
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 064904/0412 →
Continuity (1)
Related Publication 20250094039A1 · Mar 20, 2025
References Cited (23)
US 10419618B2 · Kato · 2019 [cited by applicant]
US 10740639B2 · Verma · 2020 [cited by applicant]
US 12045404B1 · Nordby · 2024 [cited by examiner]
US 20030061188A1 · Wiebe · 2003 [cited by examiner]
US 20070125860A1 · Lapstun · 2007 [cited by examiner]
US 20070139399A1 · Cook · 2007 [cited by examiner]
US 20090078473A1 · Overgard · 2009 [cited by examiner]
US 20100021022A1 · Pittel · 2010 [cited by examiner]
US 20110015893A1 · Altman · 2011 [cited by examiner]
US 20130027404A1 · Sarnoff · 2013 [cited by examiner]
US 20140253521A1 · Hicks · 2014 [cited by examiner]
US 20160282964A9 · Kim · 2016 [cited by applicant]
US 20180052534A1 · Ron · 2018 [cited by examiner]
US 20240112485A1 · Kwak · 2024 [cited by examiner]
KR 20170009384A · 2017 [cited by applicant]
KR 20200139881A · 2020 [cited by applicant]
WO WO2018072385A1 · 2018 [cited by examiner]
WO 2019235008A1 · 2019 [cited by applicant]
Nield, “Turn your handwritten documents into searchable digital notes”, Popsci.com, published Feb. 12, 2012, 2 pages, https://www.popsci.com/digitize-handwritten-notes/. [cited by applicant]
Yang et al., “DeepMotion: Handwriting English Character Classification Based on Motion Sensing on Pen,” COGS181, Final Project Report, Fall 2017, 12 pages. [cited by applicant]
Young, “Smart Whiteboard Markers”, Trendhunter.com, Feb. 11, 2015, 5 pages, https://www.trendhunter.com/trends/whiteboard-marker. [cited by applicant]
WACOM, “Welcome to the International Website From WACOM”, accessed Aug. 4, 2023, 4 pages. [cited by applicant]
Livescribe, “Know your Symphony Smartpen”, accessed Aug. 4, 2023, 2 pages. [cited by applicant]