IP Library › Granted Patent US 11,073,921
Granted Patent B2
US 11,073,921 · App. 16/625,244 · Granted Jul 27, 2021

Electronic device for generating analogue strokes and for digitally storing the analogue strokes, and an input system and method for digitizing analogue recordings

Inventors: Matthias Weidler (Nuremberg, DE); Andreas Freibert (Langensendelbach, DE); Alexander Rampp (Roth, DE); Dirk Peters (Erlangen, DE); Johannes Philipp Grohs (Forchheim, DE)
Assignee: STAEDTLER MARS GMBH & CO. KG
G06F3/03542G06F3/0317G06F3/0346G06F3/03545
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,073,921
App. No.
16/625,244
Granted
Jul 27, 2021
Kind
B2
Abstract

An electronic device, more particularly an electronic stylus, for generating analogue strokes, more particularly handwriting, and for digitally storing the analogue strokes, wherein the device includes components of a writing, drawing and/or painting device for creating analogue recordings on a recording medium, more particularly paper, wherein the device also includes electronic components and software for expanding the device into a digital writing and/or input device. The device has at least one localization unit, more particularly a camera, and as a result of the localization unit a localization between the device and a recording medium is created. The device has at least one motion detection unit, as a result of which, the motions of the device and analogue recordings generated therewith are digitally detected on a recording medium. The motion detection unit is designed as a laser tracker.

Claims (23)

1. An electronic device for generating analog strokes and digital storage of analog strokes, comprising:

components of a writing, drawing and/or painting device for generating analog recordings on a recording medium having at least two corners and at least three edges;

electronic components and software for expanding the device into a digital writing and/or input device;

at least one localization unit that has at least one IMU, a camera reference system, a microcontroller, and an evaluation software for absolute localization of the device relative to the recording medium, wherein the localization unit is configured to provide a localization between the device and a recording medium, wherein the localization is formed as a localization of the at least two corners and the at least three edges of the recording medium for the analog recordings using only the camera reference system without requiring the device to trace, draw or contact the at least two corners and the at least three edges of the recording medium for the analog recordings; and

at least one motion detection unit configured to digitally detect motions of the device and thus generated analog recordings in a coordinate system of the recording medium,

wherein the motion detection unit is a laser tracker.

2. The device according to claim 1 , wherein the electronic components and software comprise at least one IMU, a camera reference system, a microcontroller, a laser tracker and an evaluation software, wherein the electronic components and software are in contact with each other via a circuit board and/or other conductive connections.

3. The device according to claim 1 , wherein the evaluation software is configured as a sensor/data fusion unit, wherein the localization unit and the motion detection unit are brought together by the sensor data fusion unit.

4. The device according to claim 1 , wherein one of the electronic components is a distance meter for detecting a distance of the device from the recording medium, wherein the distance is present as a function of time, wherein the distance meter is a laser-based distance measuring device.

5. The device according to claim 1 , wherein the electronic components and software include a processor, a sensor, a data storage unit, a power source, a charge control, a mirror element, an on/off switch, a signal generator, a microphone and/or a data transmission unit.

6. The device according to claim 5 , wherein the sensor is a contact sensor designed as a pressure sensor and/or strain gauge for activating the device in contact with the recording medium.

7. The device according to claim 5 , wherein the data transmission unit is a communication module for transmitting detected and processed data to a digital terminal, wherein the data transmission unit is configured as a Bluetooth unit, a WLAN coupling or a cable connection.

8. The device according to claim 5 , wherein the signal generator is an acoustic and/or optical signal generator.

9. An input system, comprising: an electronic device according to claim 1 ; a recording medium; and a digital terminal.

10. A method for digitizing analog recorded data recorded with an electronic device according to claim 1 , for simultaneous detection of analog and digital data, comprising the steps of:

Step 1: activating the electronic device;

Step 2: calibrating an IMU sensor calibrated to a camera reference system by localizing the camera reference system via a detection and storage of at least two corners and at least three edge lines of a recording medium;

Step 3: recognizing by the electronic device a status “device on recording medium” via a contact sensor

Step 4: detecting motions/fine motions in form of analog recordings of the electronic device or a writing tip by a laser tracker in the localized recording medium and storing, processing and/or digitizing the detected motions as data;

Step 5: absolute localizing of a position of the writing tip in the status “device on recording medium” in a coordinate system of the recording medium, via the at least two visible/detectable corners and the three visible/detectable edges of the recording medium for the camera system, for detecting a position of the device;

Step 6: fusing sensor data, to localize the recorded fine motions of the writing tip in the analog writing or drawing process on the recording medium with aid of data calculated in step 5, provided that the fine motions of the writing tip are correctly tracked and recorded on the recording medium using the laser tracker, and also the absolute localization of the writing tip is performed on the recording medium;

Step 7: storing image data, including the fused sensor data of the fine motions, recorded in the status “device on recording medium” and digitized, and simultaneously storing the image data by an evaluation software as a time-dependent optically represented data record; and

Step 8: transmitting data records to any terminal for reconstructing, further processing, rendering and resaving.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 27, 2023
From: STAEDTLER MARS GMBH & CO. KG
To: STAEDTLER SE
Reel/Frame 065678/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2020
From: WEIDLER, MATTHIAS; FREIBERT, ANDREAS; RAMPP, ALEXANDER; PETERS, DIRK; GROHS, JOHANNES PHILIPP
To: STAEDTLER MARS GMBH & CO. KG
Reel/Frame 051744/0657 →
Priority Claims (1)
DE 10 2017 006 740.6 · Jun 22, 2017 · national
Continuity (1)
Related Publication 20200142509A1 · May 7, 2020