IP Library › Granted Patent US 10,817,169
Granted Patent B2
US 10,817,169 · App. 15/639,298 · Granted Oct 27, 2020

Time-correlated ink

Inventor: Lukasz Stanislaw Spas (Lund, SE)
Assignee: Microsoft Technology Licensing, LLC
G06F3/04883G06F16/447G06F16/7867G06K9/00416G06K9/222G06K9/4604G06K9/469G06K9/6224G06T13/80G11B27/005G11B27/031G11B27/036G11B27/32G11B27/34H04N5/91H04N5/9305G06F2207/222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,817,169
App. No.
15/639,298
Granted
Oct 27, 2020
Kind
B2
Abstract

Techniques for time-correlated ink are described. According to various embodiments, ink input is correlated to content. For instance, ink input received during playback of a video is timestamped. According to various embodiments, ink input displayed over content is removed after input ceases. Further, ink input is displayed during playback of the portion of content to which the ink input is time correlated.

Claims (44)

1. A system comprising:

one or more processors; and

one or more computer-readable storage media storing computer-executable instructions that, responsive to execution by the one or more processors, cause the system to perform operations including:

displaying previously stored ink input over video content displayed on a display device, the displaying the ink input based on timestamps applied to ink strokes of the ink input, the timestamps temporally correlating the ink input to the video content, each timestamp indicating a playback time for the video content in which the corresponding ink stroke is displayed;

causing an ink stroke of the ink input to visually unwind, the visual unwinding comprising gradually removing the ink stroke from view on the display device as an unwinding animation that imitates a way the ink input corresponding to the ink stroke was received.

2. The system as described in claim 1 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on the timestamp associated with the ink stroke caused to unwind.

3. The system as described in claim 1 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on a distance between a start and end of the ink stroke caused to unwind.

4. The system as described in claim 1 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on a sampling rate of the ink stroke caused to unwind.

5. The system as described in claim 1 , wherein the operations further include:

receiving a rewind input;

rewinding the video content according to the rewind input;

retrieving the ink strokes of the previously stored ink input that are temporally correlated to a portion of the video content; and

rendering the retrieved ink strokes for display on the display device in temporal correlation with the video content such that the ink strokes are displayed in the reverse of the order in which they were received.

6. A computer-implemented method comprising:

receiving ink strokes that are input over video content displayed on a display device;

timestamping and storing the ink strokes to temporally correlate the ink strokes to the video content, wherein a timestamp for an ink stroke indicates a corresponding playback time for the video content in which the ink stroke is applied;

responsive to receiving an indication that input of an ink stroke ceases, causing the ink stroke to visually unwind, the visual unwinding comprising gradually removing the ink stroke from the display device as an unwinding animation that imitates a way the ink stroke was received; and

enabling playback of the ink strokes along with the video content and based on timestamps applied to the ink strokes.

7. The method as described in claim 6 , the visually unwinding comprising a velocity of visually unwinding, the velocity based on at least one of: the timestamp associated with the ink stroke caused to unwind, a distance between a start and end of the ink stroke caused to unwind, or a sampling rate of the ink stroke caused to unwind.

8. The method as described in claim 6 , further comprising:

receiving a rewind input;

rewinding the video content according to the rewind input; and

displaying the ink strokes over the video content in temporal correlation with the video content such that the ink strokes are displayed in the reverse of the order in which they were received.

9. The method as described in claim 6 , further comprising:

playing back a portion of the video content that is temporally correlated to at least some of the ink strokes; and

displaying the at least some of the ink strokes in temporal correlation with the portion of the video content at the same velocity with which the ink strokes were input.

10. A computer-implemented method comprising:

displaying previously stored ink input over video content displayed on a display device, the displaying the ink input based on timestamped ink strokes of the ink input, the timestamps temporally correlating the ink input to the video content, each timestamp indicating a corresponding playback time for the video content in which an ink stroke is displayed;

causing an ink stroke of the ink input to visually unwind, the visual unwinding comprising gradually removing the ink stroke from view on the display device as an unwinding animation that imitates a way the ink input corresponding to the ink stroke was received.

11. The method as described in claim 10 , further comprising grouping at least some of the ink strokes of the ink input into ink objects based on the respective time stamps for the ink strokes.

12. The method as described in claim 10 , further comprising grouping at least some of the ink strokes together based on geometrical clustering between respective ink strokes of the ink input.

13. The method as described in claim 10 , further comprising:

receiving a rewind input;

rewinding the video content according to the rewind input;

retrieving the ink strokes of the previously stored ink input that are temporally correlated to a portion of the video content; and

rendering the retrieved ink strokes for display on the display device in temporal correlation with the video content such that the ink strokes are displayed in the reverse of the order in which they were received.

14. The method as described in claim 10 , further comprising displaying each of the ink strokes of the ink input as an animation rendered at a velocity in which the respective ink stroke was received.

15. The method of claim 8 , wherein the displayed ink strokes are each rendered backward from the end of the ink stroke to the beginning of the ink stroke.

16. The method as described in claim 9 , further comprising:

causing a displayed ink stroke to visually unwind, the visual unwinding comprising gradually removing the ink stroke from view on the display device as an unwinding animation that imitates a way the ink stroke was received.

17. The method as described in claim 16 , the visually unwinding comprising a velocity of visually unwinding, the velocity based on at least one of: the timestamps associated with the ink stroke, a distance between a start and end of the ink stroke or a sampling rate of the ink stroke.

18. The method as described in claim 10 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on the timestamps associated with the ink stroke caused to unwind.

19. The method as described in claim 10 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on a distance between a start and end of the ink stroke caused to unwind.

20. The method as described in claim 10 , the visually unwinding of the ink stroke comprising a velocity of visually unwinding, the velocity based on a sampling rate of the ink stroke caused to unwind.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2017
From: SPAS, LUKASZ STANISLAW
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 042876/0385 →
Continuity (2)
Provisional Application 62408424 · Oct 14, 2016
Related Publication 20180107371A1 · Apr 19, 2018