IP Library Granted Patent US 9,311,548
Granted Patent B2
US 9,311,548 · App. 13/958,054 · Granted Apr 12, 2016

Recognizing and processing object and action tags from stickers

Inventors: Phil Constantinou (San Francisco, CA); Chris Dahl (Wellesley, MA); John W. Hoye (San Jose, CA); Jamie Hull (Sunnyvale, CA); Gabriel Campodonico (Oakland, CA); Stephen James White (San Francisco, CA); Alexander Pashintsev (Cupertino, CA)
Assignee: Evernote Corporation
G06K9/2063G06K9/00523G06K9/2054G06K9/228G06K9/3216G06K9/6202G06T7/0044G06F17/30256G06K2009/226G06K2009/363G06K2209/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,311,548
App. No.
13/958,054
Granted
Apr 12, 2016
Kind
B2
Abstract

Handling data for a photographic image, includes detecting a reference pattern in the data, detecting at least one sticker in the data, determining an action associated with the at least one sticker, and performing the action on the data. The reference pattern may be a uniform grid pattern of dots preprinted on paper. A paper type may be determined according to the reference image. Determining an action associated with the at least one sticker may depend, at least in part, on the paper type. Detecting a particular one of the stickers may cause data for the photographic image to be stored in a particular location. Detecting a particular one of the stickers may cause data for the photographic images to be assigned particular tags used for organizing and searching.

Claims (30)

1. A computer-implemented method for a user to perform a particular action on data for a photographic image, comprising:

a user handwriting notes on paper;

the user affixing at least one sticker on the paper;

the user photographing the paper to generate the data for a photographic image;

a processor performing the steps of:

detecting a reference pattern in the data, wherein the reference pattern is pre-printed on the paper and provides parameters for correction of the photographic image and wherein a paper type is determined according to the reference pattern;

detecting at least one sticker in the data;

selecting the particular action from a plurality of possible actions based on the at least one sticker and on the paper type; and

performing the particular action on the data.

2. A computer-implemented method, according to claim 1 , wherein the reference pattern is a uniform grid pattern of dots preprinted on the paper.

3. A computer-implemented method, according to claim 1 , wherein detecting a particular one of the stickers causes data for the photographic image to be stored in a particular location.

4. A computer-implemented method, according to claim 1 , wherein detecting a particular one of the stickers causes data for the photographic images to be assigned particular tags used for organizing and searching.

5. A computer-implemented method, according to claim 1 , wherein a particular one of the stickers represents a custom tag that is assigned after data for the photographic image is stored.

6. A computer-implemented method, according to claim 1 , wherein detecting a particular one of the stickers causes handwritten text corresponding to the sticker to be used for a title of a note corresponding to the data for the photographic image.

7. Computer software, provided in a non-transitory computer-readable medium, that handles data for a photographic image, the software comprising:

executable code that detects a reference pattern in the data, wherein the reference pattern is pre-printed on the paper and provides parameters for correction of the photographic image and wherein the data is provided by a photograph taken by a user of a handwritten note of the user on which the user had affixed a sticker;

executable code that determines a paper type according to the reference pattern;

executable code that detects the at least one sticker in the data;

executable code that determines an action associated with based on the at least one sticker and on the paper type; and

executable code that performs the action on the data.

8. Computer software, according to claim 7 , wherein the reference pattern is a uniform grid pattern of dots preprinted on the paper.

9. Computer software, according to claim 7 , wherein detecting a particular one of the stickers causes data for the photographic image to be stored in a particular location.

10. Computer software, according to claim 7 , wherein detecting a particular one of the stickers causes data for the photographic images to be assigned particular tags used for organizing and searching.

11. Computer software, according to claim 7 , wherein a particular one of the stickers represents a custom tag that is assigned after data for the photographic image is stored.

12. Computer software, according to claim 7 , wherein detecting a particular one of the stickers causes handwritten text corresponding to the sticker to be used for a title of a note corresponding to the data for the photographic image.

13. Computer software, according to claim 7 , wherein the software is one of: pre-loaded with a device, installed from an application store, and downloaded from a location of a network operator.

14. A computer-implemented method, according to claim 1 , wherein the parameters for correction of the photographic image estimate camera view angle to provide perspective correction.

15. A computer-implemented method, according to claim 1 , wherein the parameters for correction of the photographic image are used to estimate a distribution of distances between dots of a uniform grid pattern of dots along a single line augmented by calculating gridline curvature to correct for curved edges of the image.

16. Computer software, according to claim 7 , wherein the parameters for correction of the photographic image estimate camera view angle to provide perspective correction.

17. Computer software, according to claim 7 , wherein the parameters for correction of the photographic image are used to estimate a distribution of distances between dots of a uniform grid pattern of dots along a single line augmented by calculating gridline curvature to correct for curved edges of the image.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2023
From: MUFG BANK, LTD.
To: EVERNOTE CORPORATION
Reel/Frame 063116/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 8, 2021
From: EAST WEST BANK
To: EVERNOTE CORPORATION
Reel/Frame 057852/0078 →
SECURITY INTEREST Recorded Oct 6, 2021
From: EVERNOTE CORPORATION
To: MUFG UNION BANK, N.A.
Reel/Frame 057722/0876 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 040192/0720 Recorded Oct 22, 2020
From: SILICON VALLEY BANK
To: EVERNOTE CORPORATION
Reel/Frame 054145/0452 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 040240/0945 Recorded Oct 22, 2020
From: HERCULES CAPITAL, INC.
To: EVERNOTE CORPORATION; EVERNOTE GMBH
Reel/Frame 054213/0234 →
SECURITY INTEREST Recorded Oct 19, 2020
From: EVERNOTE CORPORATION
To: EAST WEST BANK
Reel/Frame 054113/0876 →
SECURITY INTEREST Recorded Oct 5, 2016
From: EVERNOTE CORPORATION; EVERNOTE GMBH
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 040240/0945 →
SECURITY AGREEMENT Recorded Sep 30, 2016
From: EVERNOTE CORPORATION
To: SILICON VALLEY BANK
Reel/Frame 040192/0720 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2013
From: CONSTANTINOU, PHIL; DAHL, CHRIS; HOYE, JOHN W., JR.; HULL, JAMIE; CAMPODONICO, GABRIEL; WHITE, STEPHEN JAMES; PASHINTSEV, ALEXANDER
To: EVERNOTE CORPORATION
Reel/Frame 031411/0742 →
Continuity (4)
Provisional Application 61684405 · Aug 17, 2012
Provisional Application 61692588 · Aug 23, 2012
Provisional Application 61714457 · Oct 16, 2012
Related Publication 20140050409A1 · Feb 20, 2014