IP Library › Granted Patent US 9,310,983
Granted Patent B2
US 9,310,983 · App. 14/514,568 · Granted Apr 12, 2016

Adding, deleting digital notes from a group of digital notes

Inventors: Guruprasad Somasundaram (Minneapolis, MN); Cristin E. Moran (St. Paul, MN); David M. Mahli (Woodbury, MN); Diane R. Wolk (Woodbury, MN); Richard J. Moore (Maplewood, MN); Pontus Axelsson (Stockholm, SE); Michael Rotstein (Stockholm, SE); Roland Persson (Stockholm, SE)
Assignee: 3M INNOVATIVE PROPERTIES COMPANY
G06F3/04842G06K9/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,310,983
App. No.
14/514,568
Granted
Apr 12, 2016
Kind
B2
Abstract

In general, the disclosure describes techniques for creating and manipulating software notes representative of physical notes. A computing device includes a processor, an image collection module configured to receive an input image of an environment having a plurality of physical notes, an image processing engine configured to identify the plurality of physical notes in the input image and generate a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image, and a graphical user interface configured to display the input image overlaid with the plurality of digital notes in place of the identified plurality of notes on a first portion of the graphical user interface and to display a set of one or more of the digital notes on a second portion of the graphical user interface.

Claims (69)

1. A method comprising:

receiving, by a computing device, an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;

processing, by the computing device, the input image to identify each of the plurality of physical notes in the input image;

responsive to identifying each of the plurality of physical notes, and by the computing device:

processing the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and

processing the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generating, by the computing device and within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;

displaying, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;

receiving, by the computing device, a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;

displaying, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and

responsive to input from the graphical user interface, updating the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

2. The method of claim 1 , further comprising:

receiving, by the computing device, a user input selecting for deletion at least one of the plurality of digital notes overlaid on the physical notes of the input image; and

removing, by the computing device and from the group of digital notes, digital notes that correspond to the digital notes selected for deletion.

3. The method of claim 1 , wherein the plurality of digital notes includes more digital notes than the subset of the digital notes, the method further comprising:

receiving, by the computing device, a user input selecting at least one digital note from the plurality of the digital notes overlaid on the physical notes of the input image that is not displayed in the group of digital notes;

updating the database to add, by the computing device, the at least one selected digital note to the group of digital notes; and

separately displaying the at least one selected digital note separate from the digital notes displayed overlaid on the physical notes of the input image.

4. The method of claim 1 , wherein the group of digital notes is organized according to a group hierarchy defined by the user input.

5. A computer system comprising:

one or more non-transitory computer-readable media having instructions stored thereon; and

one or more processors comprising integrated or discrete logic circuitry, wherein the instructions, when executed by the one or more processors, configure the computer system to:

receive, by a computing device of the computer system, an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;

process the input image with the computing device to identify each of the plurality of physical notes in the input image;

responsive to identifying each of the plurality of physical notes:

process the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and

process the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generate, by the computing device and within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;

display, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;

receive, by the computing device, a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;

display, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and

responsive to input from the graphical user interface, update the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

6. A non-transitory computer-readable medium comprising instructions that cause a programmable processor of a computing device to:

receive an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;

process the input image to identify each of the plurality of physical notes in the input image;

responsive to identifying each of the plurality of physical notes:

process the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and

process the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generate, within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of the physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;

display, on a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes;

receive a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;

display, by the computing device and separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and

responsive to input from the graphical user interface, update the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

7. A computing device comprising:

a processor comprising integrated or discrete logic circuitry; and

a note management application executable by the processor and configured to:

receive an input image of an environment having a plurality of physical notes, each of the physical notes comprising a separate physical object having a predefined boundary and recognizable content thereon;

identify each of the plurality of physical notes in the input image;

responsive to identifying each of the plurality of physical notes, and by the computing device:

process the input image to extract content from a note segment associated with a respective one of the plurality of physical notes in the input image; and

process the input image to determine one or more attributes of the respective one of the plurality of physical notes in the input image;

generate, within a database, a plurality of records representing a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein each of the records stores the respective one or more attributes associated with the corresponding one of the plurality of physical notes and includes the respective extracted content from the note segment associated with the corresponding physical note;

display the input image overlaid with the plurality of digital notes in place of the identified plurality of physical notes of the input image;

receive a user input selecting a subset of the digital notes overlaid on the physical notes of the input image to form a group of the digital notes representative of a collaboration session;

display, separate from the digital notes displayed as overlaid on the physical notes of the input image, the selected subset of the plurality of digital notes, wherein each of the digital notes in the group of digital notes corresponds to a respective one of the plurality of digital notes overlaid on the plurality of physical notes of the input image; and

responsive to input from the graphical user interface, update the respective records of the database corresponding to the selected subset of the plurality of digital notes to store metadata assigning the subset of the digital notes to the group of digital notes.

8. The device of claim 7 , wherein the device includes an image capture device configured to capture the input image.

9. The device of claim 7 , wherein the device includes a receiver configured to receive the input image.

10. The device of claim 9 , wherein the receiver includes a wireless communication interface configured to receive the input image.

11. The device of claim 9 , wherein the communication interface includes a wired communication device configured to receive the input image.

12. The device of claim 7 , wherein the note management application is further configured to:

receive a user input selecting for deletion at least one digital note from the plurality of the digital notes displayed as overlaid on the physical notes of the input image; and

remove, from the group of digital notes displayed, any of the digital notes that correspond to the digital notes selected for deletion.

13. The device of claim 7 , wherein the plurality of digital notes includes more digital notes than the subset of the digital notes, and wherein the note management application is further configured to:

receive a user input selecting at least one of the plurality of digital notes overlaid on the physical notes of the input image; and

add the selected plurality of digital notes to the group of digital notes.

14. The device of claim 7 , wherein the group of digital notes is organized accordingly to a group hierarchy defined by the user input.

15. The device of claim 7 , wherein the note management application is further configured to display indications of the group of digital notes in conjunction with the plurality of digital notes as overlaid on the physical notes of the input image.

16. The device of claim 7 , wherein the note management application is further configured to display indications of the group of digital notes in conjunction with the selected subset of the plurality of digital notes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2014
From: SOMASUNDARAM, GURUPRASAD; MORAN, CRISTIN E.; MAHLI, DAVID M.; WOLK, DIANE R.; MOORE, RICHARD J.; AXELSSON, PONTUS; ROTSTEIN, MICHAEL; PERSSON, ROLAND
To: 3M INNOVATIVE PROPERTIES COMPANY
Reel/Frame 033952/0042 →
Continuity (3)
Provisional Application 61891442 · Oct 16, 2013
Provisional Application 61934392 · Jan 31, 2014
Related Publication 20150106754A1 · Apr 16, 2015