IP Library Granted Patent US 9,805,483
Granted Patent B2
US 9,805,483 · App. 14/465,317 · Granted Oct 31, 2017

Enhanced recognition of charted data

Inventors: Aaron Lamar Wilson (Seattle, WA); Daniel Parish (Seattle, WA); Yi Zhang (Bothell, WA)
Assignee: Microsoft Technology Licensing, LLC
G06T11/206G06F3/04842G06F3/04847G06F3/04883G06K9/00476G06K9/00456G06T2207/10004G06T2207/20072
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,805,483
App. No.
14/465,317
Granted
Oct 31, 2017
Kind
B2
Abstract

An image including a chart displaying graphical elements may be received or captured by a computing device. The graphical elements, for example, may be bars of a bar chart, or components of a pie chart. Techniques described herein may determine values for the graphical elements. Techniques described herein may also analyze the arrangement of the graphical elements and other contextual information to determine a chart type. The generated values may be arranged into an editable chart and/or an editable data structure based on the chart type. Touch-enabled gestures may be applied to the data structure to allow a user to modify, save or otherwise process the data structure.

Claims (50)

1. A computer-implemented method comprising computer-implemented operations for:

obtaining an image of a chart having one or more graphical elements;

analyzing the image of the chart to identify an arrangement of the one or more graphical elements and a size of an individual graphical element of the one or more graphical elements;

determining a value for the individual graphical element based on the size of the individual graphical element, wherein analyzing the image to identify the size comprises measuring the individual graphical element to obtain the size, wherein the value is based on at least one relative proportion of the individual graphical element with respect to at least one other individual graphical element;

determining a chart type based on the arrangement of the one or more graphical elements; and

generating an editable graphical chart based on the chart type and the value for the individual graphical element.

2. The computer-implemented method of claim 1 , further comprising computer-implemented operations for generating an editable table storing the value for the individual graphical element of the one or more graphical elements.

3. The computer-implemented method of claim 1 , wherein analyzing the image to identify the size of the individual graphical element comprises measuring a length of the individual graphical element to obtain the size, wherein the value is based on the length of the individual graphical element.

4. The computer-implemented method of claim 1 , wherein analyzing the image to identify the size of the individual graphical element comprises measuring an area of the individual graphical element to obtain the size, wherein the value is based on, the area of the individual graphical element.

5. The computer-implemented method of claim 1 , wherein determining the value for the individual graphical element comprises:

identifying optically recognizable data that is associated with the individual graphical element; and

determining the value based, at least in part, on an interpretation of the optically recognizable data.

6. The computer-implemented method of claim 1 , wherein determining the value for the individual graphical element comprises:

measuring the individual graphical element to obtain a measurement of the individual graphical element, wherein the value is based on the measurement of the individual graphical element;

identifying a unit; and

associating the value with the unit.

7. A computer, comprising:

a processor; and

a computer-readable storage medium in communication with the processor, the computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by the processor, cause the computer to:

obtain an image of a chart having one or more graphical elements;

determine a length for an individual graphical element of the one or more graphical elements;

determine a value corresponding to the individual graphical element based on the length of the individual graphical element, wherein the value is based on measuring the individual graphical element to identify at least one relative proportion of the individual graphical element with respect to at least one other individual graphical element;

determine a chart type based on an arrangement of the one or more graphical elements; and

generate an editable graphical chart based on the chart type and the value corresponding to-the individual graphical element.

8. The computer of claim 7 , wherein the computer-readable storage medium has further computer-executable instructions stored thereupon, which when executed by the processor, cause the computer to generate an editable table storing the value for the individual graphical element of the one or more graphical elements.

9. The computer of claim 7 , wherein determining the value for the individual graphical element comprises measuring the individual graphical element to obtain the value or measuring at least one angle associated with the individual graphical element to obtain the value.

10. The computer of claim 7 , wherein determining the value for the individual graphical element comprises analyzing the image of the chart to measure the length of the individual graphical element to obtain the value.

11. The computer of claim 7 , wherein determining the value for the individual graphical element comprises analyzing the image of the chart to measure an area of the individual graphical element to obtain the value, wherein the value is based on the area of the individual graphical element.

12. The computer of claim 7 , wherein the computer-readable storage medium has further computer-executable instructions stored thereupon, which when executed by the processor, cause the computer to:

display the editable graphical chart on an interface configured to receive an input gesture for modifying a data structure containing the editable graphical chart;

receive the input gesture to modify the data structure;

modify the data structure based on the input gesture; and

display a modified version of the editable graphical chart based on the input gesture.

13. A computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by a computer, cause the computer to:

obtain an image of a chart having one or more graphical elements in an arrangement that corresponds to at least one of a bar chart, a pie chart, a scatter chart, or a line chart;

analyzing the image of the chart to identify the arrangement of the one or more graphical elements;

determine a value for an individual graphical element of the one or more graphical elements, wherein the value is based on measuring the individual graphical element to identify at least one relative proportion of the individual graphical element with respect to at least one other individual graphical element;

determine a chart type based on the arrangement of the one or more graphical elements; and

generate an editable graphical chart based on the chart type and the value for the individual graphical element.

14. The computer-readable storage medium of claim 13 , wherein the computer-readable storage medium comprises further computer-executable instructions stored thereupon for causing the computer to generate an editable table storing the value for the individual graphical element of the one or more graphical elements, wherein the editable graphical chart and the editable table are stored in a data structure, and wherein the data structure further comprises metadata representing the image.

15. The computer-readable storage medium of claim 13 , wherein the chart contained in the image includes at least one of a color, an orientation, a layout, or a format, wherein the editable graphical chart is further based on the at least one of the color, the orientation, the layout, or the format.

16. The computer-readable storage medium of claim 13 , wherein determining the value for the individual graphical element comprises measuring a length of the individual graphical element to obtain the value, wherein the value is based on the length of the individual graphical element.

17. The computer-readable storage medium of claim 13 , wherein determining the value for the individual graphical element comprises measuring an area of the individual graphical element to obtain the value, wherein the value is based, at least in part, on the area of the individual graphical element.

18. The computer-readable storage medium of claim 13 , wherein determining the value for the individual graphical element comprises:

identifying optically recognizable data that is associated with the individual graphical element; and

determining the value based, at least in part, on an interpretation of the optically recognizable data.

19. The computer-readable storage medium of claim 13 , wherein determining the value for the individual graphical element comprises:

measuring the individual graphical element to obtain a measurement, wherein the value is based on the measurement of the individual graphical element;

identifying a unit; and

associating the value with the unit.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2014
From: WILSON, AARON LAMAR; PARISH, DANIEL; ZHANG, YI
To: MICROSOFT CORPORATION
Reel/Frame 033584/0271 →
Continuity (1)
Related Publication 20160055659A1 · Feb 25, 2016