IP Library Granted Patent US 9,031,894
Granted Patent B2
US 9,031,894 · App. 13/769,838 · Granted May 12, 2015

Parsing and rendering structured images

Inventors: Sumit Gulwani (Bellevue, WA); Oleksandr Polozov (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F17/30247G06K9/00449
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,031,894
App. No.
13/769,838
Filed
Feb 19, 2013
Granted
May 12, 2015
Kind
B2
Art Unit
2129
USPC
706/47
Abstract

Systems and methods for generating a tuple of structured data files are described herein. In one example, a method includes detecting an expression that describes a structure of a structured image using a constructor. The method can also include using an inference-rule based search strategy to identify a hierarchical arrangement of bounding boxes in the structured image that match the expression. Furthermore, the method can include generating a first tuple of structured data files based on the identified hierarchical arrangement of bounding boxes in the structured image.

Claims (43)

1. A method for generating a tuple of structured data files comprising:

detecting an expression that describes a structure of a structured image;

using an inference-rule based search strategy to identify a hierarchical arrangement of bounding boxes in the structured image that match the expression; and

generating a first tuple of structured data files based on the identified hierarchical arrangement of bounding boxes in the structured image.

2. The method of claim 1 , wherein the inference-rule based search strategy comprises using both a top-down inference rule and a bottom-up inference rule.

3. The method of claim 1 , wherein the inference-rule based search strategy comprises identifying the bounding boxes by detecting a contour within the structured image using image processing techniques.

4. The method of claim 1 , wherein the first tuple of structured data files comprises a first data file of content values and a second data file of style characteristic related to the content values.

5. The method of claim 4 comprising:

generating a second tuple of data files for a second structured image based on the expression, wherein the second tuple of data files comprises a third data file of content values and a fourth data file of style characteristics related to the content values;

rendering a third structured image from the first data file based on the first structured image and the fourth data file based on the second structured image.

6. The method of claim 1 comprising:

detecting a modification to the first tuple of structured data files; and

rendering a second structured image with the modified first tuple of structured data files.

7. The method of claim 2 wherein the expression is an expression tree that is generated based on a set of example structured images.

8. The method of claim 7 wherein the top-down inference rule can identify the bounding boxes, wherein the bounding boxes comprise a first bounding box and a second bounding box that match at least two child expressions in the expression tree, given a third bounding box that matches a parent expression in the expression tree.

9. The method of claim 7 wherein the bottom-up inference rule can identify the bounding boxes, wherein the bounding boxes comprise a first bounding box that matches a parent expression in the expression tree, given a second bounding box and a third bounding box that match at least two child expressions in the expression tree.

10. One or more computer-readable storage media for generating a tuple of structured data files comprising a plurality of instructions that, when executed by a processor, cause the processor to:

detect an expression that describes a structure of a structured image using a constructor;

use an inference-rule based search strategy to identify a hierarchical arrangement of bounding boxes in the structured image that match the expression; and

generate a first tuple of structured data files based on the identified hierarchical arrangement of bounding boxes in the structured image, wherein the first tuple of structured data files comprises a first data file of content values and a second data file of style characteristic related to the content values.

11. The one or more computer-readable storage media of claim 10 , wherein the inference-rule based search strategy comprises using both a top-down inference rule and a bottom-up inference rule.

12. The one or more computer-readable storage media of claim 10 , wherein the inference-rule based search strategy comprises identifying the bounding boxes by detecting a contour within the first structured image using image processing techniques.

13. The one or more computer-readable storage media of claim 10 , wherein the instructions cause the processor to:

generate a second tuple of data files for a second structured image based on the expression, wherein the second tuple of data files comprises a third data file of content values and a fourth data file of style characteristics related to the content values; and

render a third structured image from the first data file based on the first structured image and the fourth data file based on the second structured image.

14. The one or more computer-readable storage media of claim 9 , wherein the instructions cause the processor to:

detect a modification to the first tuple of structured data files; and

render a second structured image with the modified first tuple of structured data files.

15. A system for generating a data file comprising:

a processor to execute processor executable code;

a storage device that stores processor executable code, wherein the processor executable code, when executed by the processor, causes the processor to:

detect an expression that describes a structure of a structured image using a constructor;

use an inference-rule based search strategy to identify a hierarchical arrangement of bounding boxes in the structured image that match the expression; and

generate a first tuple of structured data files based on the identified hierarchical arrangement of bounding boxes in the structured image, wherein the first tuple of structured data files comprises a first data file of content values and a second data file of style characteristic related to the content values.

16. The system of claim 15 , wherein the inference-rule based search strategy comprises identifying the bounding boxes by detecting a contour within the first structured image using image processing techniques.

17. The system of claim 15 , wherein the processor is to:

generate a second tuple of data files for a second structured image based on the expression, wherein the second tuple of data files comprises a third data file of content values and a fourth data file of style characteristics related to the content values; and

render a third structured image from the first data file based on the first structured image and the fourth data file based on the second structured image.

18. The system of claim 15 , wherein the processor is to:

detect a modification to the first tuple of structured data files; and

render a second structured image with the modified first tuple of structured data files.

19. The system of claim 15 , wherein the expression is an expression tree that is generated based on a set of example structured images.

20. The system of claim 19 , wherein the inference-rule based search strategy uses a top-down inference rule that can identify the bounding boxes, wherein the bounding boxes comprise a first bounding box and a second bounding box that match at least two child expressions in the expression tree, given a third bounding box that matches a parent expression in the expression tree.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2013
From: GULWANI, SUMIT; POLOZOV, OLEKSANDR
To: MICROSOFT CORPORATION
Reel/Frame 029825/0960 →
Continuity (1)
Related Publication 20140236991A1 · Aug 21, 2014