IP Library › Granted Patent US 11,354,489
Granted Patent B2
US 11,354,489 · App. 17/308,244 · Granted Jun 7, 2022

Intelligent inferences of authoring from document layout and formatting

Inventors: Milos Raskovic (Belgrade, RS); Aljosa Obuljen (Belgrade, RS); Milan Sesum (Belgrade, RS); Dragan Slaveski (Belgrade, RS); Milos Lazarevic (Belgrade, RS); Nikola Terzic (Belgrade, RS)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06F40/151G06F16/116G06F16/168G06F16/93G06F40/117G06F40/131G06F40/14G06F40/143G06F40/16G06N5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,489
App. No.
17/308,244
Granted
Jun 7, 2022
Kind
B2
Abstract

Non-limiting examples of the present disclosure describe processing that generates intelligent inferences of authoring from analysis of attributes associated with a digital file being imported in an application/service. Examples described herein are configured to work with any type of application/service including an authoring application/service. For instance, a request to import a digital file is received in an application/service. The application/service may be configured to analyze the digital file and generate authoring inferences based on an analysis of attributes of the digital file. For example, a conversion data model may be utilized to identify a file type of the digital file, analyze attributes of the identified digital file (e.g. content portions, layout, formatting, metadata, etc.) and output file data in a format that is tailored for the application/service based on authoring inferences. A converted representation of the digital file is surfaced in the application/service based on output of the file data.

Claims (43)

1. A method comprising:

identifying a digital file for importation of content into an authoring service;

applying a trained model that is configured to automatically generate one or more authoring inferences suggesting data transformation of content from the digital file into a format for inclusion in a digital presentation object that is presentable in the authoring service, wherein the generating of the one or more authoring inferences comprises:

determining that an image portion of the digital file is missing a caption,

determining that a textual portion of the digital file is proximate to the image portion based on analysis of locational coordinates of one or more content sections of the digital file, and

automatically generating an authoring inference, of the one or more authoring inferences, providing a suggestion to generate a caption for the image portion using the textual portion based on a determination that the image portion is missing a caption and a determination that the textual portion is proximate to the image portion;

generating, based on analysis of the authoring inference, the digital presentation object that comprises an aggregated representation of the textual portion and the image portion presenting the textual portion as a caption for the image portion; and

transmitting, to the authoring service, data for rendering the digital presentation object.

2. The method of claim 1 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the textual portion, wherein the determination of the level of emphasis of formatting for the textual portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the textual portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the textual portion, formatting attributes associated with the textual portion to be representative of the caption for the image portion.

3. The method of claim 2 , wherein the trained data model is a machine learning model that is further configured to map the level of emphasis of formatting for the textual portion to a specific format, of a plurality of formats, of the digital presentation object of the authoring service.

4. The method of claim 1 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the image portion, wherein the determination of the level of emphasis of formatting for the image portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the image portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the image portion, formatting attributes associated with the image portion to be representative of the aggregate representation.

5. The method of claim 4 , wherein the trained data model is a machine learning model that is further configured to map the level of emphasis of formatting for the textual portion to a specific format, of a plurality of formats, of the digital presentation object of the authoring service.

6. The method of claim 1 , wherein the digital presentation object, of the authoring service, is a content card that collectively present a storyline for a digital presentation document of the authoring service.

7. The method of claim 1 , further comprising: detecting export of the digital presentation object in a different application or service; and in response to detecting the export of the digital presentation object, converting content of the digital presentation object back to an original file format for rendering in the different application or service.

8. A system comprising:

at least one processor; and

a memory, operatively connected with the at least one processor, storing computer-executable instructions that, when executed by the at least one processor, causes the at least one processor to execute a method that comprises:

identifying a digital file for importation of content into an authoring service;

applying a trained model that is configured to automatically generate one or more authoring inferences suggesting data transformation of content from the digital file into a format for inclusion in a digital presentation object that is presentable in the authoring service, wherein the generating of the one or more authoring inferences comprises:

determining that an image portion of the digital file is missing a caption,

determining that a textual portion of the digital file is proximate to the image portion based on analysis of locational coordinates of one or more content sections of the digital file, and

automatically generating an authoring inference, of the one or more authoring inferences, providing a suggestion to generate a caption for the image portion using the textual portion based on a determination that the image portion is missing a caption and a determination that the textual portion is proximate to the image portion;

generating, based on analysis of the authoring inference, the digital presentation object that comprises an aggregated representation of the textual portion and the image portion presenting the textual portion as a caption for the image portion; and

transmitting, to the authoring service, data for rendering the digital presentation object.

9. The system of claim 8 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the textual portion, wherein the determination of the level of emphasis of formatting for the textual portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the textual portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the textual portion, formatting attributes associated with the textual portion to be representative of the caption for the image portion.

10. The system of claim 9 , wherein the trained data model is a machine learning model that is further configured to map the level of emphasis of formatting for the textual portion to a specific format, of a plurality of formats, of the digital presentation object of the authoring service.

11. The system of claim 8 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the image portion, wherein the determination of the level of emphasis of formatting for the image portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the image portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the image portion, formatting attributes associated with the image portion to be representative of the aggregate representation.

12. The system of claim 11 , wherein the trained data model is a machine learning model that is further configured to map the level of emphasis of formatting for the textual portion to a specific format, of a plurality of formats, of the digital presentation object of the authoring service.

13. The system of claim 8 , wherein the digital presentation object, of the authoring service, is a content card that collectively present a storyline for a digital presentation document of the authoring service.

14. The system of claim 8 , wherein the method, executed by the at least one processor, further comprises: detecting export of the digital presentation object in a different application or service; and in response to detecting the export of the digital presentation object, converting content of the digital presentation object back to an original file format for rendering in the different application or service.

15. A computer-implemented method, executed on a computing device, comprising:

identifying a digital file for importation of content into an authoring service;

applying a trained model that is configured to automatically generate one or more authoring inferences suggesting data transformation of content from the digital file into a format for inclusion in a digital presentation object that is presentable in the authoring service, wherein the generating of the one or more authoring inferences comprises:

determining that an image portion of the digital file is missing a caption,

determining that a textual portion of the digital file is proximate to the image portion based on analysis of locational coordinates of one or more content sections of the digital file, and

automatically generating an authoring inference, of the one or more authoring inferences, providing a suggestion to generate a caption for the image portion using the textual portion based on a determination that the image portion is missing a caption and a determination that the textual portion is proximate to the image portion;

generating, based on analysis of the authoring inference, the digital presentation object that comprises an aggregated representation of the textual portion and the image portion presenting the textual portion as a caption for the image portion; and

rendering, in a graphical user interface (GUI) of the authoring service, the digital presentation object.

16. The computer-implemented method of claim 15 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the textual portion, wherein the determination of the level of emphasis of formatting for the textual portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the textual portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the textual portion, formatting attributes associated with the textual portion to be representative of the caption for the image portion.

17. The computer-implemented method of claim 16 , wherein the trained data model is a machine learning model that is further configured to map the level of emphasis of formatting for the textual portion to a specific format, of a plurality of formats, of the digital presentation object of the authoring service.

18. The computer-implemented method of claim 15 , wherein the generating of the one or more authoring inferences further comprises: generating a determination of a level of emphasis of formatting for the image portion, wherein the determination of the level of emphasis of formatting for the image portion is an aggregate heuristic score derived from an aggregation of scoring metrics each assigned to a specific formatting attribute identified for the image portion of the digital file, and wherein the generating of the digital presentation object further comprises modifying, based on the determination of the level of emphasis of formatting for the image portion, formatting attributes associated with the image portion to be representative of the aggregate representation.

19. The computer-implemented method of claim 15 , wherein the digital presentation object, of the authoring service, is a content card that collectively present a storyline for a digital presentation document of the authoring service.

20. The computer-implemented method of claim 15 , further comprising: detecting export of the digital presentation object in a different application or service; and in response to detecting the export of the digital presentation object, converting content of the digital presentation object back to an original file format for rendering in the different application or service.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2021
From: RASKOVIC, MILOS; OBULJEN, ALJOSA; SESUM, MILAN; SLAVESKI, DRAGAN; LAZAREVIC, MILOS; TERZIC, NIKOLA
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 056140/0863 →
Continuity (3)
Continuation 15788131 · Oct 19, 2017
Provisional Application 62563014 · Sep 25, 2017
Related Publication 20210256202A1 · Aug 19, 2021