IP Library Granted Patent US 11,176,311
Granted Patent B1
US 11,176,311 · App. 16/924,284 · Granted Nov 16, 2021

Enhanced section detection using a combination of object detection with heuristics

Inventors: Mario J. Lorenzo (Miami, FL); Scott Carrier (New Hill, NC); Paul Lewis Felt (Springville, UT); Brendan Bull (Durham, NC)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F40/117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,311
App. No.
16/924,284
Granted
Nov 16, 2021
Kind
B1
Abstract

Aspects of the invention include converting text from a first image file into a first machine-encodable text, wherein the image file includes a first section of text that is offset from a second section of text. Analyzing the first image file to detect a position of the first section of text. Embedding a first section of the first machine encodable-text with metadata describing the position of the first section of text. Reformatting the first section of the first machine encodable-text to conform to the position of the first section of text.

Claims (61)

1. A computer-implemented method comprising:

detecting, by the processor, alphanumeric characters by recognizing patterns formed by dark areas of a first image file;

converting, by the processor, the detected alphanumeric characters to a first section of a machine-encodable text and a second section of a machine encodable-text;

detecting, by the processor, a position of the first section of the machine encodable-text, wherein detecting the position of the first section of the machine encodable-text comprises:

generating, by the processor, a plurality of bounding boxes in the first image file,

detecting, by the processor, features in a bounding box, of the plurality of bounding boxes, indicative of the first section of the machine encodable-text, and

classifying, by the processor, the bounding box as including the first section of the machine encodable-text;

detecting, by the processor, confidential information in the first section of the machine encodable-text;

replacing, by the processor, the confidential information with generic characters;

embedding, by the processor, the first section of the first machine encodable-text with metadata describing the position of the first section of text; and

reformatting, by the processor, the first section of the first machine encodable-text to conform to the position of the first section of text.

2. The computer-implemented method of claim 1 , wherein converting the text from the first image file to the first machine-encodable text comprises optical character recognition.

3. The computer-implemented method of claim 1 further comprising annotating the first section of machine-encodable text via a natural language processing technique.

4. The computer-implemented method of claim 1 , further comprising:

converting the first section of the first machine encodable-text to a second image file;

converting text of the second image file to a second machine-encodable text;

detecting a boundary of a subset of text from the second image file;

embedding the second machine encodable-text with metadata describing the boundary.

5. The computer-implemented method of claim 4 , wherein the subset comprises a sentence.

6. The computer implemented method of claim 4 , wherein detecting the boundary comprises performing a semantic analysis of text included in the second image file to determine the beginning and ending of the subset.

7. A system comprising:

a memory having computer readable instructions; and

one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

detecting alphanumeric characters by recognizing patterns formed by dark areas of a first image file;

converting the detected alphanumeric characters to a first section of a machine-encodable text and a second section of a machine encodable-text;

detecting a position of the first section of the machine encodable-text, wherein detecting the position of the first section of the machine encodable-text comprises:

generating a plurality of bounding boxes in the first image file,

detecting features in a bounding box, of the plurality of bounding boxes, indicative of the first section of the machine encodable-text, and

classifying the bounding box as including the first section of the machine encodable-text;

detecting confidential information in the first section of the machine encodable-text;

replacing the confidential information with generic characters;

embedding the first section of the first machine encodable-text with metadata describing the position of first section; and

reformatting the first section of the machine encodable-text to conform to a position of the first section of text.

8. The system of claim 7 , wherein converting the text from the first image file to the first machine-encodable text comprises optical character recognition.

9. The system of claim 7 , wherein the operations further comprise annotating the first section of machine-encodable text via natural language processing techniques.

10. The system of claim 7 , wherein the operations further comprise:

converting the first section of the first machine encodable-text to a second image file;

converting text of the second image file to a second machine-encodable text;

detecting a boundary of a subset of text from the second image file;

embedding the second machine encodable-text with metadata describing the boundary.

11. The system of claim 10 , wherein the subset comprises a sentence.

12. The system of claim 10 , wherein detecting the boundary comprises performing a semantic analysis of text included in the second image file to determine the beginning and ending of the subset.

13. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:

detecting alphanumeric characters by recognizing patterns formed by dark areas of a first image file;

converting the detected alphanumeric characters to a first section of a machine-encodable text and a second section of a machine encodable-text;

detecting a position of the first section of the machine encodable-text, wherein detecting the position of the first section of the machine encodable-text comprises:

generating a plurality of bounding boxes in the first image file,

detecting features in a bounding box, of the plurality of bounding boxes, indicative of the first section of the machine encodable-text, and

classifying the bounding box as including the first section of the machine encodable-text;

detecting confidential information in the first section of the machine encodable-text;

replacing the confidential information with generic characters;

embedding the first section of the machine encodable-text with metadata describing the position of first section; and

reformatting the first section of the machine encodable-text to conform to a position of the first section of text.

14. The computer program product of claim 13 , wherein converting the text from the first image file to machine-encodable text comprises optical character recognition.

15. The computer program product of claim 13 , wherein the operations further comprise annotating the first section of machine-encodable text via natural language processing techniques.

16. The computer program product of claim 13 , wherein the operations further comprise:

converting the first section of the first machine encodable-text to a second image file;

converting text of the second image file to a machine-encodable text;

detecting a boundary of a subset of text from the second image file;

embedding the second machine encodable-text with metadata describing the boundary.

17. The computer program product of claim 16 , wherein the subset comprises a sentence.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2020
From: LORENZO, MARIO J.; CARRIER, SCOTT; FELT, PAUL LEWIS; BULL, BRENDAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 053160/0995 →
Cited By (3)
US 12,354,382 US 12,374,137 US 12,615,432