IP Library Granted Patent US 11,093,796
Granted Patent B2
US 11,093,796 · App. 15/472,837 · Granted Aug 17, 2021

Entity learning recognition

Inventors: Gaurav Goswami (New Deli, IN); Sharathchandra Umapathirao Pankanti (Yorktown Heights, NY); Nalini K. Ratha (Yorktown Heights, NY)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06K9/6262G06K9/6257G06N5/022G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,093,796
App. No.
15/472,837
Granted
Aug 17, 2021
Kind
B2
Abstract

An entity learning recognition method, system, and computer program product include learning (i.e., in a training phase) from at least one entity to produce augments entities such that an augmented entity is still recognizable as the original entity but differs sufficiently to produce a different feature representation of the entity to create a database for use (i.e., in an implementation phase).

Claims (80)

1. A computer-implemented entity learning recognition training method, comprising:

in a training phase:

selecting a structural element from a plurality of structural elements, the plurality of structural elements being a shape that is associated with a feature of a face;

for one or more entities in a training database:

associating the structural element with one or more features in an aspect of the entities, the entities being the faces of the training database;

generating one or more augmented entities based on one or more combinations of the structural element and the features; and

adding the augmented entities to the training database; and

training a model based on a combination of original entities and the augmented entities in an augmented database,

wherein the entities comprise an image that is used for the training of the model, and

wherein the structural element comprises a visual element portion of the image with added noise.

2. The computer-implemented method of claim 1 , further comprising associating the visual element with an object is based on a geometric transform.

3. The computer-implemented method of claim 1 , wherein a generated augmented entity is based on n superimposition of the structural element to a sample entity.

4. The computer-implemented method of claim 1 , further comprising:

applying existing distortion resultants of the entity in the database to the generated augmented entity;

updating the database with the augmented entity or the combined augmented entity of the generated augmented entity and the existing distortion resultants; and

verifying if more generated augmented entities are required in the database to train the model based on a feedback from the model.

5. The computer-implemented method of claim 1 , wherein said generating, further comprises:

selecting a distortion model D(.), from a plurality of distortion models;

transforming an object image (F) as a function of a selected D(.);

to create an extended corpus of augmented object images {D(F)}; and

reconstructing the object image (F) from D(F), where reconstructed object image (F′)=R(D(F))+e, where R is a transform and e is a reconstruction error,

wherein the transforming the object image (F) further comprises selecting R based on the value of e, and

wherein said training the model is limited to one or more R that produces a reconstructed object image (F′) exceeding a threshold value.

6. The computer-implemented method of claim 1 , further comprising:

in an implementation phase:

applying a data point to the trained model to obtain a feedback of an efficiency of a correspondence between the data point and the trained model; and

wherein the feedback is used to update the model in the training phase by selecting additional entities and training the model with the additional generated augmented entities.

7. The computer-implement method of claim 1 , further comprising:

associating the visual element with an object is based on a geometric transformation;

applying existing distortion resultants of the entity in the database to the generated augmented entity;

updating the database with the augmented entity or the combined augmented entity of the generated augmented entity and the existing distortion resultants; and

verifying if more generated augmented entities are required in the database to train the model based on a feedback from the model,

wherein a generated augmented entity is based on n superimposition of the structural element to a sample entity.

8. A computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause:

in a training phase:

selecting a structural element from a plurality of structural elements, the plurality of structural elements being a shape that is associated with a feature of a face;

for one or more entities in a training database:

associating the structural element with one or more features in an aspect of the entities, the entities being the faces of the training database;

generating one or more augmented entities based on one or more combinations of the structural element and the features; and

adding the augmented entities to the training database; and

training a model based on a combination of original entities and the augmented entities in an augmented database,

wherein the entities comprise an image that is used for the training of the model, and

wherein the structural element comprises a visual element portion of the image with added noise.

9. The computer program product of claim 8 , further comprising associating the visual element with object is based on a geometric transform.

10. The computer program product of claim 8 , wherein a generated augmented entity is based on n superimposition of the structural element to a sample entity.

11. The computer program product of claim 8 , further comprising:

applying existing distortion resultants of the entity in the database to the generated augmented entity;

updating the database with the augmented entity or the combined augmented entity of the generated augmented entity and the existing distortion resultants; and

verifying if more generated augmented entities are required in the database to train the model based on a feedback from the model.

12. The computer program product of claim 8 , wherein said generating, further comprises:

selecting a distortion model D(.), from a plurality of distortion models;

transforming an object image (F) as a function of a selected D(.);

to create an extended corpus of augmented object images {D(F)}; and

reconstructing the object image (F) from D(F), where reconstructed object image (F′)=R(D(F))+e, where R is a transform and e is a reconstruction error,

wherein the transforming the object image (F) further comprises selecting R based on the value of e, and

wherein said training the model is limited to one or more R that produces a reconstructed object image (F′) exceeding a threshold value.

13. The computer program product of claim 8 , further comprising:

in an implementation phase:

applying a data point to the trained model to obtain a feedback of an efficiency of a correspondence between the data point and the trained model; and

wherein the feedback is used to update the model in the training phase by selecting additional entities and training the model with the additional generated augmented entities.

14. An entity learning recognition system, said system comprising:

a processor; and

a memory, operably coupled to the processor, the memory storing instructions to cause the processor to perform:

in a training phase:

selecting a structural element from a plurality of structural elements, the plurality of structural elements being a shape that is associated with a feature of a face;

for one or more entities in a training database:

associating the structural element with one or more features in an aspect of the entities, the entities being the faces of the training database;

generating one or more augmented entities based on one or more combinations of the structural element and the features; and

adding the augmented entities to the training database; and

training a model based on a combination of original entities and the augmented entities in an augmented database,

wherein the entities comprise an image that is used for the training of the model, and

wherein the structural element comprises a visual element portion of the image with added noise.

15. The system of claim 14 , wherein said generating, further comprises:

selecting a distortion model D(.), from a plurality of distortion models;

transforming an object image (F) as a function of a selected D(.);

to create an extended corpus of augmented object images {D(F)}; and

reconstructing the object image (F) from D(F), where reconstructed object image (F′)=R(D(F))+e, where R is a transform and e is a reconstruction error,

wherein the transforming the object image (F) further comprises selecting R based on the value of e, and

wherein said training the model is limited to one or more R that produces a reconstructed object image (F′) exceeding a threshold value.

16. The system of claim 14 , embodied in a cloud-computing environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2017
From: GOSWAMI, GAURAV; PANKANTI, SHARATHCHANDRA UMAPATHIRAO; RATHA, NALINI K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 041803/0953 →
Continuity (1)
Related Publication 20180285690A1 · Oct 4, 2018