IP Library › Granted Patent US 11,275,972
Granted Patent B2
US 11,275,972 · App. 16/678,084 · Granted Mar 15, 2022

Image classification masking

Inventors: Gandhi Sivakumar (Bentleigh, AU); Craig M. Trim (Ventura, CA); Michael Bender (Rye Brook, NY); Martin G. Keen (Cary, NC)
Assignee: International Business Machines Corporation
G06K9/6267G06F16/583G06F21/6245G06K9/6215
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,275,972
App. No.
16/678,084
Granted
Mar 15, 2022
Kind
B2
Abstract

An embodiment of the invention may include a method, computer program product and computer system for image classification and masking. The method, computer program product and computer system may include computing device which may receive image data from one or more sources. The computing device may classify the image data utilizing visual recognition classification and identify one or more classified features, each classified feature being associated with one or more attributes. The computing device may analyze the classified image data to determine if one or more of images of the classified image data contains one or more sensitive attributes. In response to determining one or more images of the classified image data contains one or more sensitive attributes, the computing device may apply a masking technique and may generate one or more masked images.

Claims (54)

1. A method for image classification and masking, the method comprising:

classifying, by a computing device, the image data utilizing visual recognition classification;

identifying, by the computing device, one or more classified features contained within the classified image data, each classified feature being associated with one or more attributes;

analyzing, by the computing device, the classified image data to determine if one or more images of the classified image data contains one or more sensitive attributes;

in response to determining one or more images of the classified image data contains one or more sensitive attributes, applying, by the computing device, a masking technique to the one or more images of the classified image data containing the one or more sensitive attributes, wherein the masking technique comprises of at least one of the group consisting of: substitution image classification masking, variance image classification masking, and shuffling image classification masking; and

generating, by the computing device, one or more masked images, wherein the one or more masked images comprise the one or more of the images determined to contain sensitive attributes with the sensitive attributes masked.

2. A method as in claim 1 , further comprising:

generating, by the computing device, a corpus of images, the corpus of images comprising the one or more masked images and remaining images of the classified image data containing no sensitive attributes;

transmitting, by the computing device, the corpus of images with sensitive attributes masked to a visual analysis system; and

detecting, by the computing device, insights and trends based on the corpus of images by the visual analysis system.

3. A method as in claim 1 , wherein analyzing, by the computing device, the classified image data to determine if one or more images of the classified image data contains one or more sensitive attributes, further comprises:

identifying, by the computing device, user-defined sensitive attributes.

4. A method as in claim 1 , wherein analyzing, by the computing device, the classified image data to determine if one or more images of the classified image data contains one or more sensitive attributes, further comprises:

identifying, by the computing device, sensitive attributes based on sensitive attributes defined by a rules-engine application.

5. A method as in claim 1 , wherein substitution image classification masking comprises:

substituting, by the computing device, the one or more classified features of the image data containing one or more sensitive attributes with similar classification features and attributes.

6. A method as in claim 1 , wherein variance image classification masking comprises:

adjusting, by the computing device, a value of the one or more identified sensitive attributes.

7. A method as in claim 1 , wherein shuffling image classification masking comprises:

redistributing, by the computing device, a location of the one or more classified features containing sensitive attributes within a classified image with a location of a similar classified feature.

8. A computer program product for image classification and masking, the computer program product comprising:

a computer-readable storage medium having program instructions embodied therewith, wherein the computer-readable storage medium is not a transitory signal per se, the program instructions comprising:

program instructions to classify, by a computing device, image data utilizing visual recognition classification;

program instructions to identify, by the computing device, one or more classified features contained within the classified image data, each classified feature being associated with one or more attributes;

program instructions to analyze, by the computing device, the classified image data to determine if one or more images of the classified image data contains one or more sensitive attributes;

in response to determining one or more images of the classified image data contain one or more sensitive attributes, program instructions to apply, by the computing device, a masking technique to the one or more images of the classified image data containing the one or more sensitive attributes, wherein the masking technique comprises of at least one of the group consisting of: substitution image classification masking, variance image classification masking, and shuffling image classification masking; and

program instructions to generate, by the computing device, one or more masked images, wherein the one or more masked images comprise the one or more of the images determined to contain sensitive attributes with the sensitive attributes masked.

9. A computer program product as in claim 8 , further comprising:

program instructions to generate, by the computing device, a corpus of images, the corpus of images comprising the one or more masked images and remaining images of the classified image data containing no sensitive attributes;

program instructions to transmit, by the computing device, the corpus of images with sensitive attributes masked to a visual analysis system; and

program instructions to detect, by the computing device, insights and trends based on the corpus of images by the visual analysis system.

10. A computer program product as in claim 8 , wherein substitution image classification masking comprises:

substituting, by the computing device, the one or more classified features of the image data containing one or more sensitive attributes with similar classification features and attributes.

11. A computer program product as in claim 8 , wherein variance image classification masking comprises:

adjusting, by the computing device, a value of the one or more identified sensitive attributes.

12. A computer program product as in claim 8 , wherein shuffling image classification masking comprises:

redistributing, by the computing device, a location of the one or more classified features containing sensitive attributes within a classified image with a location of a similar classified feature.

13. A computer system for image classification and masking, the system comprising:

one or more computer processors, one or more computer-readable storage media, and program instructions stored on the one or more computer-readable storage media for execution by at least one of the one or more processors, the program instructions comprising:

program instructions to classify, by a computing device, image data utilizing visual recognition classification;

program instructions to identify, by the computing device, one or more classified features contained within the classified image data, each classified feature being associated with one or more attributes;

program instructions to analyze, by the computing device, the classified image data to determine if one or more images of the classified image data contains one or more sensitive attributes;

in response to determining one or more images of the classified image data contain one or more sensitive attributes, program instructions to apply, by the computing device, a masking technique to the one or more images of the classified image data containing the one or more sensitive attributes, wherein the masking technique comprises of at least one of the group consisting of: substitution image classification masking, variance image classification masking, and shuffling image classification masking; and

program instructions to generate, by the computing device, one or more masked images, wherein the one or more masked images comprise the one or more of the images determined to contain sensitive attributes with the sensitive attributes masked.

14. A computer system as in claim 13 , further comprising:

program instructions to generate, by the computing device, a corpus of images, the corpus of images comprising the one or more masked images and remaining images of the classified image data containing no sensitive attributes;

program instructions to transmit, by the computing device, the corpus of images with sensitive attributes masked to a visual analysis system; and

program instructions to detect, by the computing device, insights and trends based on the corpus of images by the visual analysis system.

15. A computer system as in claim 13 , wherein substitution image classification masking comprises:

substituting, by the computing device, the one or more classified features of the image data containing one or more sensitive attributes with similar classification features and attributes.

16. A computer system as in claim 13 , wherein variance image classification masking comprises:

adjusting, by the computing device, a value of the one or more identified sensitive attributes.

17. A computer system as in claim 13 , wherein shuffling image classification masking comprises:

redistributing, by the computing device, a location of the one or more classified features containing sensitive attributes within a classified image with a location of a similar classified feature.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2019
From: SIVAKUMAR, GANDHI; TRIM, CRAIG M.; BENDER, MICHAEL; KEEN, MARTIN G.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 050957/0984 →
Continuity (1)
Related Publication 20210142121A1 · May 13, 2021