IP Library Granted Patent US 11,798,117
Granted Patent B2
US 11,798,117 · App. 17/349,604 · Granted Oct 24, 2023

Systems and methods for intelligent steganographic protection

Inventors: Madhusudhanan Krishnamoorthy (Srivilliputtur, IN); Paramita De (Kolkata, IN); Pawan Kumar Jha (Tamil Nadu, IN)
Assignee: BANK OF AMERICA CORPORATION
G06T1/0085G06N3/045H04W4/029G06T2201/0061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,798,117
App. No.
17/349,604
Granted
Oct 24, 2023
Kind
B2
Abstract

The present invention generally relates to the field of automated and flexible information extraction and protection for graphical data. In particular, the invention provides a unique platform for analyzing, classifying, extracting, and processing information from images using deep learning image detection models. Embodiments of the inventions are configured to provide an end to end automated solution for intelligently hiding or obscuring private data from graphical displays via the use of embedded steganographic image data techniques.

Claims (52)

1. A system for intelligent steganographic graphical data protection, the system comprising:

a processing device;

a non-transitory storage device containing instructions when executed by the processing device, causes the processing device to perform the steps of:

receive an original image for analysis from a user device, wherein the original image comprises an image displayed on a graphical user interface of the user device;

encode the original image using multiple convolutional neural network layers;

embed, simultaneously, a steganographic layer containing randomized portions of a secret image into the encoded image such that the randomized portions of the secret image obscure portions of the original image;

encrypt and store pooling indices for the randomized portions of the secret image in encoding feature variance layers of the encoded image;

receive geolocation data from the user device or one or more auxiliary user devices;

based on the geolocation data, determine that the user device is in a public location; and

determine portions of the original image to obscure based on the user device being in a public location.

2. The system of claim 1 , wherein the non-transitory storage device containing instructions when executed by the processing device further causes the processing device to perform the steps of:

apply a stegoanalyser to the encoded image to remove the steganographic layer resulting in a processed encoded image; and

decode the processed encoded image using additional multiple convolutional neural network layers to identify and extract feature data.

3. The system of claim 1 , wherein the multiple convolutional neural network layers further comprise batch normalization to normalize a scale of the encoded image and reduce internal covariance shift between the multiple convolutional neural network layers.

4. The system of claim 1 , wherein the multiple convolutional neural network layers further comprise using one or more linear-activation functions.

5. The system of claim 1 , wherein embedding the steganographic layer containing randomized portions of the secret image further comprises applying multiple hidden convolutional layers during encoding and wherein the hidden layers are applied between at least two separate convolutional neural network layers.

6. The system of claim 1 , wherein the non-transitory storage device containing instructions when executed by the processing device further causes the processing device to perform the steps of:

store user-specific location or time preferences, wherein the user-specific location or time preferences comprise specific locations or times wherein the user prefers the system to activate; and

continuously monitor geolocation data received from the user device or one or more auxiliary devices.

7. A computer program product for intelligent steganographic graphical data protection with at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured to receive an original image for analysis from a user device, wherein the original image comprises an image displayed on a graphical user interface of the user device;

an executable portion configured to encode the original image using multiple convolutional neural network layers;

an executable portion configured to embed, simultaneously, a steganographic layer containing randomized portions of a secret image into the encoded image such that the randomized portions of the secret image obscure portions of the original image;

an executable portion configured to encrypt and store pooling indices for the randomized portions of the secret image in encoding feature variance layers of the encoded image;

an executable portion configured to receive geolocation data from the user device or one or more auxiliary user devices;

an executable portion configured to based on the geolocation data, determine that the user device is in a public location; and

an executable portion configured to determine portions of the original image to obscure based on the user device being in a public location.

8. The computer program product of claim 7 , further comprising:

an executable portion configured to apply a stegoanalyser to the encoded image to remove the steganographic layer resulting in a processed encoded image; and

an executable portion configured to decode the processed encoded image using additional multiple convolutional neural network layers to identify and extract feature data.

9. The computer program product of claim 7 , wherein the multiple convolutional neural network layers further comprise batch normalization to normalize a scale of the encoded image and reduce internal covariance shift between the multiple convolutional neural network layers.

10. The computer program product of claim 7 , wherein the multiple convolutional neural network layers further comprise using one or more linear-activation functions.

11. The computer program product of claim 7 , wherein embedding the steganographic layer containing randomized portions of the secret image further comprises applying multiple hidden convolutional layers during encoding and wherein the hidden layers are applied between at least two separate convolutional neural network layers.

12. The computer program product of claim 7 , further comprising:

an executable portion configured to store user-specific location or time preferences, wherein the user-specific location or time preferences comprise specific locations or times wherein the user prefers the system to activate; and

an executable portion configured to continuously monitor geolocation data received from the user device or one or more auxiliary devices.

13. A computer-implemented method for intelligent steganographic graphical data protection, the method comprising:

receiving an original image for analysis from a user device, wherein the original image comprises an image displayed on a graphical user interface of the user device;

encoding the original image using multiple convolutional neural network layers;

embedding, simultaneously, a steganographic layer containing randomized portions of a secret image into the encoded image such that the randomized portions of the secret image obscure portions of the original image;

encrypting and store pooling indices for the randomized portions of the secret image in encoding feature variance layers of the encoded image;

receiving geolocation data from the user device or one or more auxiliary user devices;

based on the geolocation data, determining that the user device is in a public location; and

determining portions of the original image to obscure based on the user device being in a public location.

14. The computer-implemented method of claim 13 , the method further comprising:

applying a stegoanalyser to the encoded image to remove the steganographic layer resulting in a processed encoded image; and

decoding the processed encoded image using additional multiple convolutional neural network layers to identify and extract feature data.

15. The computer-implemented method of claim 13 , wherein the multiple convolutional neural network layers further comprise batch normalization to normalize a scale of the encoded image and reduce internal covariance shift between the multiple convolutional neural network layers.

16. The computer-implemented method of claim 13 , wherein the multiple convolutional neural network layers further comprise using one or more linear-activation functions.

17. The computer-implemented method of claim 13 , the method further comprising:

storing user-specific location or time preferences, wherein the user-specific location or time preferences comprise specific locations or times wherein the user prefers the system to activate; and

continuously monitoring geolocation data received from the user device or one or more auxiliary devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2021
From: KRISHNAMOORTHY, MADHUSUDHANAN; DE, PARAMITA; JHA, PAWAN KUMAR
To: BANK OF AMERICA CORPORATION
Reel/Frame 056567/0553 →
Continuity (1)
Related Publication 20220405875A1 · Dec 22, 2022