IP Library › Granted Patent US 12,406,037
Granted Patent B2
US 12,406,037 · App. 17/123,948 · Granted Sep 2, 2025

System and method for digital steganography purification

Inventors: Jonathan Richard Lwowski (San Antonio, TX); Isaac Alexander Corley (San Antonio, TX)
Assignee: BOOZ ALLEN HAMILTON INC.
G06F21/16G06T3/4007G06F21/1066G06N3/04G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,037
App. No.
17/123,948
Granted
Sep 2, 2025
Kind
B2
Abstract

Exemplary systems and methods are disclosed for removing steganography from digital data is disclosed. The method and system involve receiving a digital data. At least one processing device accesses a steganography purifier model. The at least one processing device includes at least a generator configured to scale a magnitude of individual data elements of the digital data from a first value range to a second value range. The scaled data elements are downsampled to remove steganography data embedded in the digital data and produce a purified version. The purified version is upsampled by interpolating new data elements between one or more adjacent data elements to provide an upsampled purified version. The magnitude of the data elements of the upsampled purified version are scaled from the second value range to the first value range to generate a purified output version.

Claims (52)

1. A system for removing steganography from a digital data, the system comprising:

a receiving device configured to receive digital data including at least one of image data and audio data; and

at least one processing device configured to access a steganography purifier model having at least a generator configured to: scale a magnitude of individual data elements of the digital data from a first value range to a second value range, downsample the scaled data elements to remove steganography data embedded in the digital data and produce a purified version of the digital data, upsample the purified version of the digital data by interpolating new data elements between one or more adjacent data elements to provide an upsampled purified version of the digital data, and scale the data elements of the upsampled purified version of the digital data from the second value range to the first value range to generate a purified output version of the received digital data.

2. The system according to claim 1 , wherein the received digital data includes image data and the individual elements of the digital data are pixels.

3. The system according to claim 2 , wherein if the image data includes video image data, the system comprising:

a front-end device configured to parse the video image into a plurality of image frames and feed each image frame to the at least one processing device as the digital data.

4. The system according to claim 2 , wherein the magnitude of the individual data elements are scaled from a first value within the first value range of 0 to 255 to a second value within the second value range of 0 to 1.

5. The system according to claim 1 , wherein the received digital data includes audio data.

6. The system according to claim 5 , comprising:

a front-end device configured to reshape a vector of the audio data into a matrix format and feed the matrix to the at least one processor as the digital data.

7. The system according to claim 6 , wherein each individual element of the digital data is a sample of the audio data.

8. The system according to claim 6 , wherein the at least one processor is configured to generate the purified image as a matrix and reshape the matrix into a vector to generate purified audio data.

9. The system according to claim 1 , wherein steganography purifier model of the at least one processing device includes a discriminator configured to distinguish between the purified image generated by the generator and a cover image of the digital data during a training mode.

10. A method for removing steganography from digital data, comprising:

receiving, in a receiving device digital data including at least one of image data and audio data;

scaling, in at least one processing device which having an encoder of a steganography purifier model, a magnitude of individual data elements of the digital data from a first value range to a second value range;

downsampling, in the encoder architecture of the at least one processing device, the scaled data elements to remove steganography data embedded in the digital data and produce a purified version of the digital data;

upsampling, in the at least one processing device having a decoder of a steganography purifier model, the purified version of the digital data by interpolating new data elements between one or more adjacent data elements to provide an upsampled purified version of the digital data; and

scaling, in the decoder architecture of the at least one processing device, the data elements of the upsampled purified version of the digital data from the second value range to the first value range to generate a purified output version of the received digital data.

11. The method according to claim 10 , wherein if the image data includes a video image data, the method comprises:

parsing, in a front end device, the video image into a plurality of image frames; and

feeding each image frame to the at least one processing device as a digital data.

12. The method according to claim 11 , wherein if the received digital data includes audio data, the method comprises:

reshaping, in a front-end device, a vector of the audio data to a matrix format, and

feeding the matrix to the at least one processing device as the digital data.

13. The method according to claim 12 , wherein the purified output version of the received digital data is generated as a matrix of values, the method comprising:

reshaping the matrix into a vector to generate purified audio data.

14. The method according to claim 13 , wherein the digital data is received in a data signal and formatted according to an application program interface.

15. The method according to claim 10 , wherein scaling a magnitude of individual data elements of the digital dataset from a first value range to a second value range, comprises:

scaling the magnitude of the individual data elements from a first value within the first value range of 0 to 255 to a second value within the second value range of 0 to 1.

16. A method of training a system for removing steganography from digital data, the system having a receiving device and at least one processing device accessing a steganography purifier model having at least a generator for generating purified digital data and a discriminator for distinguishing between the purified digital data and cover data, the method comprising:

receiving, in the receiving device, a plurality of digital datasets including steganography, each digital datasets including one of image data and audio data;

scaling, via the generator of the at least one processing device, a magnitude of individual data elements of the digital dataset from a first value range to a second value range;

downsampling, via the generator of the at least one processing device, the digital dataset with the scaled elements to remove steganography data embedded in the digital data and producing a purified version of the digital dataset;

upsampling, via the generator of the at least one processing device, the purified version of the digital dataset by interpolating data between one or more adjacent data elements to provide an upsampled purified version of the digital dataset;

scaling, via the generator of the at least one processing device, the data elements of the upsampled purified version from the second value range to the first value range to generate a purified output version of the received digital dataset;

receiving, in the discriminator of the at least one processing device, the purified output version of the received digital dataset and a reference digital dataset, which corresponds to the digital dataset received by the receiving device; and

determining, via the discriminator of the at least one processing device, which of the purified version of the received digital dataset and the reference digital dataset contained steganography.

17. The method according to claim 16 , comprising:

feeding a determination result of the discriminator to the generator.

18. The method according to claim 17 , comprising:

wherein the nodal weights of the generator are adjusted so that a subsequent purified digital dataset has less steganographic content than a previous purified digital dataset.

19. The method according to claim 16 , comprising:

adjusting one or more nodal weights of the generator based on whether the determination result of the discriminator is correct.

20. The method according to claim 16 , wherein if the image data includes video image data, the method comprises:

parsing, in a front end device, the video image into a plurality of image frames; and

feeding each image frame to the at least one processing device as a corresponding digital dataset.

21. The method according to claim 16 , wherein if the received digital dataset includes audio data, the method comprises:

reshaping, in a front-end device, a vector of the audio data to a matrix format, and

feeding the matrix to the at least one processing device as a corresponding digital dataset.

22. The method according to claim 16 , wherein the purified output version of the digital dataset is generated as a matrix of values, the method comprising:

reshaping the matrix into a vector to generate a purified version of the audio data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2020
From: LWOWSKI, JONATHAN RICHARD; CORLEY, ISAAC ALEXANDER
To: BOOZ ALLEN HAMILTON INC.
Reel/Frame 054670/0301 →
Continuity (2)
Provisional Application 62949754 · Dec 18, 2019
Related Publication 20210192019A1 · Jun 24, 2021
References Cited (133)
US 6571021B1 · Braudaway · 2003 [cited by examiner]
US 6665417B1 · Yoshiura · 2003 [cited by examiner]
US 6674876B1 · Hannigan · 2004 [cited by examiner]
US 6813366B1 · Rhoads · 2004 [cited by examiner]
US 6944298B1 · Rhoads · 2005 [cited by examiner]
US 7956930B2 · Sullivan · 2011 [cited by examiner]
US 8737832B1 · Lin · 2014 [cited by examiner]
US 8867860B2 · Lyons · 2014 [cited by examiner]
US 9015494B2 · Fischer · 2015 [cited by examiner]
US 9690967B1 · Brundage · 2017 [cited by examiner]
US 10147433B1 · Bradley · 2018 [cited by examiner]
US 10182170B1 · Evans · 2019 [cited by examiner]
US 10339664B2 · Rhoads · 2019 [cited by examiner]
US 10410322B2 · Viswanathan · 2019 [cited by examiner]
US 10547858B2 · Wang · 2020 [cited by examiner]
US 10839487B2 · Stewart · 2020 [cited by examiner]
US 10896307B2 · Sharma · 2021 [cited by examiner]
US 10958869B1 · Chi · 2021 [cited by examiner]
US 10986356B2 · Kim · 2021 [cited by examiner]
US 11037274B2 · Vogels · 2021 [cited by examiner]
US 11043226B2 · Ravelli · 2021 [cited by examiner]
US 11062108B2 · Bradley · 2021 [cited by examiner]
US 11130042B2 · Tran · 2021 [cited by examiner]
US 11164295B2 · Stewart · 2021 [cited by examiner]
US 11315467B1 · Mandle · 2022 [cited by examiner]
US 11367159B1 · Holub · 2022 [cited by examiner]
US 11438632B2 · Yin · 2022 [cited by examiner]
US 12073487B2 · Kamath · 2024 [cited by examiner]
US 20030091189A1 · Rhoads · 2003 [cited by examiner]
US 20030137697A1 · Sato · 2003 [cited by examiner]
US 20060050957A1 · Naccari · 2006 [cited by examiner]
US 20070036357A1 · Van der Veen · 2007 [cited by examiner]
US 20070171288A1 · Inoue · 2007 [cited by examiner]
US 20070223592A1 · Rhoads · 2007 [cited by examiner]
US 20070286451A1 · Rhoads · 2007 [cited by examiner]
US 20080263359A1 · Radzishevsky · 2008 [cited by examiner]
US 20090015710A1 · Hirasawa · 2009 [cited by examiner]
US 20110026593A1 · New · 2011 [cited by examiner]
US 20120163655A1 · Tanaka · 2012 [cited by examiner]
US 20120239387A1 · Ben-David · 2012 [cited by examiner]
US 20120300976A1 · Tanaka · 2012 [cited by examiner]
US 20130019106A1 · Fischer · 2013 [cited by examiner]
US 20150278980A1 · Sinclair · 2015 [cited by examiner]
US 20150312579A1 · Sim · 2015 [cited by examiner]
US 20170084006A1 · Stewart · 2017 [cited by examiner]
US 20170103285A1 · Le Borgne · 2017 [cited by examiner]
US 20180293706A1 · Viswanathan · 2018 [cited by examiner]
US 20190171856A1 · Sharma · 2019 [cited by examiner]
US 20190205694A1 · Wang · 2019 [cited by examiner]
US 20190213705A1 · Kamath · 2019 [cited by examiner]
US 20190266749A1 · Rhoads · 2019 [cited by examiner]
US 20190304069A1 · Vogels · 2019 [cited by examiner]
US 20190332840A1 · Sharma · 2019 [cited by examiner]
US 20190378235A1 · Kamath · 2019 [cited by examiner]
US 20190385288A1 · Stewart · 2019 [cited by examiner]
US 20200019857A1 · Wang · 2020 [cited by examiner]
US 20200043138A1 · Chou · 2020 [cited by examiner]
US 20200162751A1 · Kim · 2020 [cited by examiner]
US 20200184212A1 · Anthony Samy · 2020 [cited by examiner]
US 20200250513A1 · Krishnamoorthy · 2020 [cited by examiner]
US 20200304794A1 · Lai · 2020 [cited by examiner]
US 20200349682A1 · Mayol Cuevas · 2020 [cited by examiner]
US 20200349686A1 · Shapovalova · 2020 [cited by examiner]
US 20200410335A1 · Gu · 2020 [cited by examiner]
US 20210125313A1 · Bai · 2021 [cited by examiner]
US 20210150312A1 · Lwowski · 2021 [cited by examiner]
US 20210150354A1 · Karras · 2021 [cited by examiner]
US 20210150769A1 · Babaheidarian · 2021 [cited by examiner]
US 20210192019A1 · Lwowski · 2021 [cited by examiner]
US 20210227231A1 · Hannuksela · 2021 [cited by examiner]
US 20210365716A1 · Li · 2021 [cited by examiner]
US 20220007029A1 · Deng · 2022 [cited by examiner]
US 20220051604A1 · Bogdanowicz · 2022 [cited by examiner]
US 20220165198A1 · Bogdanowicz · 2022 [cited by examiner]
US 20220262002A1 · Wang · 2022 [cited by examiner]
US 20230051960A1 · Sonneveldt · 2023 [cited by examiner]
US 20240412266A1 · Usui · 2024 [cited by examiner]
Volkhonskiy et al, Steganographic generative adversarial networks, Jan. 2020, Proc. SPIE, Twelfth International Conference on Machine Vision (ICMV 2019). [cited by examiner]
Cao et al, Resampling detection of recompressed images via dual-stream convolutional neural network, May 2019, Mathematical Biosciences and Engineering. [cited by examiner]
Corley et al, Destruction of Image Steganography using Generative Adversarial Networks, Dec. 2019, arXiv. [cited by examiner]
Huang et al, Image steganography using texture features and GANs, Jul. 2019, IEEE. [cited by examiner]
Tan et al., Pixel-Decimation-Assisted Steganalysis of Synchronize-Embedding-Changes Steganography, Jul. 2017, IEEE. [cited by examiner]
El-Emam et al., A novel algorithm for colour image steganography using a new intelligent technique based on three phases, Sep. 2015, Elsevier. [cited by examiner]
Duan et al., Reversible Image Steganography Scheme Based on a U-Net Structure, Jan. 2019, IEEE. [cited by examiner]
Hayes et al., Generating steganographic images via adversarial training, Jul. 2017, arXiv. [cited by examiner]
Meng et al., A Fusion Steganographic Algorithm Based on Faster R-CNN, 2018, Tech Science Press. [cited by examiner]
Liu et al., Image Deblocking Detection Based on a Convolutional Neural Network, Mar. 2019, IEEE. [cited by examiner]
Meng et al., A Fusion Steganographic Algorithm Based on Faster R-CNN, 2018, Tech Science Press. (Year: 2018). [cited by examiner]
Liu et al., Image Deblocking Detection Based on a Convolutional Neural Network, Mar. 2019, IEEE. (Year: 2019). [cited by examiner]
Hayes et al., Generating steganographic images via adversarial training, Jul. 2017, arXiv. (Year: 2017). [cited by examiner]
Duan et al., Reversible Image Steganography Scheme Based on a U-Net Structure, Jan. 2019, IEEE. (Year: 2019). [cited by examiner]
El-Emam et al., A novel algorithm for colour image steganography using a new intelligent technique based on three phases, Sep. 2015, Elsevier. (Year: 2015). [cited by examiner]
Tan et al., Pixel-Decimation-Assisted Steganalysis of Synchronize-Embedding-Changes Steganography, Jul. 2017, IEEE. (Year: 2017). [cited by examiner]
Volkhonskly et al, Steganographic generative adversarial networks, Jan. 2020, Proc. SPIE, Twelfth International Conference on Machine Vision (ICMV 2019). (Year: 2019). [cited by examiner]
Cao et al, Resampling detection of recompressed images via-dual-stream convolutional neural network, May 2019, Mathematical Biosciences and Engineering. (Year: 2019). [cited by examiner]
Corley et al., Destruction of Image Steganography using Generative Adversarial Networks, Dec. 2019, arXiv. (Year: 2019). [cited by examiner]
Huang et al., Image steganography using texture and GANs, Jul. 2019, IEEE. (Year: 2019). [cited by examiner]
“Apt37.” [Online]. Available: https://attack.mitre.org/groups/G0067/. [cited by applicant]
Msfvenom, [Online]. Available: https://www.offensivesecurity.com/metasploit- unleashed/msfvenom/. [cited by applicant]
Al-Naima, F., et al., “Destroying steganography content in image files, ” in The 5th International Symposium on Communication Systems, Networks and DSP (CSNDSP'06), Greece, 2006. [cited by applicant]
Ameen, S. Y., et al., “Optimal image steganography content destruction techniques,” , in International Conference on Systems, Control, Signal Processing and Informatics, 2013, pp. 453-457. [cited by applicant]
Amritha, P., et al., “Active warden attack on steganography using prewitt filter,”, in Proceedings of the International Conference on Soft Computing Systems. Springer, 2016, pp. 591-599. [cited by applicant]
Amritha, P., et al., “Anti-forensic approach to remove stego content from images and videos,” Journal of Cyber Security and Mobility, vol. 8, No. 3, pp. 295-320, 2019. [cited by applicant]
Amritha, P., et al., “On the removal of steganographic content from images,” Defence Science Journal, vol. 66, No. 6, pp. 574-581, 2016. [cited by applicant]
Baluja, S., “Hiding images in plain sight: Deep steganography,” in Advances in Neural Information Processing Systems, 2017, pp. 2069-2079. [cited by applicant]
Bas, P., et al., “Break our steganographic system”: the ins and outs of organizing boss, in International workshop on information hiding. Springer, 2011, pp. 59-70. [cited by applicant]
Bender, W., et al., “Techniques for data hiding”, IBM systems journal, vol. 35, No. 3.4, pp. 313-336, 1996. [cited by applicant]
Butterworth, S., et al., “On the theory of filter amplifiers,” Wireless Engineer, vol. 7, No. 6, pp. 536-541, 1930. [cited by applicant]
Chang, S. G., et al., “Adaptive wavelet thresholding for image denoising and compression,” IEEE transactions on image processing, vol. 9, No. 9, pp. 1532-1546, 2000. [cited by applicant]
Cox, I., et al., “Digital watermarking and steganography”, Morgan kaufmann, 2007. [cited by applicant]
Daubechies, I., “Ten lectures on wavelets”, Siam, 1992, vol. 61. [cited by applicant]
Essenwanger, O. M., “Elements of statistical analysis,” 1986. [cited by applicant]
Fridrich, J., “Steganographic algorithms,” [Online]. Available: http://dde.binghamton.edu/download/stego algorithms/. [cited by applicant]
Goodfellow, I., et al., “Generative adversarial nets,” in Advances in neural information processing systems, 2014, pp. 2672-2680. [cited by applicant]
He, K., et al., “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770-778. [cited by applicant]
Holub, V., et al., “Designing steganographic distortion using directional filters,” in 2012 IEEE International workshop on information forensics and security (WIFS). IEEE, 2012, pp. 234-239. [cited by applicant]
Holub, V., et al., “Universal distortion function for steganography in an arbitrary domain,” EURASIP Journal on Information Security, vol. 2014, No. 1, p. 1, 2014. [cited by applicant]
Jung, D., et al., “Pixelsteganalysis: Destroying hidden information with a low degree of visual degradation,” arXiv preprint arXiv:1902.11113, 2019. [cited by applicant]
Kingma, D. P., et al., “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014. [cited by applicant]
Ledig, C., et al., “Photo-realistic single image super-resolution using a generative adversarial network,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 4681-4690. [cited by applicant]
Li, B., et al., “A new cost function for spatial image steganography,” in 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 2014, pp. 4206-4210. [cited by applicant]
Nagrani, A., et al., “Voxceleb: a largescale speaker identification dataset,” in Interspeech, 2017. [cited by applicant]
Nair, V., et al., “Rectified linear units improve restricted boltzmann machines,” in Proceedings of the 27th international conference on machine learning (ICML-10), 2010, pp. 807-814. [cited by applicant]
Pevn'y, T., et al., “Using high-dimensional image models to perform highly undetectable steganography,” in International Workshop on Information Hiding. Springer, 2010, pp. 161-177. [cited by applicant]
Salimans, T., et al., “Pixelcnn++: Improving the pixelcnn with discretized logistic mixture likelihood and other modifications,” arXiv preprint arXiv:1701.05517, 2017. [cited by applicant]
Sharp, A., et al., “A novel active warden steganographic attack for next-generation steganography,” in 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC). IEEE, 2013, pp. 1138-1143. [cited by applicant]
Shrestha, P. L., et al., “A general attack method for steganography removal using pseudo-cfa re-interpolation,” in 2011 International Conference for Internet Technology and Secured Transactions. IEEE, 2011, pp. 454-459. [cited by applicant]
Smith, C. B., et al., “Denoising and the active warden,” in 2007 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 2007, pp. 3317-3322. [cited by applicant]
Wang, Z., et al., “A universal image quality index,” IEEE signal processing letters, vol. 9, No. 3, pp. 81-84, 2002. [cited by applicant]
Wang, Z., et al., “Image quality assessment: from error visibility to structural similarity,” IEEE transactions on image processing, vol. 13, No. 4, pp. 600-612, 2004. [cited by applicant]
Wayner, P., “Disappearing cryptography: information hiding: steganography and watermarking” Morgan Kaufmann, 2009. [cited by applicant]
Westfeld, A., et al., “Attacks on steganographic systems,” in International workshop on information hiding. Springer, 1999, pp. 61-76. [cited by applicant]
Zhang, R., et al., “Invisible steganography via generative adversarial networks,” Multimedia Tools and Applications, vol. 78, No. 7, pp. 8559-8575, 2019. [cited by applicant]
Cited By (1)
US 12,743,738