IP Library › Granted Patent US 12,235,990
Granted Patent B2
US 12,235,990 · App. 17/751,397 · Granted Feb 25, 2025

Data obscuring for privacy-enhancement

Inventors: Martin Haerterich (Wiesloch, DE); Benjamin Weggenmann (Karlsruhe, DE)
Assignee: SAP SE
G06F21/6245
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,235,990
App. No.
17/751,397
Granted
Feb 25, 2025
Kind
B2
Abstract

Various examples are directed to systems and methods for obscuring private information in input data. A system may apply an encoder model to an input data unit to generate a latent space representation of the input data unit. The system may apply multi-dimensional noise to the latent space representation of the input data unit, the multi-dimensional noise having a first value in a first latent space dimension and a second value different than the first value in a second latent space dimension. The system may apply a decoder model to the latent space representation of the input data unit to generate an obscured data unit.

Claims (61)

1. A system for obscuring private information in input data, the system comprising:

a computing device comprising at least one processor and an associated storage device, the at least one processor programmed to perform operations comprising:

accessing an input data unit;

applying an encoder model to the input data unit to generate a latent space representation of the input data unit in a latent space, the latent space having a first latent space dimension and a second latent space dimension;

applying multi-dimensional noise to the latent space representation of the input data unit, the multi-dimensional noise having a first value in the first latent space dimension and a second value different than the first value in the second latent space dimension; and

applying a decoder model to the latent space representation of the input data unit to generate an obscured data unit.

2. The system of claim 1 , the operations further comprising:

accessing a plurality of labeled input data units, a first labeled input data unit of the plurality of labeled input data units comprising a first input data unit feature, a first utility parameter describing the first input data unit feature, and a first privacy parameter describing the first input data unit feature;

generating, using the plurality of labeled input data units, a utility classifier, the utility classifier to map from the latent space to a corresponding utility; and

generating, using the plurality of labeled input data units, a privacy classifier, the privacy classifier to map from the latent space to a corresponding privacy.

3. The system of claim 1 , the operations further comprising:

determining, using a utility classifier, a first latent space dimension utility attribution label;

determining, using a privacy classifier, a first latent space dimension privacy attribution label; and

determining the first value of the multi-dimensional noise using the first latent space dimension utility attribution label and the first latent space dimension privacy attribution label.

4. The system of claim 3 , the operations further comprising:

generating a privacy explainability map using the input data unit and the privacy classifier, the privacy explainability map comprising a plurality of latent space dimension privacy attribution labels including the first latent space dimension utility attribution label; and

generating a utility explainability map using the input data unit and the utility classifier, the utility explainability map comprising a plurality of latent space dimension utility attribution labels including the first latent space dimension utility attribution label.

5. The system of claim 3 , the operations further comprising:

determining a ratio using the first latent space dimension utility attribution label and the first latent space dimension privacy attribution label; and

applying the ratio to a noise distribution, the first value of the multi-dimensional noise being based at least in part on the applying of the ratio to the noise distribution.

6. The system of claim 5 , the applying of the ratio to the noise distribution comprising applying the ratio to a variance of a Gaussian distribution.

7. The system of claim 5 , further comprising cropping a result of applying the ratio to the noise distribution to determine the first value of the multi-dimensional noise.

8. The system of claim 1 , the operations further comprising determining a plurality of vectors, the plurality of vectors comprising a first vector corresponding to the first latent space dimension and a second vector corresponding to the second latent space dimension.

9. A method for obscuring private information in input data, the method comprising:

accessing, by an obscuring system, an input data unit, the obscuring system comprising at least one processor and an associated storage device;

applying, by the obscuring system, an encoder model to the input data unit to generate a latent space representation of the input data unit in a latent space, the latent space having a first latent space dimension and a second latent space dimension;

applying, by the obscuring system, multi-dimensional noise to the latent space representation of the input data unit, the multi-dimensional noise having a first value in the first latent space dimension and a second value different than the first value in the second latent space dimension; and

applying, by the obscuring system, a decoder model to the latent space representation of the input data unit to generate an obscured data unit.

10. The method of claim 9 , further comprising:

accessing, by the obscuring system, a plurality of labeled input data units, a first labeled input data unit of the plurality of labeled input data units comprising a first input data unit feature, a first utility parameter describing the first input data unit feature, and a first privacy parameter describing the first input data unit feature;

generating, by the obscuring system and using the plurality of labeled input data units, a utility classifier, the utility classifier to map from the latent space to a corresponding utility; and

generating, by the obscuring system and using the plurality of labeled input data units, a privacy classifier, the privacy classifier to map from the latent space to a corresponding privacy.

11. The method of claim 9 , further comprising:

determining, using a utility classifier, a first latent space dimension utility attribution label;

determining, using a privacy classifier, a first latent space dimension privacy attribution label; and

determining the first value of the multi-dimensional noise using the first latent space dimension utility attribution label and the first latent space dimension privacy attribution label.

12. The method of claim 11 , further comprising:

generating, by the obscuring system, a privacy explainability map using the input data unit and the privacy classifier, the privacy explainability map comprising a plurality of latent space dimension privacy attribution labels including the first latent space dimension utility attribution label; and

generating, by the obscuring system, a utility explainability map using the input data unit and the utility classifier, the utility explainability map comprising a plurality of latent space dimension utility attribution labels including the first latent space dimension utility attribution label.

13. The method of claim 11 , further comprising:

determining, by the obscuring system, a ratio using the first latent space dimension utility attribution label and the first latent space dimension privacy attribution label; and

applying the ratio to a noise distribution by the obscuring system, the first value of the multi-dimensional noise being based at least in part on the applying of the ratio to the noise distribution.

14. The method of claim 13 , the applying of the ratio to the noise distribution comprising applying the ratio to a variance of a Gaussian distribution.

15. The method of claim 13 , further comprising cropping a result of applying the ratio to the noise distribution to determine the first value of the multi-dimensional noise.

16. The method of claim 9 , further comprising determining, by the obscuring system, a plurality of vectors, the plurality of vectors comprising a first vector corresponding to the first latent space dimension and a second vector corresponding to the second latent space dimension.

17. A machine-readable medium comprising instructions thereon that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

accessing an input data unit;

applying an encoder model to the input data unit to generate a latent space representation of the input data unit in a latent space, the latent space having a first latent space dimension and a second latent space dimension;

applying multi-dimensional noise to the latent space representation of the input data unit, the multi-dimensional noise having a first value in the first latent space dimension and a second value different than the first value in the second latent space dimension; and

applying a decoder model to the latent space representation of the input data unit to generate an obscured data unit.

18. The machine-readable medium of claim 17 , the operations further comprising:

accessing a plurality of labeled input data units, a first labeled input data unit of the plurality of labeled input data units comprising a first input data unit feature, a first utility parameter describing the first input data unit feature, and a first privacy parameter describing the first input data unit feature;

generating, using the plurality of labeled input data units, a utility classifier, the utility classifier to map from the latent space to a corresponding utility; and

generating, using the plurality of labeled input data units, a privacy classifier, the privacy classifier to map from the latent space to a corresponding privacy.

19. The machine-readable medium of claim 17 , the operations further comprising:

determining, using a utility classifier, a first latent space dimension utility attribution label;

determining, using a privacy classifier, a first latent space dimension privacy attribution label; and

determining the first value of the multi-dimensional noise using the first latent space dimension utility attribution label and the first latent space dimension privacy attribution label.

20. The machine-readable medium of claim 19 , the operations further comprising:

generating a privacy explainability map using the input data unit and the privacy classifier, the privacy explainability map comprising a plurality of latent space dimension privacy attribution labels including the first latent space dimension utility attribution label; and

generating a utility explainability map using the input data unit and the utility classifier, the utility explainability map comprising a plurality of latent space dimension utility attribution labels including the first latent space dimension utility attribution label.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2022
From: HAERTERICH, MARTIN; WEGGENMANN, BENJAMIN
To: SAP SE
Reel/Frame 059991/0958 →
Continuity (1)
Related Publication 20230376626A1 · Nov 23, 2023
References Cited (46)
US 20100074437A1 · Inami · 2010 [cited by examiner]
US 20100091337A1 · Yoshio · 2010 [cited by examiner]
US 20180336463A1 · Bloom · 2018 [cited by applicant]
US 20200020098A1 · Odry · 2020 [cited by examiner]
US 20200082916A1 · Polykovskiy et al. · 2020 [cited by applicant]
US 20200366914A1 · Schroers · 2020 [cited by examiner]
US 20210150305A1 · Amiri et al. · 2021 [cited by applicant]
US 20210276547A1 · Narayanan et al. · 2021 [cited by applicant]
US 20220070150A1 · Haerterich et al. · 2022 [cited by applicant]
US 20220084173A1 · Liang · 2022 [cited by examiner]
US 20220101096A1 · Singer · 2022 [cited by examiner]
US 20220172050A1 · Dalli · 2022 [cited by examiner]
US 20230038935A1 · Kothari · 2023 [cited by examiner]
US 20230197289A1 · deLaubenfels · 2023 [cited by examiner]
US 20230222176A1 · Honke · 2023 [cited by examiner]
“Watrix Technology”, Biometric Update, [Online]. Retrieved from the Internet: <URL: https://www.biometricupdate.com/companies/watrix-technology>, (Accessed May 18, 2022), 4 pgs. [cited by applicant]
Cresswell, Antonia, et al., “Inverting The Generator Of A Generative Adversarial Network”, [Online]. Retrieved from the Internet: <URL: https://arxiv.org/pdf/1802.05701.pdf>, (2018), 8 pgs. [cited by applicant]
Dwork, C, et al., “Calibrating noise to sensitivity in private data analysis”, in Proceedings of the Third Conference on Theory of Cryptography, ser. TCC'06. Berlin, Heidelberg: Springer-Verlag, <http://dx.doi.org/10.10… [cited by applicant]
Galer, Susan, “SAP Medical Research Insights receives Red Dot Award”, SAP News Center (in German with English translation), [Online]. Retrieved from the Internet: <URL: [6] https://news.sap.com/germany/2015/11/sap-medic… [cited by applicant]
Kim, Jayoung, et al., “Wearable Biosensors for healthcare monitoring”, Nature Biotechnology, [Online]. Retrieved from the Internet: <URL:, (2019), 18 pgs. [cited by applicant]
Kwapisz, Jennifer, et al., “Activity Recognition using Cell Phone Accelerometers”, Sensor, KDD, (2010), 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Examiner Interview Summary mailed Sep. 19, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Final Office Action mailed Oct. 2, 2023”, 33 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Non Final Office Action mailed Apr. 21, 2023”, 29 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Non Final Office Action mailed May 15, 2024”, 29 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Response filed Feb. 2, 2024 to Final Office Action mailed Oct. 2, 2023”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Response filed Jul. 21, 2023 to Non Final Office Action mailed Apr. 21, 2023”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/010,501, Response filed Sep. 16, 2024 to Non Final Office Action mailed May 15, 2024”, 12 pgs. [cited by applicant]
“Saliency Maps in Tensorflow 2.0”, UR Machine Learning Blog, Data Scientist at City of Edmonton, [Online]. Retrieved from the Internet: <URL: https://usmanr149.github.io/urmlblog/cnn/2020/05/01/Salincy-Maps.html>, (May … [cited by applicant]
“Watrix Technology”, Biometric Update, [Online]. Retrieved from the Internet: <URL: https://www.biometricupdate.com/companies/watrix-technology>, (Accessed Jul. 17, 2023), 4 pgs. [cited by applicant]
Alguliyev, Rasim M, et al., “Privacy-preserving deep learning algorithm for big personal data analysis”, Journal of Industrial Information Integration, 15, (Sep. 2019), 1-14. [cited by applicant]
Chen, Xiao, et al., “Distributed Generation of Privacy Preserving Data with User Customization”, arXiv:1904.09415v1, (2019), 20 pgs. [cited by applicant]
Cresswell, Antonia, et al., “Inverting the Generator of a Generative Adversarial Network”, arXiv: 1802.05701v1, [Online]. Retrieved from the Internet: <URL: https://arxiv.org/pdf/1802.05701.pdf>, (2018), 8 pgs. [cited by applicant]
Dwork, C., et al., “Calibrating noise to sensitivity in private data analysis”, In Proceedings of the Third Conference on Theory of Cryptography, ser. TCC'06. Berlin, Heidelberg: Springer-Verlag, [Online] Retrieved from… [cited by applicant]
Galer, Susan, “SAP Medical Research Insights receives Red Dot Award”, SAP News Center (in German with English translation), [Online]. Retrieved from the Internet: <URL: https://news.sap.com/germany/2015/11/sap-medical-r… [cited by applicant]
Galer, Susan, “SAP Wins Red Dot Award”, [Online]. Retrieved from the Internet: <URL: https://news.sap.com/2015/11/sap-medical-research-insights-wins-red-dot-award/>, (2015), 5 pgs. [cited by applicant]
Hern, Alex, “Fitness tracking app strava gives away location of secret US army bases”, The Guardian, [Online]. Retrieved from the Internet: <URL: https://www.theguardian.com/world/2018/jan/28/fitness-tracking-app-gives-… [cited by applicant]
Kim, Jayoung, et al., “Wearable Biosensors for healthcare monitoring”, Nature Biotechnology, [Online]. Retrieved from the Internet: <URL: https://www.researchgate.net/publication/331329696_Wearable_biosensors_for_health… [cited by applicant]
Kwapisz, Jennifer, et al., “Activity Recognition using Cell Phone Accelerometers”, Sensor, KDD, [Online]. Retrieved from the Internet: <URL: https://www.researchgate.net/publication/220520200_Activity_Recognition_Using_… [cited by applicant]
Ma, Yue, et al., “Long Short-Term Memory Autoencoder Neural Networks Based DC Pulsed Load Monitoring Using Short-Time Fourier Transform Feature Extraction”, IEEE 29th International Symposium on Industrial Electronics (I… [cited by applicant]
Majumder, Sumit, et al., “Smartphone sensors for health monitoring and diagnosis.”, Sensors, 19, (2019), 45 pgs. [cited by applicant]
Malekzadeh, Mohammad, et al., “Replacement AutoEncoder: A Privacy-Preserving Algorithm for Sensory Data Analysis”, arXiv:1710.06564v3, (2018), 12 pgs. [cited by applicant]
Seshadri, Dhruv, et al., “Wearable sensors for monitoring the internal and external workload of the athlete”, npj Digit. Med. 2, 71, [Online]. Retrieved from the Internet: <URL: https://www.nature.com/articles/s41746-01… [cited by applicant]
Voynov, Andrey, et al., “Unsupervised Discovery of Interpretable Directions in the GAN Latent Space”, arXiv:2002.03754, (2020), 15 pgs. [cited by applicant]
Zhao, Shengjia, et al., “InfoVAE: Information maximizing variational autoencoders.”, arXiv:1706.02262v1, (2017), 11 pgs. [cited by applicant]
Zhou, et al., “Human Activity Recognition Based on Improved Bayesian Convolution Network to Analyze Health Care Data Using Wearable IoT Device”, IEEE Access, vol. 8, (Apr. 2020), 1-8. [cited by applicant]
Cited By (1)
US 12,437,105