IP Library Granted Patent US 11,830,098
Granted Patent B2
US 11,830,098 · App. 16/794,265 · Granted Nov 28, 2023

Data leak prevention using user and device contexts

Inventors: Rohit Pradeep Shetty (Bengaluru, IN); Erich Peter Stuntebeck (Atlanta, GA); Ramani Panchapakesan (Bengaluru, IN); Suman Aluvala (Bengaluru, IN); Chaoting Xuan (Atlanta, GA)
Assignee: VMWARE, INC.
G06Q50/265G06F21/74G06Q10/107G06Q10/109G10L15/22G10L15/30G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,830,098
App. No.
16/794,265
Granted
Nov 28, 2023
Kind
B2
Abstract

Disclosed are various examples for audio data leak prevention using user and device contexts. In some examples, a voice assistant device can be connected to a remote service that provides enterprise data to be audibly emitted by the voice assistant device. In response to a request for the enterprise data being received from the voice assistant device, an audio signal can be generated that audibly broadcasts the enterprise data. The audio signal can be generated to audibly redact at least a portion of the enterprise data based at least in part on a mode of operation of the voice assistant device. The voice assistant device can be directed to emit the enterprise data through a playback of the audio signal.

Claims (64)

1. A system, comprising:

at least one computing device; and

program instructions stored in memory and executable by the at least one computing device that, when executed, direct the at least one computing device to:

connect a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;

receive whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or regular expressions to not be redacted;

receive blacklist data for the mode of operation of the voice assistant device, the blacklist data comprising a second list of words, phrases, or regular expressions to be redacted;

in response to a request for the enterprise data being received from the voice assistant device, generate an audio signal that audibly broadcasts the enterprise data, wherein at least a first portion of the audio signal is generated to audibly redact at least a first portion of the enterprise data based at least in part on the first portion of the enterprise data matching the blacklist data for the mode of operation of the voice assistant device, and wherein at least a second portion of the audio signal is generated to not audibly redact at least a second portion of the enterprise data based at least in part on the second portion of the enterprise data matching the whitelist data for the mode of operation of the voice assistant device; and

direct the voice assistant device to emit the enterprise data through a playback of the audio signal.

2. The system of claim 1 , wherein the at least one computing device is further directed to:

maintain, in association with the voice assistant device, a plurality of security modes, the mode of operation of the voice assistant device being one of the security modes, wherein individual ones of the security modes are different from one another; and

in response to a request for the enterprise data being received from the voice assistant device, identify an active one of the plurality of security modes, wherein the audio signal is generated based at least in part on the active one of the plurality of security modes.

3. The system of claim 2 , wherein the at least one computing device is further directed to:

receive a request to change the active one of the security modes to another one of the security modes based at least in part on a verbalized command received from the voice assistant device.

4. The system of claim 2 , wherein the at least one computing device is further directed to:

adjust the active one of the security modes to another one of the security modes without a verbalized command based at least in part on a sensitivity of at least a portion of the enterprise data.

5. The system of claim 2 , wherein:

the active one of the security modes is enabled based at least in part on: multiple individuals being detected within an audible range of the voice assistant device or an analysis of a calendar item indicating that multiple individuals are present.

6. The system of claim 1 , wherein the enterprise data comprises at least one of:

an email; a calendar item; a reminder; an instant message; and a short message service (SMS) message.

7. The system of claim 1 , wherein a portion of the enterprise data is modified by:

replacing the first portion of the enterprise data with a predetermined audio tone;

replacing the first portion of the enterprise data with static sound; or

replacing the first portion of the enterprise data with silence.

8. A non-transitory computer-readable medium comprising machine-readable instructions, wherein the machine-readable instructions, when executed by at least one processor, direct the at least one computing device to at least:

connect a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;

receive whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or regular expressions to not be redacted;

receive blacklist data for the mode of operation of the voice assistant device, the blacklist data comprising a second list of words, phrases, or regular expressions to be redacted;

in response to a request for the enterprise data being received from the voice assistant device, generate an audio signal that audibly broadcasts the enterprise data, wherein at least a first portion of the audio signal is generated to audibly redact at least a first portion of the enterprise data based at least in part on the first portion of the enterprise data matching the blacklist data for the mode of operation of the voice assistant device, and wherein at least a second portion of the audio signal is generated to not audibly redact at least a second portion of the enterprise data based at least in part on the second portion of the enterprise data matching the whitelist data for the mode of operation of the voice assistant device; and

direct the voice assistant device to emit the enterprise data through a playback of the audio signal.

9. The non-transitory computer-readable medium of claim 8 , wherein the at least one computing device is further directed to:

maintain, in association with the voice assistant device, a plurality of security modes, the mode of operation of the voice assistant device being one of the security modes, wherein individual ones of the security modes are different from one another; and

in response to a request for the enterprise data being received from the voice assistant device, identify an active one of the plurality of security modes, wherein the audio signal is generated based at least in part on the active one of the plurality of security modes.

10. The non-transitory computer-readable medium of claim 9 , wherein the at least one computing device is further directed to:

receive a request to change the active one of the security modes to another one of the security modes based at least in part on a verbalized command received from the voice assistant device.

11. The non-transitory computer-readable medium of claim 9 , wherein the at least one computing device is further directed to:

adjust the active one of the security modes to another one of the security modes without a verbalized command based at least in part on a sensitivity of at least a portion of the enterprise data.

12. The non-transitory computer-readable medium of claim 9 , wherein:

the active one of the security modes is enabled based at least in part on: multiple individuals being detected within an audible range of the voice assistant device or an analysis of a calendar item indicating that multiple individuals are present.

13. The non-transitory computer-readable medium of claim 8 , wherein the enterprise data comprises at least one of: an email; a reminder; a calendar item; an instant message; and a short message service (SMS) message.

14. The non-transitory computer-readable medium of claim 8 , wherein a portion of the enterprise data is modified by:

replacing the first portion of the enterprise data with a predetermined audio tone;

replacing the first portion of the enterprise data with static sound; or

replacing the first portion of the enterprise data with silence.

15. A method, comprising:

connecting a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;

receiving whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or regular expressions to not be redacted;

receiving blacklist data for the mode of operation of the voice assistant device, the blacklist data comprising a second list of words, phrases, or regular expressions to be redacted;

in response to a request for the enterprise data being received from the voice assistant device, generating an audio signal that audibly broadcasts the enterprise data, wherein at least a first portion of the audio signal is generated to audibly redact at least a first portion of the enterprise data based at least in part on the first portion of the enterprise data matching the blacklist data for the mode of operation of the voice assistant device, and wherein at least a second portion of the audio signal is generated to not audibly redact at least a second portion of the enterprise data based at least in part on the second portion of the enterprise data matching the whitelist data for the mode of operation of the voice assistant device; and

directing the voice assistant device to emit the enterprise data through a playback of the audio signal.

16. The method of claim 15 , further comprising:

maintaining, in association with the voice assistant device, a plurality of security modes, the mode of operation of the voice assistant device being one of the security modes, wherein individual ones of the security modes are different from one another; and

in response to a request for the enterprise data being received from the voice assistant device, identifying an active one of the plurality of security modes, wherein the audio signal is generated based at least in part on the active one of the plurality of security modes.

17. The method of claim 16 , further comprising:

receiving a request to change the active one of the security modes to another one of the security modes based at least in part on a verbalized command received from the voice assistant device.

18. The method of claim 16 , further comprising:

adjusting the active one of the security modes to another one of the security modes without a verbalized command based at least in part on a sensitivity of at least a portion of the enterprise data.

19. The method of claim 16 , wherein:

the active one of the security modes is enabled based at least in part on: multiple individuals being detected within an audible range of the voice assistant device or an analysis of a calendar item indicating that multiple individuals are present.

20. The method of claim 15 , wherein:

the enterprise data comprises at least one of: an email; a reminder; a calendar item; an instant message; and a short message service (SMS) message; and

a portion of the enterprise data is modified by:

replacing the first portion of the enterprise data with a predetermined audio tone;

replacing the first portion of the enterprise data with static sound; or

replacing the first portion of the enterprise data with silence.

Assignments (4)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2020
From: SHETTY, ROHIT PRADEEP; STUNTEBECK, ERICH PETER; PANCHAPAKESAN, RAMANI; ALUVALA, SUMAN; XUAN, CHAOTING
To: VMWARE, INC.
Reel/Frame 051852/0082 →
Priority Claims (1)
IN 202041000113 · Jan 2, 2020 · national
Continuity (1)
Related Publication 20210209710A1 · Jul 8, 2021