IP Library › Granted Patent US 11,755,756
Granted Patent B1
US 11,755,756 · App. 16/993,707 · Granted Sep 12, 2023

Sensitive data management

Inventors: Jason Cline (Bellevue, WA); Yolando Pereira (Seattle, WA); Arvind Kumar Babel (Seattle, WA); Bharanidharan Arul Janakiammal (Seattle, WA); Rohan Manish Chandra (Seattle, WA); Gary Scot Henderson (Redmond, WA)
Assignee: Amazon Technologies, Inc.
G06F21/6209G10L13/00G10L15/22G10L2015/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,755,756
App. No.
16/993,707
Filed
Aug 14, 2020
Granted
Sep 12, 2023
Kind
B1
Examiner
AZAD, ABUL K
Art Unit
2656
USPC
704/200
Abstract

Systems and methods for sensitive data management are disclosed. A voice-enabled device may generate audio data representing a request from a user utterance. A remote system may perform speech-processing operations, including obtaining responsive text data from a third-party application. In examples, a sensitivity designation may be received from the third-party application, which may cause the remote system to encrypt the responsive text data, redact the text data, and/or remove the text data from the remote system after the response is provided to the voice-enabled device.

Claims (71)

1. A method, comprising:

receiving, from a device, input data representing a request;

identifying an application configured to provide a response to the request;

receiving, from the application, first data representing the response;

determining that a first portion of the response is sensitive;

generating, based at least in part on the response including the first portion that is sensitive, audio data representing a second portion of the response that differs from the first portion of the response, the second portion selected based at least in part on the second portion differing from the first portion, the audio data excluding the first portion of the response; and

sending, to the device, the audio data for output of the response.

2. The method of claim 1 , further comprising:

generating redacted data representing the first data with the first portion of the response redacted; and

storing the redacted data in association with user account data associated with the device.

3. The method of claim 2 , further comprising:

receiving request data to display a representation of the response on a screen; and

sending, based at least in part on receiving the request data, the redacted data for display instead of the first data.

4. The method of claim 1 , further comprising:

determining that the first portion of the first data is associated with a first sensitivity level designated as more sensitive than a second sensitivity level;

based at least in part on the first portion of the first data being associated with the first sensitivity level, generating second data indicating that the first data is unavailable for display;

receiving request data to display a representation of the response; and

causing, in response to the request data, display of a notification that the first data is unavailable.

5. The method of claim 1 , further comprising:

receiving request data to display a representation of the response; and

causing, in response to the request data, display of the second portion of the response without display of the first portion of the response.

6. The method of claim 1 , wherein determining that the first portion of the response is sensitive comprises determining that the first portion of the response is sensitive based at least in part on receiving, from a remote device associated with the application, an indication that the response includes sensitive information.

7. The method of claim 1 , further comprising:

determining user account data associated with the device;

determining a personal device associated with the user account data; and

sending text data to the personal device, the text data representing a redacted instance of the response with the first portion of the response redacted.

8. The method of claim 1 , further comprising:

generating second data representing a speech synthesis markup language (SSML) tag associated with a sensitivity designation for responses;

receiving an indication that the application has associated the SSML tag with the first data; and

wherein determining that the first portion of the response is sensitive comprises determining that the first portion of the response is sensitive based at least in part on the indication that the first data is associated with the SSML tag.

9. The method of claim 1 , further comprising:

sending text data representing the first data to the device such that text corresponding to the text data is displayed on the device for a predetermined amount of time based at least in part on the first portion of the response being sensitive; and

causing the device to refrain from displaying the text in response to the predetermined amount of time lapsing.

10. The method of claim 1 , further comprising, based at least in part on the first portion of the response being sensitive, causing the audio data to be deleted after sending the audio data to the device.

11. A system comprising:

one or more processors; and

computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving, from a device, input data representing a request;

identifying an application configured to provide a response to the request;

receiving, from the application, first data representing the response;

determining, utilizing the first data, that a first portion of the response is sensitive;

generating, based at least in part on the response including the first portion that is sensitive, audio data corresponding to the response, the audio data representing a second portion of the response that differs from the first portion of the response, the second portion selected based at least in part on the second portion differing from the first portion, the audio data excluding the first portion of the response; and

sending, to the device, the audio data for output of the response.

12. The system of claim 11 , the operations further comprising:

generating redacted data representing the first data with the first portion of the response redacted; and

storing the redacted data in association with an identifier of the input data.

13. The system of claim 12 , the operations further comprising:

receiving request data to present a representation of the response on a screen; and

sending, based at least in part on receiving the request data, the redacted data for display instead of the first data.

14. The system of claim 11 , the operations further comprising:

determining that the first portion of the first data is associated with a first sensitivity level designated as more sensitive than a second sensitivity level;

based at least in part on the first portion of the first data being associated with the first sensitivity level, generating second data indicating that the first data is unavailable for display;

receiving request data to present a representation of the response; and

causing, in response to the request data, display of a notification that the first data is unavailable.

15. The system of claim 11 , the operations further comprising:

receiving request data to display a representation of the response; and

causing, in response to the request data, display of the second portion of the response without display of the first portion of the response.

16. The system of claim 11 , wherein determining that the first portion of the response is sensitive comprises determining that the first portion of the response is sensitive based at least in part on receiving an indication that the response includes sensitive information, the indication received from a device associated with the application.

17. The system of claim 11 , the operations further comprising:

determining user account data associated with the device;

determining a personal device associated with the user account data; and

sending text data to the personal device, the text data representing a redacted instance of the response with the first portion of the response redacted.

18. The system of claim 11 , the operations further comprising:

generating second data representing speech synthesis markup language (SSML) tags associated with sensitivity designations for responses;

receiving an indication that the application has associated at least one of the SSML tags with the first data; and

wherein determining that the first portion of the response is sensitive comprises determining that the first portion of the response is sensitive based at least in part on the indication that the first data is associated with the at least one of the SSML tags.

19. The system of claim 11 , the operations further comprising:

sending text data representing the first data to the device;

causing text corresponding to the text data to be displayed on the device for a predetermined amount of time based at least in part on the first data including the first portion of the first data indicated to be sensitive; and

causing the device to refrain from displaying the text in response to the predetermined amount of time lapsing.

20. The system of claim 11 , the operations further comprising, based at least in part on the first data including the first portion of the first data indicated to be sensitive, causing the audio data to be deleted after sending the audio data to the device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2020
From: CLINE, JASON; PEREIRA, YOLANDO; BABEL, ARVIND KUMAR; JANAKIAMMAL, BHARANIDHARAN ARUL; CHANDRA, ROHAN MANISH; HENDERSON, GARY SCOT
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 054024/0515 →
Continuity (1)
Continuation 16140334 · Sep 24, 2018
Cited By (2)
US 12,413,664 US 12,739,323