IP Library › Granted Patent US 11,302,323
Granted Patent B2
US 11,302,323 · App. 16/690,915 · Granted Apr 12, 2022

Voice response delivery with acceptable interference and attention

Inventors: Shubhadip Ray (Secaucus, NJ); Sarbajit K. Rakshit (Kolkata, IN); Avik Sanyal (Kolkata, IN); Craig M. Trim (Ventura, CA)
Assignee: International Business Machines Corporation
G10L15/22G06N20/00G08B3/10G08B21/182G10L15/1815G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,302,323
App. No.
16/690,915
Granted
Apr 12, 2022
Kind
B2
Abstract

A computer-implemented method comprises receiving an audio user request, converting the request into a digitized request using natural language processing. A determination is made, based on a measured user attentiveness level, of a suitability of responding to the user request. Responsive to a determination that the suitability of responding is above a predetermined threshold value, the method comprises providing a response to the user request.

Claims (67)

1. A computer-implemented method comprising:

receiving an audio user request from a user;

converting the request into a digitized request using natural language processing;

determining a suitability of responding value (SRV); and

responsive to a determining that the SRV is equal to or above a predetermined threshold value, providing a response to the user request;

wherein the SRV is based on a user attentiveness value and a user context value.

2. The method of claim 1 , further comprising:

responsive to a determining that the SRV is below the predetermined threshold value, performing an action selected from the group consisting of:

a) waiting until the SRV is equal to or above the predetermined threshold value, and responsive thereto, providing the response to the user request; and

b) determining a possibility of improving the SRV;

responsive to a positive determination of improving the SRV, taking an action to improve the SRV and then subsequently providing a response to the user request; and

responsive to a negative determination of improving the SRV, providing a response to the user request without taking an action to improve the SRV.

3. The method of claim 1 , further comprising:

receiving data from a device comprising physiological data of the user; and

determining the user attentiveness value based on the physiological data of the user.

4. The method of claim 3 , wherein the physiological data of the user is based on data selected from the group consisting of: a user's gaze time at an object, a user's posture, and a user's response time to previous responses.

5. The method of claim 1 , further comprising, responsive to the receiving of the user request:

determining a current distraction level of the user based on historical patterns of distraction levels, wherein the historical patterns of distraction levels comprise one or more historical interactions of the user that have each been identified as a respective historical distraction, wherein the historical patterns of distraction levels further comprise, for each of the one or more historical interactions of the user, a respective historical context that caused a respective historical distraction; and

predicting a time in which the user's determined distraction level is below an acceptable threshold based on a determination of importance of the request.

6. The method of claim 1 , further comprising:

responsive to detecting an interruption in a delivery of a response to the received request, determining a distraction level of the user associated with the interruption of the delivery; and

refocusing the user's attention to the delivery of the response by transmitting an alert to the user, wherein the alert is one or more sounds.

7. The method of claim 6 , further comprising delivering a response to the received request at a predicted time in which the determined distraction level of the user is below an acceptable threshold.

8. The method of claim 1 , further comprising determining acceptable thresholds of interference and attention that are specific to user clusters.

9. The method of claim 1 , further comprising predicting, at a time of the response and based on historical data, levels of interference in both a user's environment and context.

10. The method of claim 1 , further comprising:

performing, based on user reactions and based on follow up questions from users or commands from users, self-learning; and

enhancing, for specific users and users in a same user cluster, a knowledge corpus for actions and responses.

11. The method of claim 1 , further comprising:

performing, based on user reactions and based on follow up questions from users or commands from users, self-learning; and

adjusting acceptable thresholds of interference and required thresholds of attention for specific users and users in a same user cluster.

12. A voice response delivery system, comprising:

a processor configured to:

receive an audio user request from a user;

convert the request into a digitized request using natural language processing;

determine a suitability of responding value (SRV); and

responsive to a determination that the SRV is equal to or above a predetermined threshold value, provide a response to the user request;

wherein the SRV is based on a user attentiveness value and a user context value.

13. The system of claim 12 , wherein the processor is further configured to:

responsive to a determination that the SRV is below the predetermined threshold value, perform an action selected from the group consisting of:

a) wait until the SRV is equal to or above the predetermined threshold value, and responsive thereto, provide the response to the user request; and

b) determine a possibility to improve the SRV;

responsive to a positive determination to improve the SRV, take an action to improve the SRV and then subsequently provide a response to the user request; and

responsive to a negative determination to improve the SRV, provide a response to the user request without taking an action to improve the SRV.

14. The system of claim 12 , wherein the processor is further configured to:

receive data from a device comprising physiological data of the user; and

determine the user attentiveness value based on the physiological data of the user.

15. The system of claim 14 , wherein the physiological data of the user is based on data selected from the group consisting of: a user's gaze time at an object, a user's posture, and a user's response time to previous responses.

16. The system of claim 12 , wherein the processor is further configured to, responsive to the receiving of the user request:

determine a current distraction level of the user based on historical patterns of distraction levels, wherein the historical patterns of distraction levels comprise one or more historical interactions of the user that have each been identified as a respective historical distraction, wherein the historical patterns of distraction levels further comprise, for each of the one or more historical interactions of the user, a respective historical context that caused a respective historical distraction; and

predict a time in which the user's determined distraction level is within below an acceptable threshold based on a determination of importance of the request.

17. The system of claim 12 , wherein the processor is further configured to:

responsive to a detection of an interruption in a delivery of a response to the received request, determine a distraction level of the user associated with the interruption of the delivery; and

refocus the user's attention to the delivery of the response by transmitting an alert to the user, wherein the alert is one or more sounds.

18. The system of claim 12 , wherein the processor is further configured to predict, at a time of the response and based on historical data, levels of interference in both a user's environment and context.

19. A computer program product, the computer program product comprising a computer readable storage medium having computer-readable program instructions embodied therewith which, when executed on a processor, cause the processor to:

receive an audio user request from a user;

convert the request into a digitized request using natural language processing;

determine a suitability of responding value (SRV); and

responsive to a determination that the SRV is equal to or above a predetermined threshold value, provide a response to the user request;

wherein the SRV is based on a user attentiveness value and a user context value.

20. The computer program product of claim 19 , wherein the instructions, when executed on the processor, cause the processor to:

responsive to a determination that the SRV is below the predetermined threshold value, perform an action selected from the group consisting of:

a) wait until the SRV is equal to or above the predetermined threshold value, and responsive thereto, provide the response to the user request; and

b) determine a possibility to improve the SRV;

responsive to a positive determination to improve the SRV, take an action to improve the SRV and then subsequently provide a response to the user request; and

responsive to a negative determination to improve the SRV, provide a response to the user request without taking an action to improve the SRV.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: RAY, SHUBHADIP; RAKSHIT, SARBAJIT K.; SANYAL, AVIK; TRIM, CRAIG M.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 051078/0643 →
Continuity (1)
Related Publication 20210158808A1 · May 27, 2021