IP Library Granted Patent US 11,842,372
Granted Patent B2
US 11,842,372 · App. 16/947,767 · Granted Dec 12, 2023

Systems and methods for real-time processing of audio feedback

Inventors: Leslie Stretch (San Mateo, CA); Krish Mantripragada (San Mateo, CA); Ric Smith (San Mateo, CA); Ali Sadat (San Mateo, CA)
Assignee: Medallia, Inc.
G06Q30/0282G06F3/167G06F40/295G06Q10/0637G06Q10/10G06Q30/016G06Q30/0203G06Q30/0205G06Q50/01G10L15/26G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,842,372
App. No.
16/947,767
Granted
Dec 12, 2023
Kind
B2
Abstract

Embodiments discussed herein are directed to systems and methods for processing audio feedback on a business, product or service offered and providing the feedback to an associated company in a way that enables the appropriate actors within the company's organizational hierarchy to analyze and take action with respect to the feedback. Customers or employees can interact with a virtual assistant platform or other voice recognition platform to access a feedback service that enables customers or employees to provide feedback to or have a conversation with any business about their product or service. The feedback service can be accessed at any time using a mobile phone or internet connected speaker device using a digital assistant platform.

Claims (71)

1. A computer-implemented method, comprising:

receiving a user provided audio feedback in response to a user interacting with a virtual assistant platform, wherein the user provided audio feedback is provided to a speech to text engine that converts the user provided audio feedback to digital form, wherein the audio feedback is associated with a user interaction with a business, product, or service;

converting the user provided audio feedback in digital form to text via speech to text (STT) platform;

generating a metadata from prosodic and acoustic features of the audio feedback, wherein the metadata is device generated metadata;

classifying a polarity associated with the audio feedback via a sentiment analysis engine;

determining an emotion context data associated with the audio feedback using machine learning and artificial intelligence algorithms, wherein the determining is based on the metadata and further based on processing the audio feedback in textual form using at least one of a natural language processing, text analysis, and computational linguistics, and wherein the determining is further based on the classifying;

determining a business name associated with the received audio feedback based on analyzing the text and further based on receiving a geolocational data via an application programming interface (API) running on a user device;

identifying a client account associated with the business name;

responsive to the identifying, posting the feedback and the determined emotion to a location-specific response feed of a feedback website associated with the identified client account;

generating a Unit in response to receipt of the audio feedback, wherein the Unit represents an interaction between a representative associated with a client account and the customer; and

generating a report based on the Unit.

2. The computer-implemented method of claim 1 , further comprising:

posting the feedback to a generic response feed of a publicly accessible website, wherein the posting the feedback to the generic response feed is associated with the identified client account responsive to identifying the business name and in absence of the business location being known.

3. The computer-implemented method of claim 1 , further comprising:

posting the feedback to a feedback website when the business name is not associated with any client accounts.

4. The computer-implemented method of claim 1 further comprising:

identifying the business name or the business location using a map application program interface.

5. The computer-implemented method of claim 1 , further comprising:

accessing a user profile of the user via the speech to text engine; and

associating the user profile with the audio feedback.

6. The computer-implemented method of claim 1 , wherein the feedback is posted to the location-specific response feed to enable an employee of the identified client account to engage in a closed loop feedback with the user.

7. The computer-implemented method of claim 6 , wherein the closed loop feedback comprises an inner loop and an outer loop, wherein the inner loop comprises:

following up with the user in response to the received feedback to obtain additional information; and

identifying and executing actions based on the feedback and the obtained additional information; and

wherein the outer loop comprises:

aggregating information collected from the inner loop to provide an aggregated data set; and

analyzing the aggregated data set to develop systematic improvements for the identified client account.

8. The computer-implemented method of claim 6 , wherein the closed loop feedback comprises an inner loop, an account loop, and an outer loop, wherein the inner loop addresses individual feedback by the user, wherein the account loop addresses action at an account-level with respect to the user, and wherein the outer loop addresses systematic and business/industry level issues.

9. The computer-implemented method of claim 1 , wherein the posted feedback is in an audio format.

10. The computer-implemented method of claim 1 , wherein the posted feedback is in a textual format.

11. The computer-implemented method of claim 1 further comprising classifying the audio feedback based on the emotional context data.

12. A computer-implemented method comprising:

receiving audio feedback related to a feedback target from a customer during interaction with a virtual assistant platform, wherein the audio feedback is received at a speech to text engine;

generating a metadata from prosodic and acoustic features of the audio feedback, wherein the metadata is device generated metadata;

classifying a polarity associated with the audio feedback via a sentiment analysis engine;

determining an emotion context data associated with the audio feedback using machine learning and artificial intelligence algorithms, wherein the determining is based on the metadata and further based on processing the audio feedback in textual form using at least one of a natural language processing, text analysis, and computational linguistics, and wherein the determining is further based on the classifying;

determining a business entity associated with the feedback target, wherein the determining the business entity is based on processing the audio feedback in textual form and is further based on receiving a geolocational data via an application programming interface (API) running on a user device;

determining a user profile associated with the customer;

providing the received audio feedback, the determined emotion context data, and the user profile to the business entity;

enabling the business entity to directly engage the customer contemporaneously with the audio feedback submission by the customer via a communication channel;

generating a Unit in response to receipt of the audio feedback, wherein the Unit represents an interaction between a representative associated with the business entity and the customer; and

generating a report based on the Unit.

13. The computer-implemented method of claim 12 , wherein the received audio feedback and the user profile are provided to the business entity contemporaneously with receipt of the audio feedback.

14. The computer-implemented method of claim 12 , wherein an application programming interface running on a device associated with the customer provides the geolocational data.

15. The computer-implemented method of claim 12 , wherein determining the business location comprises:

obtaining the business location from textual analysis of the audio feedback in text form.

16. The computer-implemented method of claim 12 , wherein the Unit comprises a name, an identifier, address where the Unit is located, Unit data fields, and Unit groups.

17. The computer-implemented method of claim 12 , wherein the method further comprises:

posting the received audio feedback in a location-specific response feed associated with the business entity if the business entity has an account with a feedback service and the business location is identified;

posting the received audio feedback to a generic response feed associated with the business entity if the business entity has an account with the host service and the business location is unidentified; and

posting the received audio feedback to a website if the business entity does not have an account with the host service; and

tagging the posting with business related identifying information including the business name or the business location.

18. The computer-implemented method of claim 17 , wherein the method further includes associating the received audio feedback with a Unit in a database if the business entity has an account with a feedback service and the business location is identified, wherein the Unit represents an interaction between a representative associated with a client account and the customer.

19. The computer-implemented method of claim 12 further comprising classifying the audio feedback based on the emotional context data.

20. A computer-implemented method comprising:

initiating a voice recognition platform that solicits feedback related to a service or product provided by a feedback target;

soliciting feedback from a customer by causing the voice recognition platform to render a series of audio questions for the customer that include a business name or a business location, and wherein the soliciting further includes receiving a geolocational data from a user device;

in response to receiving voice identification of the business name or the business location from the customer, rendering a list of potential businesses corresponding to the business name or the business location on a display;

in response to receiving a user selection of a feedback target from the list of potential businesses, rendering a page comprising a plurality of selectable elements, including a feedback element on the display;

in response to receiving a user selection of the feedback element, outputting an audio for prompting the user to provide feedback for the feedback target;

receiving voice feedback of the feedback target;

generating a metadata from prosodic and acoustic features of the voice feedback, wherein the metadata is device generated metadata;

determining an emotion context data associated with the voice feedback using machine learning and artificial intelligence algorithms, wherein the determining is based on the metadata and further based on processing the voice feedback using at least one of a natural language processing, text analysis, and computational linguistics;

generating a Unit in response to receipt of the voice feedback, wherein the Unit represents an interaction between a representative associated with the feedback target and the customer; and

generating a report based on the Unit.

21. The computer-implemented method of claim 20 , further comprising:

providing the voice feedback of the feedback target to a feedback service operative to route the voice feedback to the business identified in the business name.

22. The computer-implemented method of claim 20 , further comprising:

interacting with the feedback target after the business identified in the business name initiates a close the feedback action.

23. The computer-implemented method of claim 20 further comprising processing the voice feedback to derive emotional context data associated with the voice feedback.

24. The computer-implemented method of claim 23 further comprising classifying the voice feedback based on the emotional context data.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Apr 13, 2022
From: WELLS FARGO BANK NA
To: MEDALLION, INC
Reel/Frame 059581/0865 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE LIST OF PATENT PROPERTY NUMBER TO INCLUDE TWO PATENTS THAT WERE MISSING FROM THE ORIGINAL FILING PREVIOUSLY RECORDED AT REEL: 057968 FRAME: 0430. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 1, 2021
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
To: MEDALLIA, INC.
Reel/Frame 057982/0092 →
SECURITY INTEREST Recorded Oct 29, 2021
From: MEDALLIA, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 057964/0016 →
RELEASE OF SECURITY INTEREST Recorded Oct 29, 2021
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
To: MEDALLIA, INC.
Reel/Frame 057968/0430 →
SECURITY INTEREST Recorded Jul 28, 2021
From: MEDALLIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 057011/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2021
From: STRETCH, LESLIE; MANTRIPRAGADA, KRISH; SMITH, RIC; SADAT, ALI
To: MEDALLIA, INC.
Reel/Frame 055611/0953 →
Continuity (2)
Provisional Application 62888918 · Aug 19, 2019
Related Publication 20210056600A1 · Feb 25, 2021