IP Library Granted Patent US 10,114,814
Granted Patent B1
US 10,114,814 · App. 15/277,892 · Granted Oct 30, 2018

System and method for actionizing patient comments

Inventors: Kyle Robertson (Austin, TX); Taylor Turpen (Austin, TX)
Assignee: NARRATIVEDX, INC.
G06F17/2785G06F17/241G06F17/245G06F17/2705G06F17/278G06F17/30778G06Q50/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,114,814
App. No.
15/277,892
Granted
Oct 30, 2018
Kind
B1
Abstract

A system and method for processing and actionizing structured and unstructured patient experience data is disclosed herein. In some embodiments, a system may include a natural language processing (NLP) engine configured to transform a data set into a plurality of concepts within a plurality of distinct contexts, and a data mining engine configured to process the relationships of the concepts and to identify associations and correlations in the data set. In some embodiments, the method may include the steps of receiving a data set, scanning the data set with an NLP engine to identify a plurality of concepts within a plurality of distinct contexts, and identifying patterns in the relationships between the plurality of concepts.

Claims (42)

1. A system for processing and actionizing patient experience data, the system comprising:

a server comprising a natural language processing (NLP) engine; and

a relational database;

wherein a plurality of communications is received at the server, each of the plurality of communications comprises comment data collected from publicly available data of an Internet web site or from one or more surveys, wherein the comment data comprises structured or unstructured patient experience data;

wherein the comment data from each of the plurality of communications is transformed to structured patient experience data and stored at the relational database in a response table that includes one or more records, wherein each record corresponds to the comment data from a communication, and wherein each record comprises the corresponding comment data and a timestamp;

wherein the comment data from each of the plurality of communications is parsed for individual phrases to generate a plurality of phrases;

wherein one or more phrases are selected from the plurality of phrases based on a predetermined parameter;

wherein the NLP engine is to predict one or more annotations for the one or more phrases based upon a score, wherein to predict the one or more annotations for the one or more phrases based upon the score comprises to (i) predict one or more annotations for the one or more phrases based upon a machine learning score, wherein the one or more annotations comprise a sentiment, a theme, or any named entity of the one or more phrases, (ii) determine whether the machine learning score is less than a predetermined threshold score, and (iii) predict the one or more annotations for the one or more phrases based upon a reference score in response to a determination that the machine learning score is less than the predetermined threshold score;

wherein the one or more annotations are stored at the relational database in an annotation table that includes one or more records in response to prediction of the one or more annotations, wherein each record corresponds to an annotation, and wherein each record includes the sentiment, the named entity, a primary tag indicative of a subject matter, or a secondary tag indicative of the theme; and

wherein the server is to generate a dashboard web page for a user that includes the one or more annotations in response to prediction of the one or more annotations.

2. The system according to claim 1 wherein the NLP engine predicts the sentiment of the phrase, wherein the sentiment comprises if the phrase is positive, negative or neutral.

3. The system according to claim 1 the NLP engine tags each phrase with a primary tag based on a subject matter of the phrase.

4. The system according to claim 1 further comprising an API for providing business intelligence for the user to act upon the inputted patient experience data.

5. The system according to claim 1 wherein the comment data of each of the plurality of communications is extracted at server, wherein the extracted comment data are transformed to a format compatible with a target, and wherein the transformed comment data are loaded into the response table of the relational database.

6. The system according to claim 1 wherein the comment data from each of the plurality of communications is parsed for individual phrases based upon punctuation or linguistic structure.

7. The system according to claim 1 wherein the plurality of communications is collected from publicly available data and uploaded from a hospital entity.

8. The system according to claim 1 wherein the server is configured to (i) determine whether a phrase is associated with a complete record in the annotations table, wherein the complete record comprises a sentiment, a primary tag, and a secondary tag, and (ii) generate an improvement action as a function of the phrase's annotation in response to a determination that the phrase is associated with a complete record.

9. The system of claim 1 , wherein to predict the one or more annotations for the one or more phrases based upon a reference score comprises to (i) store the one or more annotations at the relational database in a batching table that includes one or more records, wherein each record corresponds to an annotation, and wherein each record includes the sentiment, the named entity, the primary tag, the secondary tag, and an approval; and (ii) receive the approval in response to storing the one or more annotations at the relational database in the batching table.

10. The system of claim 1 , wherein the NLP engine is to predict the sentiment, the theme, and any named entity of the one or more phrases based upon the machine learning score in parallel.

11. A method according for processing and actionizing patient experience data, the method comprising:

receiving at a server a plurality of communications, each of the plurality of communications comprises comment data collected from publicly available data of an Internet web site or from one or more surveys, wherein the comment data comprises structured or unstructured patient experience data;

transforming the comment data of each of the plurality of communications to structured patient experience data;

storing the comment data of each of the plurality of communications at a relational database in a response table that includes one or more records, wherein each record corresponds to the comment data from a communication, and wherein each record comprises the corresponding comment data and a timestamp;

parsing the comment data for individual phrases to generate a plurality of phrases;

selecting one or more phrases from the plurality of phrases based on a predetermined parameter;

predicting at a NLP engine one or more annotations for the one or more phrases based upon a machine learning score wherein the one or more annotations comprise a sentiment, a theme, or any named entity of the one or more phrases;

determining whether the machine learning score is less than a predetermined threshold score;

predicting the one or more annotations for the one or more phrases based upon a reference score in response to determining that the machine learning score is less than the predetermined threshold score;

storing the one or more annotations at the relational database in an annotation table that includes one or more records in response to predicting the one or more annotations, wherein each record corresponds to an annotation, and wherein each record includes the sentiment, the named entity, a primary tag indicative of a subject matter, or a secondary tag indicative of the theme; and

generating at the server a dashboard web page for a user that includes the one or more annotations in response to predicting the one or more annotations.

12. The method according to claim 11 further comprising: extracting the comment data of each of the plurality of communications at the server;

transforming the comment data to a format compatible with a target; and

loading the transformed comment data into the response table of the relational database.

13. The method according to claim 11 further comprising tagging at the NLP engine each phrase with a primary tag based on a subject matter of the phrase.

14. The method according to claim 11 further comprising an API for providing business intelligence for the user to act upon the inputted patient experience data.

15. The method according to claim 11 wherein the comment data of each of the plurality of communications is extracted at server, wherein the extracted comment data are transformed to a format compatible with a target, and wherein the transformed comment data are loaded into the response table of the relational database.

16. The method according to claim 11 wherein the comment data from each of the plurality of communications is parsed for individual phrases based upon punctuation or linguistic structure.

17. The method according to claim 11 further comprising:

determining whether a phrase is associated with a complete record in the annotations table, wherein the complete record comprises a sentiment, a primary tag, and a secondary tag; and

generating an improvement action as a function of the phrase's annotation in response to determining that the phrase is associated with a complete record, and wherein if a named entity is detected in the phrase the improvement action is specific for the named entity.

18. The method according to claim 11 wherein predicting the sentiment of the phrase comprises predicting if the phrase is positive, negative or neutral.

19. The method of claim 11 , wherein predicting the one or more annotations for the one or more phrases based upon the reference score comprises predicting the one or more annotations based upon a manual review score.

Assignments (6)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 67275, FRAME 0559 Recorded May 18, 2026
From: BARCLAYS BANK PLC, AS COLLATERAL AGENT
To: PRESS GANEY ASSOCIATES LLC; RIOSOFT HOLDINGS, INC.
Reel/Frame 075583/0412 →
SECURITY INTEREST Recorded May 18, 2026
From: QUALTRICS, LLC; PRESS GANEY ASSOCIATES LLC; CLARABRIDGE, INC.; DELIGHTED, LLC; RIOSOFT HOLDINGS, INC.; INMOMENT, INC.; LEXALYTICS, INC.; INMOMENT RESEARCH, LLC; ALLEGIANCE SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075583/0001 →
PATENT SECURITY AGREEMENT Recorded Apr 30, 2024
From: PRESS GANEY ASSOCIATES LLC; RIOSOFT HOLDINGS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 067275/0559 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2021
From: NARRATIVEDX, INC.
To: PRESS GANEY ASSOCIATES, LLC
Reel/Frame 054895/0892 →
MERGER Recorded Mar 18, 2020
From: PG PADRES, INC.
To: NARRATIVEDX, INC.
Reel/Frame 052157/0106 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2016
From: ROBERTSON, KYLE; TURPEN, TAYLOR
To: NARRATIVEDX, INC.
Reel/Frame 039871/0016 →
Continuity (1)
Provisional Application 62233657 · Sep 28, 2015