IP Library › Granted Patent US 10,515,121
Granted Patent B1
US 10,515,121 · App. 15/486,265 · Granted Dec 24, 2019

Systems and methods of using natural language processing for visual analysis of a data set

Inventors: Vidya R. Setlur (Portola Valley, CA); Sarah E. Battersby (Seattle, WA); Melanie K. Tory (Palo Alto, CA); Richard C. Gossweiler, III (Sunnyvale, CA); Angel Xuan Chang (Stanford, CA); Isaac J. Dykeman (Bethesda, MD); Md Enamul Hoque Prince (Vancouver, CA)
Assignee: Tableau Software, Inc.
G06F16/90332G06F17/271G10L15/1815G06F17/274G06F17/2785
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,515,121
App. No.
15/486,265
Filed
Apr 12, 2017
Granted
Dec 24, 2019
Kind
B1
Art Unit
2659
USPC
704/257
Abstract

A method of using natural language processing for visual analysis of a data set includes displaying a data visualization based on a dataset retrieved from a database using a set of one or more queries and receiving a user input to specify a natural language command related to the displayed data visualization. The method further includes, based on the displayed data visualization, extracting one or more independent analytic phrases from the natural language command. The method further includes requerying the database using an updated set of one or more queries based on the extracted analytic phrases, thereby retrieving an updated dataset and displaying an updated data visualization using the updated dataset.

Claims (40)

1. A method of using natural language for visual analysis of a dataset, comprising:

at computer having a display, one or more processors, and memory storing one or more programs configured for execution by the one or more processors:

displaying a data visualization based on a dataset retrieved from a database using a set of one or more queries, wherein the data visualization is selected from the group consisting of a map, a line chart, a bar chart, and a scatter plot;

receiving a first user input to specify a natural language command related to the displayed data visualization;

based on the displayed data visualization, extracting a first analytic phrase from the natural language command, the first analytic phrase including range of values for a first data field in the dataset;

displaying an editable user interface control corresponding to the first data field, wherein the user interface control displays the initial range of values;

receiving a second user input at the user interface control, the second user input specifying a modified range of values for the first data field;

requerying the database using an updated set of one or more queries based on the modified range of values, thereby retrieving an updated dataset; and

updating the displayed data visualization using the updated dataset.

2. The method of claim 1 , wherein the first user input is received as text input from a user in a data-entry region on the display in proximity to the displayed data visualization.

3. The method of claim 1 , wherein the first user input is received as a voice command using a microphone coupled to the electronic device.

4. The method of claim 1 , wherein the first analytic phrase is a filter command.

5. The method of claim 1 , further comprising iterating the steps of receiving, extracting, displaying, receiving, requerying, and updating a plurality of times.

6. The method of claim 1 , wherein the natural language command is a question.

7. A computing device, comprising:

one or more processors;

memory;

a display; and

one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs comprising instructions for:

displaying a data visualization based on a dataset retrieved from a database using a set of one or more queries, wherein the data visualization is selected from the group consisting of a map, a line chart, a bar chart, and a scatter plot;

receiving a first user input to specify a natural language command related to the displayed data visualization;

based on the displayed data visualization, extracting a first analytic phrase from the natural language command, the first analytic phrase including an initial range of values for a first data field in the dataset;

displaying an editable user interface control corresponding to the first data field, wherein the user interface control displays the initial range of values;

receiving a second user input at the user interface control, the second user input specifying a modified range of values for the first data field;

requerying the database using an updated set of one or more queries based on the modified range of values, thereby retrieving an updated dataset; and

updating the displayed data visualization using the updated dataset.

8. The computing device of claim 7 , wherein the first user input is received as text input from a user in a data-entry region on the display in proximity to the displayed data visualization.

9. The computing device of claim 7 , wherein the first user input is received as a voice command using a microphone coupled to the electronic device.

10. The computing device of claim 7 , wherein the first analytic phrase is a filter command.

11. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computing device having one or more processors, memory, and a display, the one or more programs comprising instructions for:

displaying a data visualization based on a dataset retrieved from a database using a set of one or more queries, wherein the data visualization is selected from the group consisting of a map, a line chart, a bar chart, and a scatter plot;

receiving a first user input to specify a natural language command related to the displayed data visualization;

based on the displayed data visualization, extracting a first analytic phrase from the natural language command, the first analytic phrase including an initial range of values for a first data field in the dataset;

displaying an editable user interface control corresponding to the first data field, wherein the user interface control displays the initial range of values;

receiving a second user input at the user interface control the second user input specifying a modified range of values for the first data field;

requerying the database using an updated set of one or more queries based on the modified range of values, thereby retrieving an updated dataset; and

updating the displayed data visualization using the updated dataset.

12. The non-transitory computer readable storage medium of claim 11 , wherein the first user input is received as text input from a user in a data-entry region on the display in proximity to the displayed data visualization.

13. The non-transitory computer readable storage medium of claim 11 , wherein the first user input is received as a voice command using a microphone coupled to the electronic device.

14. The non-transitory computer readable storage medium of claim 11 , wherein the first analytic phrase is a filter command.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2017
From: SETLUR, VIDYA RAGHAVAN; BATTERSBY, SARAH E.; TORY, MELANIE KARLA; GOSSWEILER, RICHARD CARL, III; CHANG, ANGEL XUAN; DYKEMAN, ISAAC JAMES; HOQUE PRINCE, MD ENAMUL
To: TABLEAU SOFTWARE INC.
Reel/Frame 042810/0364 →
Continuity (2)
Provisional Application 62321695 · Apr 12, 2016
Provisional Application 62418052 · Nov 4, 2016
Cited By (19)
US 12,189,663 US 12,217,000 US 12,235,865 US 12,287,954 US 12,335,215 US 12,367,222 US 12,379,831 US 12,379,908 US 12,462,107 US 12,488,052 US 12,498,915 US 12,499,318 US 12,524,217 US 12,524,461 US 12,536,382 US 12,717,766 US 12,717,811 US 12,737,158 US 12,743,273