IP Library Granted Patent US 11,954,700
Granted Patent B2
US 11,954,700 · App. 17/819,854 · Granted Apr 9, 2024

Digital survey creation by providing optimized suggested content

Inventors: John Thimsen (Seattle, WA); Jeffrey Wade Starr (Orem, UT)
Assignee: Qualtrics, LLC
G06Q30/0203G06F16/9024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,954,700
App. No.
17/819,854
Granted
Apr 9, 2024
Kind
B2
Abstract

The present disclosure relates to a question recommendation system that intelligently optimizes a survey being created by a user by providing customized suggestions. For example, in one or more embodiments, the question recommendation system provides a suggested question based on questions previous added by a user while creating a survey. In particular, the question recommendation system provides various recommendations to the user to further optimize a survey being created. For instance, the question recommendation system provides recommendations with respect to improving question ordering, question phrasing, and question type as well as recommends removing potentially inefficient questions.

Claims (59)

1. A computer-implemented method comprising:

receiving, from an administrator client device, a user-generated survey prompt;

generating an encoded survey prompt comprising a semantic label;

accessing a database of survey graphs, wherein each survey graph within the database of survey graphs represents a previously created and administered digital survey;

based on the semantic label of the encoded survey prompt, identifying from the database of survey graphs:

a first survey graph comprising a first node with a first semantic label corresponding to the semantic label of the encoded survey prompt; and

a second survey graph comprising a second node with a second semantic label corresponding to the semantic label of the encoded survey prompt;

comparing first response data associated with the first node with second response data associated with the second node;

determining, based on comparing the first response data to the second response data, to traverse the first survey graph to identify a suggested survey prompt corresponding to an additional node within the first survey graph;

providing, to the administrator client device, an option to use the suggested survey prompt; and

based on receiving an indication of an interaction with the option to use the suggested survey prompt, generating a digital survey comprising the user-generated survey prompt and the suggested survey prompt.

2. The computer-implemented method of claim 1 , wherein comparing the first response data with the second response data comprises determining that the first node in the first survey graph has a more favorable survey prompt response rate metric than the second node in the second survey graph.

3. The computer-implemented method of claim 1 , further comprising providing the suggested survey prompt for display on the administrator client device.

4. The computer-implemented method of claim 1 , further comprising:

identifying a survey prompt type and a survey prompt wording from the additional node; and

wherein providing the suggested survey prompt for display on the administrator client device comprises providing, as the suggested survey prompt, the survey prompt type and the survey prompt wording identified from the additional node.

5. The computer-implemented method of claim 4 , further comprising providing a keep selectable option and an ignore selectable option in combination with providing the suggested survey prompt.

6. The computer-implemented method of claim 5 , further comprising associating the suggested survey prompt with the user-generated survey prompt to generate an electronic survey based on receiving, from the administrator client device, an indication of a selection of the keep selectable option.

7. The computer-implemented method of claim 5 , further comprising providing an additional suggested survey prompt for display on the administrator client device based on receiving, from the administrator client device, an indication of a selection of the ignore selectable option.

8. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computer device to:

receive, from an administrator client device, a user-generated survey prompt;

generate an encoded survey prompt comprising a semantic label;

access a database of survey graphs, wherein each survey graph within the database of survey graphs represents a previously created and administered digital survey;

based on the semantic label of the encoded survey prompt, identify from the database of survey graphs:

a first survey graph comprising a first node with a first semantic label corresponding to the semantic label of the encoded survey prompt; and

a second survey graph comprising a second node with a second semantic label corresponding to the semantic label of the encoded survey prompt;

compare first response data associated with the first node with second response data associated with the second node;

determine, based on comparing the first response data to the second response data, to traverse the first survey graph to identify a suggested survey prompt corresponding to an additional node within the first survey graph;

based on receiving an indication of an interaction with an option to use the suggested survey prompt, generating a digital survey comprising the user-generated survey prompt and the suggested survey prompt; and

provide, to a respondent client device, the digital survey comprising the user-generated survey prompt and the suggested survey prompt.

9. The non-transitory computer-readable medium of claim 8 , wherein comparing the first response data with the second response data comprises determining that the first node in the first survey graph has a more favorable survey prompt response rate metric than the second node in the second survey graph.

10. The non-transitory computer-readable medium of claim 8 , further comprising instructions that cause the computer device to provide the suggested survey prompt for display on the administrator client device.

11. The non-transitory computer-readable medium of claim 10 , further comprising instructions that cause the computer device to:

identify a survey prompt type and a survey prompt wording from the additional node; and

wherein providing the suggested survey prompt for display on the administrator client device comprises providing, as the suggested survey prompt, the survey prompt type and the survey prompt wording identified from the additional node.

12. The non-transitory computer-readable medium of claim 10 , further comprising instructions that cause the computer device to provide a keep selectable option and an ignore selectable option in combination with providing the suggested survey prompt.

13. The non-transitory computer-readable medium of claim 12 , further comprising instructions that cause the computer device to associate the suggested survey prompt with the user-generated survey prompt to generate an electronic survey based on receiving, from the administrator client device, an indication of a selection of the keep selectable option.

14. The non-transitory computer-readable medium of claim 12 , further comprising instructions that cause the computer device to provide an additional suggested survey prompt for display on the administrator client device based on receiving, from the administrator client device, an indication of a selection of the ignore selectable option.

15. A system, comprising:

at least one processor; and

a non-transitory computer-readable storage medium comprising instructions that, when executed by the at least one processor, cause the system to:

receive, from an administrator client device, a user-generated survey prompt;

generate an encoded survey prompt comprising a semantic label;

access a database of survey graphs, wherein each survey graph within the database of survey graphs represents a previously created and administered digital survey:

based on the semantic label of the encoded survey prompt, identify from the database of survey graphs:

a first survey graph comprising a first node with a first semantic label corresponding to the semantic label of the encoded survey prompt; and

a second survey graph comprising a second node with a second semantic label corresponding to the semantic label of the encoded survey prompt;

compare first response data associated with the first node with second response data associated with the second node;

determine, based on comparing the first response data to the second response data, to traverse the first survey graph to identify a suggested survey prompt corresponding to an additional node within the first survey graph;

provide to the administrator client device, an option to use the suggested survey prompt;

based on receiving an indication of an interaction with the option to use the suggested survey prompt, generate a digital survey comprising the user-generated survey prompt and the suggested survey prompt; and

provide, to a respondent client device, the digital survey comprising the user-generated survey prompt and the suggested survey prompt.

16. The system of claim 15 , wherein comparing the first response data with the second response data comprises determining that the first node in the first survey graph has a more favorable survey prompt response rate metric than the second node in the second survey graph.

17. The system of claim 16 , wherein the survey prompt response rate metric comprises at least one of a drop-off rate, a skip rate, or a dwell time.

18. The system of claim 15 , further comprising instructions that cause the system to provide the suggested survey prompt for display on the administrator client device.

19. The system of claim 18 , further comprising instructions that cause the system to:

identify a survey prompt type and a survey prompt wording from the additional node; and

wherein providing the suggested survey prompt for display on the administrator client device comprises providing, as the suggested survey prompt, the survey prompt type and the survey prompt wording identified from the additional node.

20. The system of claim 18 , further comprising instructions that cause the system to provide a keep selectable option and an ignore selectable option in combination with providing the suggested survey prompt.

Assignments (3)
SECURITY INTEREST Recorded May 18, 2026
From: QUALTRICS, LLC; PRESS GANEY ASSOCIATES LLC; CLARABRIDGE, INC.; DELIGHTED, LLC; RIOSOFT HOLDINGS, INC.; INMOMENT, INC.; LEXALYTICS, INC.; INMOMENT RESEARCH, LLC; ALLEGIANCE SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075583/0001 →
SECURITY INTEREST Recorded Jun 29, 2023
From: QUALTRICS, LLC; CLARABRIDGE, INC.; NEW DEBDEN MERGER SUB II LLC
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064162/0976 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: THIMSEN, JOHN; STARR, JEFFREY WADE
To: QUALTRICS, LLC
Reel/Frame 060811/0194 →
Continuity (2)
Continuation 16256778 · Jan 24, 2019
Related Publication 20220391931A1 · Dec 8, 2022