IP Library Granted Patent US 11,263,240
Granted Patent B2
US 11,263,240 · App. 16/426,806 · Granted Mar 1, 2022

Organizing survey text responses

Inventors: Jeffrey Wade Starr (Orem, UT); Robert David Norton (Provo, UT)
Assignee: Qualtrics, LLC
G06F16/285G06F16/353G06F16/93G06F16/955
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,263,240
App. No.
16/426,806
Granted
Mar 1, 2022
Kind
B2
Abstract

Embodiments of the present disclosure relate generally to organizing electronic text documents. In particular, one or more embodiments comprise a content management system that improves the organization of electronic text documents by intelligently and accurately categorizing electronic text documents by topic. The content management system organizes electronic text documents based on one or more topics, without the need for a human reviewer to manually classify each electronic text document, and without the need for training a classification algorithm based on a set of manually classified electronic text documents. Further, the content management system identifies and suggests topics for electronic text documents that relate to new or emerging topics.

Claims (52)

1. A method comprising:

assigning, by at least one processor, a plurality of content items to one or more predetermined topics;

identifying a group of unassigned content items that are not assigned to the one or more predetermined topics;

providing, to a client device associated with a user, a first unassigned content item from the group of unassigned content items;

receiving, from the client device associated with the user, a user-generated topic corresponding to the first unassigned content item from the group of unassigned content items, wherein the user-generated topic is a different topic from the one or more predetermined topics;

assigning, by the at least one processor and without user input, a second content item from the plurality of content items to the user-generated topic by analyzing the plurality of content items to determine that the second content item correlates to the user-generated topic; and

providing, the client device associated with the user, topic assignment results organized by the one or more predetermined topics and the user-generated topic.

2. The method of claim 1 , further comprising assigning a third content item from the group of unassigned content items to the user-generated topic.

3. The method of claim 1 , further comprising providing, to the client device associated with the user, a suggested topic.

4. The method of claim 3 , wherein the suggested topic is based on at least one of:

an analysis of the group of unassigned content items that are not assigned to the one or more predetermined topics; or

an analysis of the plurality of content items assigned to the one or more predetermined topics.

5. The method of claim 3 , further comprising:

receiving, from the client device associated with the user, a selection of the suggested topic; and

assigning a third content item to the suggested topic, wherein the third content item is from either the group of unassigned content items or the plurality of content items assigned to the one or more predetermined topics.

6. The method of claim 5 , further comprising providing, to the client device associated with the user, updated topic assignment results organized by the one or more predetermined topics, the user-generated topic, and the suggested topic.

7. The method of claim 1 , wherein each content item of the plurality of content items comprises text corresponding to a survey response to an electronic survey question.

8. A system comprising:

at least one processor; and

at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:

assign a plurality of content items to one or more predetermined topics;

identify a group of unassigned content items that are not assigned to the one or more predetermined topics;

provide, to a client device associated with a user, a first unassigned content item from the group of unassigned content items;

receive, from the client device associated with the user, a user-generated topic corresponding to the first unassigned content item from the group of unassigned content items, wherein the user-generated topic is a different topic from the one or more predetermined topics;

assign, without user input, a second content item from the plurality of content items to the user-generated topic by analyzing the plurality of content items to determine that the second content item correlates to the user-generated topic; and

provide, the client device associated with the user, topic assignment results organized by the one or more predetermined topics and the user-generated topic.

9. The system of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the system to assign a third content item from the group of unassigned content items to the user-generated topic.

10. The system of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the system to provide, to the client device associated with the user, a suggested topic.

11. The system of claim 10 , wherein the suggested topic is based on at least one of:

an analysis of the group of unassigned content items that are not assigned to the one or more predetermined topics; or

an analysis of the plurality of content items assigned to the one or more predetermined topics.

12. The system of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the system to:

receive, from the client device associated with the user, a selection of the suggested topic; and

assign a third content item to the suggested topic, wherein the third content item is from either the group of unassigned content items or the plurality of content items assigned to the one or more predetermined topics.

13. The system of claim 12 , further comprising instructions that, when executed by the at least one processor, cause the system to provide, to the client device associated with the user, updated topic assignment results organized by the one or more predetermined topics, the user-generated topic, and the suggested topic.

14. The system of claim 8 , wherein each content item of the plurality of content items comprises text corresponding to a survey response to an electronic survey question.

15. A non-transitory computer readable storage medium storing instructions that, when executed by at least one processor, cause a computer device to:

assign a plurality of content items to one or more predetermined topics;

identify a group of unassigned content items that are not assigned to the one or more predetermined topics;

provide, to a client device associated with a user, a first unassigned content item from the group of unassigned content items;

receive, from the client device associated with the user, a user-generated topic corresponding to the first unassigned content item from the group of unassigned content items, wherein the user-generated topic is a different topic from the one or more predetermined topics;

assign, without user input, a second content item from the plurality of content items to the user-generated topic by analyzing the plurality of content items to determine that the second content item correlates to the user-generated topic; and

provide, the client device associated with the user, topic assignment results organized by the one or more predetermined topics and the user-generated topic.

16. The non-transitory computer readable storage medium of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the computer device to assign a third content item from the group of unassigned content items to the user-generated topic.

17. The non-transitory computer readable storage medium of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the computer device to provide, to the client device associated with the user, a suggested topic.

18. The non-transitory computer readable storage medium of claim 17 , wherein the suggested topic is based on at least one of:

an analysis of the group of unassigned content items that are not assigned to the one or more predetermined topics; or

an analysis of the plurality of content items assigned to the one or more predetermined topics.

19. The non-transitory computer readable storage medium of claim 18 , further comprising instructions that, when executed by the at least one processor, cause the computer device to:

receive, from the client device associated with the user, a selection of the suggested topic; and

assign a third content item to the suggested topic, wherein the third content item is from either the group of unassigned content items or the plurality of content items assigned to the one or more predetermined topics.

20. The non-transitory computer readable storage medium of claim 19 , further comprising instructions that, when executed by the at least one processor, cause the computer device to provide, to the client device associated with the user, updated topic assignment results organized by the one or more predetermined topics, the user-generated topic, and the suggested topic.

Assignments (3)
SECURITY INTEREST Recorded May 18, 2026
From: QUALTRICS, LLC; PRESS GANEY ASSOCIATES LLC; CLARABRIDGE, INC.; DELIGHTED, LLC; RIOSOFT HOLDINGS, INC.; INMOMENT, INC.; LEXALYTICS, INC.; INMOMENT RESEARCH, LLC; ALLEGIANCE SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075583/0001 →
SECURITY INTEREST Recorded Jun 29, 2023
From: QUALTRICS, LLC; CLARABRIDGE, INC.; NEW DEBDEN MERGER SUB II LLC
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064162/0976 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2019
From: STARR, JEFFREY WADE; NORTON, ROBERT DAVID
To: QUALTRICS, LLC
Reel/Frame 049323/0272 →
Continuity (2)
Continuation 14927256 · Oct 29, 2015
Related Publication 20190278788A1 · Sep 12, 2019