IP Library Granted Patent US 11,086,920
Granted Patent B2
US 11,086,920 · App. 15/977,952 · Granted Aug 10, 2021

System and method for automatically generating concepts related to a target concept

Inventors: Michael A. Yen (Oakland, CA); Iain M. Harlow (Pleasant Hill, CA); Andrew Smith Lewis (Palo Alto, CA); Paul T. Mumma (Albany, CA)
Assignee: CEREGO, LLC.
G06F16/367G06F40/30G09B7/04G09B7/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,086,920
App. No.
15/977,952
Granted
Aug 10, 2021
Kind
B2
Abstract

A method for generating a set of concepts related to a target concept includes accessing a set of candidate concepts, embedding the target concept and the set of candidate concepts in a semantic vector space, selecting one or more intermediate concepts from the set of candidate concepts in response to determining whether each embedded candidate concept in the set of embedded candidate concepts satisfies a predetermined relationship with the embedded target concept, and filtering the one or more intermediate concepts to yield the set of concepts related to the target concept. The method may further include generating a multiple-choice question in which the target concept corresponds to a correct answer choice and the set of concepts related to the target concept correspond to distractors.

Claims (26)

1. A method for generating a set of concepts related to a target concept, comprising: accessing a set of candidate concepts; embedding the target concept and the set of candidate concepts in a semantic vector space; selecting one or more intermediate concepts from the set of candidate concepts in response to determining whether each embedded candidate concept in the set of embedded candidate concepts satisfies a predetermined relationship with the embedded target concept; and filtering the one or more intermediate concepts to yield the set of concepts related to the target concept; wherein

the determining whether each embedded candidate concept in the set of embedded candidate concepts satisfies the predetermined relationship includes determining whether a displacement vector between each embedded candidate concept and the embedded target concept is within a predetermined range of distances and a predetermined range of directions;

the predetermined range of distances and the predetermined range of directions are determined based on user information that identifies capabilities of a user that receives the set of concepts related to the target concept; and

the user information is based on a history of user interactions with one or more previously generated sets of concepts.

2. The method of claim 1 , further comprising generating a multiple-choice question in which the target concept corresponds to a correct answer choice and the set of concepts related to the target concept correspond to distractors.

3. The method of claim 1 , further comprising generating a lesson plan in which the target concept corresponds to a main topic of the lesson plan and the set of concepts related to the target concept correspond to subtopics of the lesson plan.

4. The method of claim 1 , wherein at the predetermined range of distances and the predetermined range of directions are determined based on relationship information that identifies a desired relationship between the target concept and the set of concepts related to the target concept.

5. The method of claim 1 , wherein the one or more intermediate concepts are selected using a neural network model that predicts whether each candidate concept in the set of candidate concepts satisfies the predetermined relationship based on the embedded target concept and the set of embedded candidate concepts.

6. The method of claim 1 , further comprising selecting, based on a subject domain of the target concept, a domain-specific concept library among a plurality of domain-specific concept libraries, the domain-specific concept library providing the set of candidate concepts.

7. The method of claim 1 , further comprising selecting, based on a subject domain of the target concept, a domain-specific embedding model among a plurality of domain-specific embedding models, the domain-specific embedding model being used to embed the target concept and the set of candidate concepts in the semantic vector space.

8. The method of claim 1 , wherein the one or more intermediate concepts are filtered based on non-semantic features of the one or more intermediate concepts.

9. The method of claim 1 , further comprising providing the set of concepts related to the target concept to a user to curate the set of concepts.

10. A learning system comprising: a non-transitory memory; and one or more hardware processors coupled to the non-transitory memory and configured to execute instructions to cause the learning system to perform operations comprising: receiving a target concept; accessing a set of candidate concepts; embedding the target concept and the set of candidate concepts in a semantic vector space; selecting one or more intermediate concepts from the set of candidate concepts in response to determining whether each embedded candidate concept in the set of embedded candidate concepts satisfies a predetermined relationship with the embedded target concept; and filtering the one or more intermediate concepts to yield a set of related concepts that are related to the target concept; wherein

the determining whether each embedded candidate concept in the set of embedded candidate concepts satisfies the predetermined relationship includes determining whether a displacement vector between each embedded candidate concept and the embedded target concept is within a predetermined range of distances and a predetermined range of directions;

the predetermined range of distances and the predetermined range of directions are determined based on user information that identifies capabilities of a user that receives the set of concepts related to the target concept; and

the user information is based on a history of user interactions with one or more previously generated sets of concepts.

11. The learning system of claim 10 , wherein the operations further comprise generating a multiple-choice question in which the target concept corresponds to a correct answer choice and the set of related concepts correspond to distractors.

12. The learning system of claim 10 , wherein the operations further comprise generating a lesson plan in which the target concept corresponds to a main topic of the lesson plan and the set of related concepts correspond to subtopics of the lesson plan.

13. The learning system of claim 10 , wherein the one or more intermediate concepts are selected using a neural network model that predicts whether each candidate concept in the set of candidate concepts satisfies the predetermined relationship based on the embedded target concept and the set of embedded candidate concepts.

14. The learning system of claim 10 , wherein the predetermined relationship is determined based on one or more of relationship information that identifies a desired relationship between the target concept and the set of related concepts and the user information that identifies capabilities of thea user that receives the set of related concepts.

15. A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a learning system to perform operations comprising: identifying a target concept corresponding to a correct answer to a multiple-choice question; accessing a set of candidate concepts; embedding the target concept and the set of candidate concepts in a semantic vector space; selecting one or more intermediate concepts from the set of candidate concepts, the one or more intermediate concepts corresponding to one or more of the set of embedded candidate concepts that are usable as distractors for the multiple-choice question; filtering the one or more intermediate concepts to yield a set of distractors for the multiple-choice question; and providing the multiple-choice question with the set of distractors to a user of the learning system; wherein

the selecting of the one or more intermediate concepts from the set of candidate concepts includes determining whether a displacement vector between each embedded candidate concept and the embedded target concept is within a predetermined range of distances and a predetermined range of directions;

the predetermined range of distances and the predetermined range of directions are determined based on user information that identifies capabilities of a user that receives the set of concepts related to the target concept; and

the user information is based on a history of user interactions with one or more previously generated sets of concepts.

16. The non-transitory machine-readable medium of claim 15 , wherein the one or more intermediate concepts are filtered based on at least one of a part of speech of the target concept, a number of words of the target concept, or a capitalization of the target concept.

17. The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise: receiving a user response to the multiple-choice question; and generating one or more second sets of distractors for one or more second multiple choice questions, the one or more second sets of distractors being customized to the user based on the user response.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2024
From: CEREGO JAPAN KABUSHIKI KAISHA
To: YOUNG, ERIC WALLACE
Reel/Frame 066780/0366 →
LIEN Recorded Nov 17, 2023
From: CEREGO JAPAN KABUSHIKI KAISHA
To: PAUL HENRY, C/O ARI LAW, P.C.
Reel/Frame 065625/0800 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2021
From: CEREGO, LLC.
To: CEREGO JAPAN KABUSHIKI KAISHA
Reel/Frame 057064/0455 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2018
From: YEN, MICHAEL A.; HARLOW, IAIN M.; SMITH LEWIS, ANDREW; MUMMA, PAUL T.
To: CEREGO, LLC.
Reel/Frame 045786/0051 →
Continuity (2)
Provisional Application 62523364 · Jun 22, 2017
Related Publication 20180373791A1 · Dec 27, 2018