IP Library › Granted Patent US 12,346,318
Granted Patent B2
US 12,346,318 · App. 18/593,760 · Granted Jul 1, 2025

System and method for automatically generating question and query pairs

Inventor: James Kaplan (Marina Del Rey, CA)
Assignee: MEETKAI, INC.
G06F16/2433
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,346,318
App. No.
18/593,760
Granted
Jul 1, 2025
Kind
B2
Abstract

Disclosed is a method and system for automatically generating question and query pair from a knowledge base that involves accessing a knowledge base to extract one or more entities and one or more predicates, generating a baseline question template from a context free grammar rule, inputting the one or more entities and the one or more predicates into the baseline question template to generate a numbered question template, generating a typed question template by traversing the numbered question template through a predicate type-graph, generating a SPARQL query by inputting the one or more entities and the one or more predicates into a SPARQL query template, generating a question by inputting the one or more entities and the one or more predicates into the typed question template, and constructing a question and query pair by combining the question and the SPARQL query.

Claims (41)

1. A method for automatically generating question and query pair from a knowledge base comprising the steps of:

accessing a knowledge base;

extracting, via processing module stored in a memory and executed by a processor, one or more entities and one or more predicates from said knowledge base;

generating, via a baseline template generator module, a baseline question template from a context free grammar rule;

inputting the one or more entities and the one or more predicates into the baseline question template to determine a numbering of the one or more predicates;

generating a numbered question template based on the numbering;

generating a typed question template by traversing the numbered question template through a predicate type-graph;

generating a protocol and RDF query language (SPARQL) query by inputting the one or more entities and the one or more predicates into a SPARQL query template;

generating a question by inputting the one or more entities and the one or more predicates into the typed question template;

constructing a question and query pair by combining the question and the SPARQL query; and

storing the question and query pair in the memory for future access.

2. The method of claim 1 wherein the knowledge base is an open knowledge base.

3. The method of claim 2 wherein the open knowledge base is WikiData.

4. The method of claim 1 wherein the SPARQL query comprises one or more of the following types: single-entity, multi-entity, count, two intention, ranking, and filtering.

5. The method of claim 1 wherein the predicate-type graph comprises at least two predicates connected by an edge.

6. The method of claim 5 wherein the edge may be uni-directional or bi-directional.

7. The method of claim 5 wherein the edge comprises of legal paths.

8. A system for automatically generating question and query pair from a knowledge base comprising:

a memory, a processor, and non-transitory machine readable code stored in the memory and executed by the processor, the non-transitory machine readable code comprising:

a knowledge processing module configured to access a knowledge base and identify an entity and two predicates from the knowledge base;

a baseline template generator configured to receive input of a context free grammar rule and to generate a baseline question template based on the input of the context free grammar rule;

a numbering module configured to number the two predicates, and to generate a numbered question template based on the baseline question template and the numbering of the two predicates;

a traverse predicate module configured to traverse the numbered question template through a predicate type-graph and to generate a typed question template based on the traverse;

a protocol and RDF query language (SPARQL) query module configured to generate a SPARQL query based on input of the entity and the predicate; and

a question and query constructor module configured to generate a question based on input of the entity and the predicate to the typed question template, and to generate a question and query pair using the question and the SPARQL query to then store the question and query pair in the memory for future lookup.

9. The system of claim 8 wherein the memory is stored in, and the processor operates on, one or more of the following: a user device, a server, a cloud.

10. The system of claim 8 wherein the numbering comprises appending a nesting order to the two predicates.

11. The system of claim 10 wherein the SPARQL query module uses the same nesting order.

12. The system of claim 8 wherein the knowledge processing module configured to identify two entities, and the numbering module is further configured to number the two entities.

13. The system of claim 8 further comprising a database comprising of one or more question and query pairs.

14. A system to automatically generate questions comprising:

a memory, a processor, and non-transitory machine readable code stored in the memory and executed by the processor, the non-transitory machine readable code comprising:

a baseline template generator configured generate a baseline question template from a context free grammar rule;

a numbering module configured to input one or more entities and one or more predicates, append a nesting order to the one or more predicates, and to generate a numbered question template based on the baseline question template and the nesting order;

a traverse predicate module configured to generate a typed question template based on the traverse of the numbered question template through a predicate type-graph; and

a question constructor module configured to generate a question based the predicate to the typed question template, the one or more entities, and the one or more predicates;

wherein the generated question is stored in the memory.

15. The system of claim 14 wherein the one or more entities and the one or more predicates are identified from a knowledge base.

16. The system of claim 14 wherein the predicate type-graph comprises two nodes and one edge, the node comprising a predicate, and the edge comprising the ontological type of the predicate.

17. The system of claim 16 wherein the predicate type-graph comprises a first edge and a second edge, and wherein each node is treated as a function from the first edge to the second edge, or from the second edge to the first edge.

18. The system of claim 16 wherein the edge is directional or bi-directional.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: KAPLAN, JAMES
To: MEETKAI, INC.
Reel/Frame 067299/0040 →
Continuity (3)
Continuation 17494672 · Oct 5, 2021
Provisional Application 63087775 · Oct 5, 2020
Related Publication 20240296159A1 · Sep 5, 2024
References Cited (90)
US 8981962B2 · Fu · 2015 [cited by applicant]
US 9267518B2 · Chang · 2016 [cited by applicant]
US 9607102B2 · Lavallee et al. · 2017 [cited by applicant]
US 9654598B1 · Crawford et al. · 2017 [cited by applicant]
US 9721570B1 · Beal et al. · 2017 [cited by applicant]
US 10156775B2 · Zimmermann · 2018 [cited by applicant]
US 10402460B1 · Jesensky et al. · 2019 [cited by applicant]
US 10402589B1 · Madisetti et al. · 2019 [cited by applicant]
US 11042369B1 · Kimball · 2021 [cited by applicant]
US 20020032591A1 · Mahaffy · 2002 [cited by applicant]
US 20050124906A1 · Childre et al. · 2005 [cited by applicant]
US 20070043736A1 · Jain · 2007 [cited by applicant]
US 20100223295A1 · Stanley · 2010 [cited by examiner]
US 20110246496A1 · Hee Sung · 2011 [cited by applicant]
US 20120317108A1 · Okazaki · 2012 [cited by applicant]
US 20140244712A1 · Walters · 2014 [cited by applicant]
US 20150051502A1 · Ross · 2015 [cited by applicant]
US 20150106737A1 · Montoy-Wilson et al. · 2015 [cited by applicant]
US 20150199010A1 · Coleman et al. · 2015 [cited by applicant]
US 20150288857A1 · Fay et al. · 2015 [cited by applicant]
US 20150339590A1 · Maarek · 2015 [cited by applicant]
US 20150351655A1 · Coleman · 2015 [cited by applicant]
US 20160292358A1 · Heger · 2016 [cited by examiner]
US 20170039291A1 · Singh et al. · 2017 [cited by applicant]
US 20170046124A1 · Nostrant · 2017 [cited by applicant]
US 20170092270A1 · Newendorp et al. · 2017 [cited by applicant]
US 20170206797A1 · Solomon · 2017 [cited by applicant]
US 20170333666A1 · Goldberg et al. · 2017 [cited by applicant]
US 20170357637A1 · Nell et al. · 2017 [cited by applicant]
US 20170357910A1 · Sommer et al. · 2017 [cited by applicant]
US 20180011903A1 · Abolhassani et al. · 2018 [cited by applicant]
US 20180054228A1 · Lin · 2018 [cited by applicant]
US 20180075145A1 · Zhao et al. · 2018 [cited by applicant]
US 20180089410A1 · Caso · 2018 [cited by applicant]
US 20180096678A1 · Zhou et al. · 2018 [cited by applicant]
US 20180159889A1 · Sjouwerman · 2018 [cited by applicant]
US 20180213037A1 · Roman · 2018 [cited by applicant]
US 20180232920A1 · Faulkner et al. · 2018 [cited by applicant]
US 20180242149A1 · Verma · 2018 [cited by applicant]
US 20180262391A1 · Jng · 2018 [cited by applicant]
US 20180300679A1 · Mahmood · 2018 [cited by applicant]
US 20180315499A1 · Appelbaum · 2018 [cited by applicant]
US 20180337875A1 · Friio · 2018 [cited by applicant]
US 20180374474A1 · Wang · 2018 [cited by applicant]
US 20190035396A1 · Adamski · 2019 [cited by applicant]
US 20190042955A1 · Cahill et al. · 2019 [cited by applicant]
US 20190083034A1 · Shim et al. · 2019 [cited by applicant]
US 20190122121A1 · Yu · 2019 [cited by applicant]
US 20190155566A1 · Dory · 2019 [cited by applicant]
US 20190215673A1 · Choi · 2019 [cited by applicant]
US 20190354599A1 · Mital · 2019 [cited by applicant]
US 20190385606A1 · Won · 2019 [cited by applicant]
US 20200092519A1 · Shin et al. · 2020 [cited by applicant]
US 20200110835A1 · Zhao · 2020 [cited by examiner]
US 20200125600A1 · Jo · 2020 [cited by applicant]
US 20200242146A1 · Kalukin · 2020 [cited by applicant]
US 20200243082A1 · Yoshida · 2020 [cited by applicant]
US 20200327431A1 · Woo · 2020 [cited by applicant]
US 20200335102A1 · Lefkofsky · 2020 [cited by applicant]
US 20200342968A1 · Avinash · 2020 [cited by applicant]
US 20200402502A1 · Hanes · 2020 [cited by applicant]
US 20210011887A1 · Visser · 2021 [cited by applicant]
US 20210011933A1 · Liu · 2021 [cited by applicant]
US 20210049827A1 · Lebaredian · 2021 [cited by applicant]
US 20210056753A1 · Yasar · 2021 [cited by applicant]
US 20210201174A1 · Huang · 2021 [cited by applicant]
US 20210297494A1 · Kaplan · 2021 [cited by applicant]
US 20210304020A1 · Kaplan · 2021 [cited by applicant]
US 20210366473A1 · Maeng · 2021 [cited by applicant]
US 20210398671A1 · Gnanasambandam · 2021 [cited by applicant]
US 20220043845A1 · Sun · 2022 [cited by examiner]
CN 110728363 · 2020 [cited by applicant]
KR 1020020030545 · 2002 [cited by applicant]
KR 100978740 · 2018 [cited by applicant]
KR 1020180050771 · 2018 [cited by applicant]
KR 101854284 · 2018 [cited by applicant]
KR 1020180096183 · 2018 [cited by applicant]
KR 1020190080834 · 2019 [cited by applicant]
KR 1020190094307 · 2019 [cited by applicant]
KR 20190106269 · 2019 [cited by applicant]
WO WO2019172946 · 2019 [cited by applicant]
WO WO2019183062 · 2019 [cited by applicant]
International Search Report issued Jul. 1, 2021 in corresponding PCT/US2021/021767. [cited by applicant]
International Search Report issued Jul. 9, 2021 in corresponding PCT/US2021/022827. [cited by applicant]
International Search Report issued Jul. 9, 2021 in corresponding PCT/US2021/024515. [cited by applicant]
International Search Report issued Jul. 19, 2021 in corresponding PCT/US2021/024720. [cited by applicant]
International Search Report issued Jul. 20, 2021 in corresponding PCT/US2021/024994. [cited by applicant]
International Search Report issued Aug. 9, 2021 in corresponding PCT/US2021/029472. [cited by applicant]
International Search Report issued Oct. 13, 2021 in corresponding PCT/US2021/038266. [cited by applicant]
International Search Report issued Jan. 20, 2022 in corresponding PCT/US2021/053646. [cited by applicant]