IP Library Granted Patent US 12,282,513
Granted Patent B2
US 12,282,513 · App. 17/134,274 · Granted Apr 22, 2025

Optimistic facet set selection for dynamic faceted search

Inventors: Michael Robert Glass (Bayonne, NJ); Md Faisal Mahbub Chowdhury (Woodside, NY); Alfio Massimiliano Gliozzo (Brooklyn, NY)
Assignee: International Business Machines Corporation
G06F16/9035G06F16/901G06F16/90344G06F16/9038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,513
App. No.
17/134,274
Granted
Apr 22, 2025
Kind
B2
Abstract

Determining an initial rank and a probability of relevance of each of a retrieved plurality of electronic documents relevant to a query. For each of a plurality of candidate facets, determine a revised rank for each of the retrieved plurality of electronic documents relevant to the query. Selecting, for each of the retrieved plurality of electronic documents relevant to the query, a minimum rank from among the initial rank and the revised rank for each of the plurality of candidate facets. Determine an expected discounted cumulative gain based on the probability of relevance and the minimum rank for each of the retrieved plurality of electronic documents relevant to the query. Select a set of optimistic facets based on maximizing the expected discounted cumulative gain.

Claims (48)

1. A computer-implemented method comprising:

determining, using at least one hardware processor, an initial rank and a probability of relevance of each of a retrieved plurality of electronic documents relevant to a query;

for each of a plurality of candidate facets, determining, using the at least one hardware processor, a revised rank for each of said retrieved plurality of electronic documents relevant to said query;

selecting, using the at least one hardware processor, for each of said retrieved plurality of electronic documents relevant to said query, a minimum rank from among said initial rank and said revised rank for each of said plurality of candidate facets;

determining, using the at least one hardware processor, an expected discounted cumulative gain based on said probability of relevance and said minimum rank for each of said retrieved plurality of electronic documents relevant to said query;

selecting, using the at least one hardware processor, a set of optimistic facets based on maximizing said expected discounted cumulative gain;

for each of those of said plurality of candidate facets not included in said set of optimistic facets:

swapping, using the at least one hardware processor, a given one of those of said plurality of candidate facets not included in said set of optimistic facets with each of the optimistic facets; and

determining, using the at least one hardware processor, a corresponding improvement in discounted cumulative gain;

continuing said swapping and said determining of said corresponding improvement until further improvement in said discounted cumulative gain is not observed;

updating, using the at least one hardware processor, said set of optimistic facets based on said swapping; and

with a computerized search engine implemented on the at least one hardware processor, searching for an updated set of electronic documents relevant to an updated query, the updated query being based on said query and said updated set of optimistic facets, wherein said set of optimistic facets is formulated by performing an aggregate reduction, wherein the aggregate reduction comprises reducing redundant facets that commonly appear with another facet in the retrieved plurality of electronic documents, reducing facets that commonly appear in a majority of the retrieved plurality of electronic documents and reducing facets that are non-discriminative.

2. The computer-implemented method of claim 1 , further comprising selecting said candidate facets via computerized term embedding.

3. The computer-implemented method of claim 2 , wherein selecting said candidate facets via said computerized term embedding comprises applying cosine similarity.

4. The computer-implemented method of claim 1 , wherein said probability of relevance is determined as proportional to an inverse of a sum of said initial rank and a square root of said initial rank.

5. An apparatus comprising:

a memory;

a non-transitory computer readable medium including computer executable instructions; and

at least one processor, coupled to the memory and the non-transitory computer readable medium, and operative to execute the instructions to:

determine an initial rank and a probability of relevance of each of a retrieved plurality of electronic documents relevant to a query;

for each of a plurality of candidate facets, determine a revised rank for each of said retrieved plurality of electronic documents relevant to said query;

select, for each of said retrieved plurality of electronic documents relevant to said query, a minimum rank from among said initial rank and said revised rank for each of said plurality of candidate facets;

determine an expected discounted cumulative gain based on said probability of relevance and said minimum rank for each of said retrieved plurality of electronic documents relevant to said query;

select a set of optimistic facets based on maximizing said expected discounted cumulative gain; and

for each of those of said plurality of candidate facets not included in said set of optimistic facets:

swap a given one of those of said plurality of candidate facets not included in said set of optimistic facets with each of the optimistic facets; and

determine a corresponding improvement in discounted cumulative gain;

continue said swapping and said determining of said corresponding improvement until further improvement in said discounted cumulative gain is not observed;

update said set of optimistic facets based on said swapping; and

cause a computerized search engine to search for an updated set of electronic documents relevant to an updated query, the updated query being based on said query and said updated set of optimistic facets, wherein said set of optimistic facets is formulated by performing an aggregate reduction, wherein the aggregate reduction comprises reducing redundant facets that commonly appear with another facet in the retrieved plurality of electronic documents, reducing facets that commonly appear in a majority of the retrieved plurality of electronic documents and reducing facets that are non-discriminative.

6. The apparatus of claim 5 , wherein said at least one processor is further operative to select said candidate facets via computerized term embedding.

7. The apparatus of claim 6 , wherein selecting said candidate facets via said computerized term embedding comprises applying cosine similarity.

8. The apparatus of claim 7 , wherein said probability of relevance is determined as proportional to an inverse of a sum of said initial rank and a square root of said initial rank.

9. A computer program product comprising one or more computer readable storage media having stored thereon:

first program instructions executable by a computer system to cause the computer system to determine an initial rank and a probability of relevance of each of a retrieved plurality of electronic documents relevant to a query;

second program instructions executable by the computer system to cause the computer system to, for each of a plurality of candidate facets, determine a revised rank for each of said retrieved plurality of electronic documents relevant to said query;

third program instructions executable by the computer system to cause the computer system to select, for each of said retrieved plurality of electronic documents relevant to said query, a minimum rank from among said initial rank and said revised rank for each of said plurality of candidate facets;

fourth program instructions executable by the computer system to cause the computer system to determine an expected discounted cumulative gain based on said probability of relevance and said minimum rank for each of said retrieved plurality of electronic documents relevant to said query;

fifth program instructions executable by the computer system to cause the computer system to select a set of optimistic facets based on maximizing said expected discounted cumulative gain;

sixth program instructions executable by the computer system to cause the computer system to, for each of those of said plurality of candidate facets not included in said set of optimistic facets:

swap a given one of those of said plurality of candidate facets not included in said set of optimistic facets with each of the optimistic facets; and

determine a corresponding improvement in discounted cumulative gain;

seventh program instructions executable by the computer system to cause the computer system to continue said swapping and said determining of said corresponding improvement until further improvement in said discounted cumulative gain is not observed;

eighth program instructions executable by the computer; and

ninth program instructions executable by the computer system to cause the computer system to cause a computerized search engine to search for an updated set of electronic documents relevant to an updated query, the updated query being based on said query and said updated set of optimistic facets, wherein said set of optimistic facets is formulated by performing an aggregate reduction, wherein the aggregate reduction comprises reducing redundant facets that commonly appear with another facet in the retrieved plurality of electronic documents, reducing facets that commonly appear in a majority of the retrieved plurality of electronic documents and reducing facets that are non-discriminative.

10. The computer program product of claim 9 , wherein said one or more computer readable storage media having further stored thereon:

tenth program instructions executable by the computer system to cause the computer system to select said candidate facets via computerized term embedding.

11. The computer program product of claim 10 , wherein said probability of relevance is determined as proportional to an inverse of a sum of said initial rank and a square root of said initial rank.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2020
From: GLASS, MICHAEL ROBERT; CHOWDHURY, MD FAISAL MAHBUB; GLIOZZO, ALFIO MASSIMILIANO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 054749/0799 →
Continuity (1)
Related Publication 20220207087A1 · Jun 30, 2022
References Cited (106)
US 6006222A · Culliss · 1999 [cited by applicant]
US 7137062B2 · Kaufman et al. · 2006 [cited by applicant]
US 7603348B2 · He et al. · 2009 [cited by applicant]
US 8214361B1 · Sandler et al. · 2012 [cited by applicant]
US 8391618B1 · Chuang · 2013 [cited by examiner]
US 8983930B2 · Cheng et al. · 2015 [cited by applicant]
US 9037579B2 · Pasumarthi et al. · 2015 [cited by applicant]
US 9183288B2 · Murray · 2015 [cited by applicant]
US 9372606B2 · Scherpa et al. · 2016 [cited by applicant]
US 9715493B2 · Papadopoullos · 2017 [cited by applicant]
US 10042880B1 · Bodapati · 2018 [cited by applicant]
US 10242103B2 · Bivens et al. · 2019 [cited by applicant]
US 10262068B2 · Gungor et al. · 2019 [cited by applicant]
US 10373075B2 · Wu · 2019 [cited by applicant]
US 10430465B2 · Freed et al. · 2019 [cited by applicant]
US 10572560B2 · Bei et al. · 2020 [cited by applicant]
US 10733211B2 · Breno · 2020 [cited by applicant]
US 11176189B1 · Hohwald · 2021 [cited by examiner]
US 11940996B2 · Chowdhury · 2024 [cited by examiner]
US 20020103799A1 · Bradford · 2002 [cited by applicant]
US 20050038781A1 · Ferrari · 2005 [cited by examiner]
US 20060004814A1 · Lawrence · 2006 [cited by applicant]
US 20060224577A1 · Hullender · 2006 [cited by examiner]
US 20070174865A1 · Jing · 2007 [cited by applicant]
US 20080172375A1 · Burges · 2008 [cited by examiner]
US 20090187555A1 · Liu · 2009 [cited by examiner]
US 20100293175A1 · Vadrevu · 2010 [cited by examiner]
US 20110078205A1 · Salkeld · 2011 [cited by examiner]
US 20110125764A1 · Carmel · 2011 [cited by examiner]
US 20110131157A1 · Iyer · 2011 [cited by examiner]
US 20110246456A1 · Weitz · 2011 [cited by examiner]
US 20120030152A1 · Pueyo · 2012 [cited by examiner]
US 20120203717A1 · Xu · 2012 [cited by examiner]
US 20120226681A1 · Paparizos · 2012 [cited by examiner]
US 20130226916A1 · Dredze · 2013 [cited by examiner]
US 20140201180A1 · Fatourechi · 2014 [cited by applicant]
US 20140207746A1 · Song · 2014 [cited by examiner]
US 20140330804A1 · Bao · 2014 [cited by examiner]
US 20170024394A1 · Kim · 2017 [cited by applicant]
US 20170140053A1 · Vorobev · 2017 [cited by examiner]
US 20170148078A1 · Agarwal · 2017 [cited by examiner]
US 20170221120A1 · Pathak · 2017 [cited by examiner]
US 20170308535A1 · Agarwal · 2017 [cited by examiner]
US 20170364596A1 · Wu · 2017 [cited by examiner]
US 20180101616A1 · Ma · 2018 [cited by examiner]
US 20180232434A1 · Geyik · 2018 [cited by examiner]
US 20180232449A1 · Bivens · 2018 [cited by examiner]
US 20180232450A1 · Bivens · 2018 [cited by examiner]
US 20180232702A1 · Dialani · 2018 [cited by examiner]
US 20190065584A1 · Fukuda · 2019 [cited by examiner]
US 20190114325A1 · Zaki · 2019 [cited by examiner]
US 20190205445A1 · Yazdani · 2019 [cited by examiner]
US 20190258722A1 · Guo · 2019 [cited by examiner]
US 20190294705A1 · Kumar · 2019 [cited by examiner]
US 20190362025A1 · Zhou et al. · 2019 [cited by applicant]
US 20190392077A1 · Kikuchi et al. · 2019 [cited by applicant]
US 20200004886A1 · Ramanath · 2020 [cited by examiner]
US 20200005218A1 · Cheung et al. · 2020 [cited by applicant]
US 20200097531A1 · Kajinaga et al. · 2020 [cited by applicant]
US 20200201848A1 · Srinivasan · 2020 [cited by applicant]
US 20200265491A1 · Young · 2020 [cited by applicant]
US 20200311092A1 · Thomas · 2020 [cited by applicant]
US 20200349179A1 · Kong · 2020 [cited by applicant]
US 20200349203A1 · Kong · 2020 [cited by applicant]
US 20200401627A1 · Liu · 2020 [cited by examiner]
US 20200410003A1 · Simhadri · 2020 [cited by examiner]
US 20210157856A1 · Tsuzuku · 2021 [cited by examiner]
US 20210319033A1 · Zhang · 2021 [cited by examiner]
US 20210326346A1 · Rivlin · 2021 [cited by examiner]
US 20210349954A1 · Renders · 2021 [cited by examiner]
US 20210390127A1 · Fox · 2021 [cited by examiner]
US 20220083559A1 · Chowdhury · 2022 [cited by applicant]
US 20220197916A1 · Sarkar · 2022 [cited by examiner]
US 20220207030A1 · Chowdhury · 2022 [cited by applicant]
KR 20090063801A · 2009 [cited by applicant]
Anju et al.; “Dynamically Building Facets From Their Search Results”, IJEAT Journal Of, vol. 6, Issue 5, pp. 2249-2253, Jun. 2017. [cited by applicant]
Latha et al.; “A Dynamic Feature Selection Method For Document Ranking With Relevance Feedback Approach”, ICTACT Journal On Soft Computing, vol. 1, Iss. 1 , pp. 1-8, Jul. 2010. [cited by applicant]
Affolter et al.; “FacetX: Dynamic Facet Generation For Advanced Information Filtering Of Search Results”, EDBT/ICDT Workshop On, pp. 1-4, Mar. 30-Apr. 2, 2020. [cited by applicant]
Jiang et al.; “Generating Query Facets Using Knowledge Bases”, TKDE IEEE Transactions On, vol. 29, Iss. 2, pp. 315-329, Feb. 1, 2017. [cited by applicant]
Lykke et al.; “Physicists' Information Tasks: Structure, Length And Retrieval Performance”, IIiX'10 ACM Symposium On, pp. 1-6, Aug. 18-21, 2010. [cited by applicant]
Ali et al., Entity attribute ranking using learning to rank. InKG4IR@ SIGIR 2017 (pp. 19-24) http://www.tara.tcd.ie/bitstream/handle/2262/82720/3.pdf?sequence=3. [cited by applicant]
Vandic et al., Dynamic Facet Ordering For Faceted Product Search Engines, IEEE Transactions on Knowledge and Data Engineering. Jan. 16, 2017;29(5):1004-16. [cited by applicant]
Dash et al.; “Dynamic Faceted Search For Discovery-Driven Analysis”, CIKM'08 17th ACM Conference On, pp. 3-12, Oct. 26-30, 2008. [cited by applicant]
Pasha et al.; “Dynamic ordering Of Facets For E-Commerce Industries”, IJSDR International Journal, vol. 3, Issue 5, pp. 595-607, May 2018. [cited by applicant]
Roy et al.; “DynaCet: Building Dynamic Faceted Search Systems Over Databases”, ICDE IEEE 25th International Conference On, pp. 1463-1466, Mar. 29-Apr. 2, 2009. [cited by applicant]
Chowdhury MF, Farrell R. An efficient approach for super and nested term indexing and retrieval. arXiv preprint arXiv:1905.09761. May 23, 2019. 5 pages. [cited by applicant]
Paul J. Otterstedt, List of IBM Patents or Patent Applications Treated as Related, 2 pp. Mar. 6, 2023. [cited by applicant]
Zhang C, Tao F, Chen X, Shen J, Jiang M, Sadler B, Vanni M, Han J. Taxogen: Unsupervised topic taxonomy construction by adaptive term embedding and clustering. InProceedings of the 24th ACM SIGKDD International Conferen… [cited by applicant]
Agnes van Belle, Berlin Buzzwords, 2017, 48 pages. [cited by applicant]
Feddoul L, Schindler S, Löffler F. Automatic facet generation and selection over knowledge graphs. InSemantic Systems. The Power of AI and Knowledge Graphs: 15th International Conference, SEMANTICS 2019, Karlsruhe, Germ… [cited by applicant]
Manioudakis K, Tzitzikas Y. Extending faceted search with automated object ranking. InMetadata and Semantic Research: 13th International Conference, MTSR 2019, Rome, Italy, Oct. 28-31, 2019, Revised Selected Papers 2019… [cited by applicant]
Bashir S, Afzal W, Baig AR. Opinion-Based Entity Ranking using learning to rank. Applied Soft Computing. Jan. 1, 2016;38:151-63. [cited by applicant]
Lawless, Seamus. “Entity attribute ranking using learning to rank.” (2017). 6 pages. [cited by applicant]
Kang C, Yin D, Zhang R, Torzec N, He J, Chang Y. Learning to rank related entities in web search. Neurocomputing. Oct. 20, 2015;166:309-18. [cited by applicant]
Senjuti Basu Roy, Haidong Wang, Gautam Das, Ullas Nambiar, and Mukesh Mohania. 2008. Minimum-effort driven dynamic faceted search in structured databases. pp. 13-22, 01. [cited by applicant]
Ben-Yitzhak O, Golbandi N, Har'El N, Lempel R, Neumann A, Ofek-Koifman S, Sheinwald D, Shekita E, Sznajder B, Yogev S. Beyond basic faceted search. InProceedings of the 2008 international conference on web search and da… [cited by applicant]
Dakka W, Ipeirotis PG. Automatic extraction of useful facet hierarchies from text databases. In2008 IEEE 24th International Conference on Data Engineering Apr. 7, 2008 (pp. 466-475). IEEE. [cited by applicant]
Kelly D. Methods for evaluating interactive information retrieval systems with users. Foundations and Trends® in Information Retrieval. Apr. 27, 2009;3(1-2):1-224. (Abstract only 2 pages). [cited by applicant]
Zhang Y, Liu X, Zhai C. Information retrieval evaluation as search simulation: A general formal framework for ir evaluation. InProceedings of the ACM SIGIR International Conference on Theory of Information Retrieval Oct… [cited by applicant]
Cranfield experiments—Wikipedia, downloaded Mar. 6, 2023 from https://en.wikipedia.org/wiki/Cranfield_experiments 5 pages. [cited by applicant]
Okapi BM25, Wikipedia, downloaded Mar. 6, 2023 from https://en.wikipedia.org/wiki/Okapi_BM25, 3 pages. [cited by applicant]
Anonymous, How is hits@k calculated and what does it mean in the context of link prediction in knowledge bases, downloaded Mar. 6, 2023 from https://stackoverflow.com/questions/58796367/how-is-hitsk-calculated-and-what-… [cited by applicant]
Discounted cumulative gain, Wikipedia, downloaded from https://en.wikipedia.org/wiki/Discounted_cumulative_gain Mar. 6, 2023 5 pages. [cited by applicant]
Anonymous, How to use word2vec to calculate the similarity distance by giving 2 words?, downloaded Mar. 6, 2023 from https://stackoverflow.com/questions/21979970/how-to-use-word2vec-to-calculate-the-similarity-distance-… [cited by applicant]
Anonymous, What is Elasticsearch?, downloaded from https://www.elastic.co/what-is/elasticsearch Mar. 6, 2023 6 pages. [cited by applicant]
Peter Mell and Timothy Grance, The NIST Definition of Cloud Computing, NIST Special Publication 800-145, cover, pp. i-iii, 1-3, Sep. 2011. [cited by applicant]