IP Library › Granted Patent US 12,566,804
Granted Patent B2
US 12,566,804 · App. 18/534,305 · Granted Mar 3, 2026

Comprehensibility scores determined for the documents

Inventors: Kevin Males (Kings Lynn, GB); Alistair James Brain (Cambridge, GB)
Assignee: International Business Machines Corporation
G06F16/94G06F16/24578G06F16/338G06F16/35G06F16/9535G06F16/9538G06F40/20G06F40/205G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,566,804
App. No.
18/534,305
Filed
Dec 8, 2023
Granted
Mar 3, 2026
Kind
B2
Art Unit
2172
USPC
715/234
Abstract

Provided are a computer program product, system, and method for sorting documents according to comprehensibility scores determined for the documents. A document has sections of text associated with topics. A determination is made of familiarity scores for a user for the topics associated with the sections of text in the document. A determination is made of a comprehensibility score of the document, indicating comprehensibility of the document to the user, as a function of the determined familiarity scores for the topics in the document. The comprehensibility score for the document is used to determine an order in which to present the document to the user with a group of documents.

Claims (50)

1 . A computer program product for determining an order in which to present documents to a user, wherein the computer program product comprises a computer readable storage medium having program instructions embodied therewith that when executed cause operations, the operations comprising:

providing a document having text, comprising at least one of words and characters, associated with topics, wherein the document provides a hierarchy of topics, wherein at least one section of the text is associated with multiple topics in the hierarchy, including a topic and lower level topics of the topic;

determining, for each topic in the hierarchy in the document, an amount of text, comprising a number of at least one of words and characters, within the topic and the lower level topics of the topic in the hierarchy;

applying familiarity scores for a user for the topics to the determined amounts of text within the topics and lower level topics of the topics, wherein a familiarity score for a topic comprises a numerical value indicating a user familiarity with the topic;

determining a comprehensibility score of the document, indicating comprehensibility of the document to the user, based on results of applying the familiarity scores for the topics to the determined amounts of text within the topics and the lower level topics of the topics; and

using the comprehensibility score for the document to determine an order in which to present the document to the user with a group of documents.

2 . The computer program product of claim 1 , wherein the determining the comprehensibility score comprises:

determining unassociated text in the document not associated with a topic; and

using a familiarity score for the unassociated text, wherein the comprehensibility score further includes the familiarity score for the unassociated text in the document.

3 . The computer program product of claim 2 , wherein the familiarity score for the unassociated text indicates full comprehension.

4 . The computer program product of claim 1 , wherein the documents comprise structured documents and wherein the text comprise tagged text elements associated with the topics.

5 . The computer program product of claim 1 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages comprising an amount of text within a topic and lower level topics of the topic as a percentage of total text in the document, wherein the coverages for the topics and the familiarity scores associated with the topics are used to determine the comprehensibility score.

6 . The computer program product of claim 5 , wherein the operations further comprise:

processing unassociated text in the document not associated with a topic and a comprehensibility score for the unassociated text to determine the comprehensibility score.

7 . The computer program product of claim 1 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages for the topics, wherein a coverage for a topic comprises an amount of text for a topic and lower level topics of the topic divided by total text in the document, wherein the coverages for the topics are multiplied by the familiarity scores associated with the topics to determine the comprehensibility score, wherein the coverage for a topic is multiplied by a familiarity score associated with the topic.

8 . The computer program product of claim 1 , wherein the operations of determining the familiarity scores and determining the comprehensibility score are performed for each of the documents in the group of documents, and wherein the using the comprehensibility score to determine the order in which to present the document comprises sorting the documents by their comprehensibility scores.

9 . A system for determining an order in which to present documents to a user, comprising:

a processor; and

a computer readable storage medium having program instructions embodied therewith that when executed by the processor performs operations, the operations:

providing a document having text, comprising at least one of words and characters, associated with topics, wherein the document provides a hierarchy of topics, wherein at least one section of the text is associated with multiple topics in the hierarchy, including a topic and lower level topics of the topic;

determining, for each topic in the hierarchy in the document, an amount of text, comprising a number of at least one of words and characters, within the topic and the lower level topics of the topic in the hierarchy;

applying familiarity scores for a user for the topics to determined amounts of text within the topics and lower level topics of the topics, wherein a familiarity score for a topic comprises a numerical value indicating a user familiarity with the topic;

determining a comprehensibility score of the document, indicating comprehensibility of the document to the user, based on results of applying the familiarity scores for the topics to the determined amounts of text within the topics and the lower level topics of the topics; and

using the comprehensibility score for the document to determine an order in which to present the document to the user with a group of documents.

10 . The system of claim 9 , wherein the determining the comprehensibility score comprises:

determining unassociated text in the document not associated with a topic; and

using a familiarity score for the unassociated text, wherein the comprehensibility score further includes the familiarity score for the unassociated text in the document.

11 . The system of claim 9 , wherein the documents comprise structured documents and wherein the text comprise tagged text elements associated with the topics.

12 . The system of claim 9 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages comprising an amount of text within a topic and lower level topics of the topic as a percentage of total text in the document, wherein the coverages for the topics and the familiarity scores associated with the topics are used to determine the comprehensibility score.

13 . The system of claim 9 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages for the topics, wherein a coverage for a topic comprises an amount of text for a topic and lower level topics of the topic divided by total text in the document, wherein the coverages for the topics are multiplied by the familiarity scores associated with the topics to determine the comprehensibility score, wherein the coverage for a topic is multiplied by a familiarity score associated with the topic.

14 . The system of claim 9 , wherein the operations of determining the familiarity scores and determining the comprehensibility score are performed for each of the documents in the group of documents, and wherein the using the comprehensibility score to determine the order in which to present the document comprises sorting the documents by their comprehensibility scores.

15 . A method for determining an order in which to present documents to a user, comprising:

providing a document having text, comprising at least one of words and characters, associated with topics, wherein the in document provides a hierarchy of topics, wherein at least one section of the text is associated with multiple topics in the hierarchy, including a topic and lower level topics of the topic;

determining, for each topic in the hierarchy in the document, an amount of text, comprising a number of at least one of words and characters, within the topic and the lower level topics of the topic in the hierarchy;

applying familiarity scores for a user for the topics to the determined amounts of text within the topics and lower level topics of the topics, wherein a familiarity score for a topic comprises a numerical value indicating a user familiarity with the topic;

determining a comprehensibility score of the document, indicating comprehensibility of the document to the user, based on results of applying the familiarity scores for the topics to the determined amounts of text within the topics and the lower level topics of the topics; and

using the comprehensibility score for the document to determine an order in which to present the document to the user with a group of documents.

16 . The method of claim 15 , wherein the determining the comprehensibility score comprises:

determining unassociated text in the document not associated with a topic; and

using a familiarity score for the unassociated text, wherein the comprehensibility score further includes the familiarity score for the unassociated text in the document.

17 . The method of claim 15 , wherein the documents comprise structured documents and wherein the text comprise tagged text elements associated with the topics.

18 . The method of claim 15 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages comprising an amount of text within a topic and lower level topics of the topic as a percentage of total text in the document, wherein the coverages for the topics and the familiarity scores associated with the topics are used to determine the comprehensibility score.

19 . The method of claim 15 , wherein the determining the comprehensibility score comprises:

determining, for the topics, coverages for the topics, wherein a coverage for a topic comprises an amount of text for a topic and lower level topics of the topic divided by total text in the document, wherein the coverages for the topics are multiplied by the familiarity scores associated with the topics to determine the comprehensibility score, wherein the coverage for a topic is multiplied by a familiarity score associated with the topic.

20 . The method of claim 15 , wherein the determining the familiarity scores and determining the comprehensibility score are performed for each of the documents in the group of documents, and wherein the using the comprehensibility score to determine the order in which to present the document comprises sorting the documents by their comprehensibility scores.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2023
From: MALES, KEVIN; BRAIN, ALISTER JAMES
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 065826/0750 →
Continuity (2)
Continuation 17076357 · Oct 21, 2020
Related Publication 20240119078A1 · Apr 11, 2024
References Cited (175)
US 5359514A · Manthuruthil · 1994 [cited by examiner]
US 6006218A · Breese · 1999 [cited by examiner]
US 6823331B1 · Abu-Hakima · 2004 [cited by examiner]
US 7194483B1 · Mohan · 2007 [cited by examiner]
US 7493253B1 · Ceusters · 2009 [cited by examiner]
US 7996400B2 · Morris · 2011 [cited by examiner]
US 8122021B2 · White · 2012 [cited by examiner]
US 8161040B2 · Ward · 2012 [cited by examiner]
US 8402024B2 · White · 2013 [cited by examiner]
US 8498974B1 · Kim · 2013 [cited by examiner]
US 8714986B2 · Dodelson · 2014 [cited by examiner]
US 8738364B2 · Banke · 2014 [cited by examiner]
US 8930357B2 · White · 2015 [cited by examiner]
US 8935274B1 · Mihailovici · 2015 [cited by examiner]
US 8954423B2 · Chica · 2015 [cited by examiner]
US 9002835B2 · Sharifi · 2015 [cited by examiner]
US 9009100B2 · Rechterman · 2015 [cited by examiner]
US 9053195B2 · Yang · 2015 [cited by examiner]
US 9098570B2 · Zhang · 2015 [cited by examiner]
US 9268864B2 · White · 2016 [cited by examiner]
US 9292494B2 · Ceusters · 2016 [cited by examiner]
US 9298777B2 · Lawrence · 2016 [cited by examiner]
US 9336204B1 · Amundsen · 2016 [cited by examiner]
US 9342590B2 · Karidi · 2016 [cited by examiner]
US 9575961B2 · Seuss · 2017 [cited by examiner]
US 9576022B2 · Braham · 2017 [cited by examiner]
US 9600585B2 · de la Chica · 2017 [cited by examiner]
US 9613131B2 · Braham · 2017 [cited by examiner]
US 9619523B2 · Voronel · 2017 [cited by examiner]
US 9740694B2 · Braham · 2017 [cited by examiner]
US 9858336B2 · Byron · 2018 [cited by examiner]
US 9875300B2 · Byron · 2018 [cited by examiner]
US 9910912B2 · Byron · 2018 [cited by examiner]
US 9916380B2 · Byron · 2018 [cited by examiner]
US 9990406B2 · Braham · 2018 [cited by examiner]
US 10002196B2 · Zhang · 2018 [cited by examiner]
US 10055498B2 · Spaulding · 2018 [cited by examiner]
US 10102272B2 · Musuluri · 2018 [cited by examiner]
US 10142272B2 · Chakra · 2018 [cited by examiner]
US 10146839B2 · Bolshinsky · 2018 [cited by examiner]
US 10162882B2 · Franceschini · 2018 [cited by examiner]
US 10162883B2 · Franceschini · 2018 [cited by examiner]
US 10191951B1 · Bronstein · 2019 [cited by examiner]
US 10248669B2 · Sweeney · 2019 [cited by examiner]
US 10275464B2 · Sharifi · 2019 [cited by examiner]
US 10303771B1 · Jezewski · 2019 [cited by examiner]
US 10303779B2 · Sharifi · 2019 [cited by examiner]
US 10371541B2 · Voronel · 2019 [cited by examiner]
US 10372813B2 · Anders · 2019 [cited by examiner]
US 10380147B1 · Omland · 2019 [cited by examiner]
US 10380207B2 · Bostick · 2019 [cited by examiner]
US 10380252B2 · Seuss · 2019 [cited by examiner]
US 10402465B1 · Jain · 2019 [cited by examiner]
US 10489512B2 · Jezewski · 2019 [cited by examiner]
US 10496683B2 · Franceschini · 2019 [cited by examiner]
US 10496684B2 · Franceschini · 2019 [cited by examiner]
US 10606874B2 · Braham · 2020 [cited by examiner]
US 10831749B2 · Silva · 2020 [cited by examiner]
US 10877980B1 · Bronstein · 2020 [cited by examiner]
US 10902201B2 · Hewitt · 2021 [cited by examiner]
US 10990602B2 · Bangalore Narayanamurthy · 2021 [cited by examiner]
US 10990767B1 · Smathers · 2021 [cited by examiner]
US 11017051B2 · Pilkington · 2021 [cited by examiner]
US 11151173B2 · Omland · 2021 [cited by examiner]
US 11163842B2 · Weldemariam · 2021 [cited by examiner]
US 11273552B2 · Ku · 2022 [cited by examiner]
US 11328116B2 · Meling · 2022 [cited by examiner]
US 11341330B1 · Smathers · 2022 [cited by examiner]
US 11354513B2 · Modani · 2022 [cited by examiner]
US 11392665B2 · Pilkington · 2022 [cited by examiner]
US 11397897B2 · Ameri · 2022 [cited by examiner]
US 11645317B2 · Tolman · 2023 [cited by examiner]
US 11657223B2 · Xiong · 2023 [cited by examiner]
US 11880416B2 · Males et al. · 2024 [cited by applicant]
US 20050071328A1 · Lawrence · 2005 [cited by examiner]
US 20060064637A1 · Rechterman · 2006 [cited by examiner]
US 20060282413A1 · Bondi · 2006 [cited by examiner]
US 20070067294A1 · Ward · 2007 [cited by examiner]
US 20080270390A1 · Ward · 2008 [cited by examiner]
US 20080319976A1 · Morris · 2008 [cited by examiner]
US 20090024605A1 · Yang · 2009 [cited by examiner]
US 20090259459A1 · Ceusters · 2009 [cited by examiner]
US 20090311657A1 · Dodelson · 2009 [cited by examiner]
US 20100088331A1 · White · 2010 [cited by examiner]
US 20120117061A1 · White · 2012 [cited by examiner]
US 20120166441A1 · Karidi · 2012 [cited by examiner]
US 20120254161A1 · Zhang · 2012 [cited by examiner]
US 20130006914A1 · Ray · 2013 [cited by examiner]
US 20130060756A1 · White · 2013 [cited by examiner]
US 20130060763A1 · Chica · 2013 [cited by examiner]
US 20130325779A1 · Shahshahani · 2013 [cited by examiner]
US 20140193796A1 · Dodelson · 2014 [cited by examiner]
US 20150046423A1 · Weeks · 2015 [cited by examiner]
US 20150052121A1 · Sharifi · 2015 [cited by examiner]
US 20150052168A1 · Sharifi · 2015 [cited by examiner]
US 20150081661A1 · White · 2015 [cited by examiner]
US 20150154307A1 · de la Chica · 2015 [cited by examiner]
US 20150278211A1 · Voronel · 2015 [cited by examiner]
US 20150294017A1 · Zhang · 2015 [cited by examiner]
US 20150339616A1 · Pursche · 2015 [cited by examiner]
US 20160012122A1 · Franceschini · 2016 [cited by examiner]
US 20160012336A1 · Franceschini · 2016 [cited by examiner]
US 20160062986A1 · Seuss · 2016 [cited by examiner]
US 20160070782A1 · Kannan · 2016 [cited by examiner]
US 20160140186A1 · Langen · 2016 [cited by applicant]
US 20160140220A1 · Chaumartin · 2016 [cited by examiner]
US 20160179805A1 · Bolshinsky · 2016 [cited by examiner]
US 20160179810A1 · Bolshinsky · 2016 [cited by examiner]
US 20160275082A1 · White · 2016 [cited by examiner]
US 20160283486A1 · Sharifi · 2016 [cited by examiner]
US 20160371352A1 · Kohlmeier · 2016 [cited by examiner]
US 20170011039A1 · Spaulding · 2017 [cited by examiner]
US 20170011043A1 · Musuluri · 2017 [cited by examiner]
US 20170116176A1 · Seuss · 2017 [cited by examiner]
US 20170132227A1 · Bostick · 2017 [cited by examiner]
US 20170169334A1 · Sweeney · 2017 [cited by examiner]
US 20170186331A1 · Lawrenson · 2017 [cited by examiner]
US 20170193090A1 · Byron · 2017 [cited by examiner]
US 20170193091A1 · Byron · 2017 [cited by examiner]
US 20170193092A1 · Byron · 2017 [cited by examiner]
US 20170193093A1 · Byron · 2017 [cited by examiner]
US 20170211944A1 · Voronel · 2017 [cited by examiner]
US 20180032522A1 · Singhal · 2018 [cited by examiner]
US 20180068014A1 · Byron · 2018 [cited by examiner]
US 20180121499A1 · Joshi · 2018 [cited by examiner]
US 20180203842A1 · Anders · 2018 [cited by examiner]
US 20180203933A1 · DeLuca · 2018 [cited by examiner]
US 20190073414A1 · Franceschini · 2019 [cited by examiner]
US 20190073415A1 · Franceschini · 2019 [cited by examiner]
US 20190206510A1 · Jiang · 2019 [cited by examiner]
US 20190251172A1 · Jezewski · 2019 [cited by examiner]
US 20190324978A1 · Omland · 2019 [cited by examiner]
US 20190324997A1 · Bostick · 2019 [cited by examiner]
US 20190384828A1 · Bangalore Narayanamurthy · 2019 [cited by examiner]
US 20200042593A1 · Hewitt · 2020 [cited by examiner]
US 20200134039A1 · Alam · 2020 [cited by examiner]
US 20200142545A1 · Wald · 2020 [cited by examiner]
US 20200159795A1 · Weldemariam · 2020 [cited by examiner]
US 20200311092A1 · Thomas · 2020 [cited by examiner]
US 20200341990A1 · Rosenoff · 2020 [cited by examiner]
US 20200409982A1 · Buchanan · 2020 [cited by examiner]
US 20210004420A1 · Mittal · 2021 [cited by examiner]
US 20210004439A1 · Xiong · 2021 [cited by examiner]
US 20210073237A1 · Wang · 2021 [cited by examiner]
US 20210073654A1 · Ameri · 2021 [cited by examiner]
US 20210216937A1 · Dhaygude · 2021 [cited by examiner]
US 20210224296A1 · Kohlmeier · 2021 [cited by examiner]
US 20210248322A1 · Modani · 2021 [cited by examiner]
US 20210248323A1 · Maheshwari · 2021 [cited by examiner]
US 20210406449A1 · Meling · 2021 [cited by examiner]
US 20220016767A1 · Ku · 2022 [cited by examiner]
US 20220108078A1 · Xiong · 2022 [cited by examiner]
CN 1175303A · 1998 [cited by applicant]
CN 111753043A · 2020 [cited by examiner]
Corrected Final Office Action dated Jun. 10, 2022, 19 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
Final Office Action dated Mar. 15, 2023, 24 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
HTML, “Microdata”, 2018, pp. 35. [online][retrieved Oct. 5, 2020] https://www.w3.org/TR/2018/WD-microdata-20180426/. [cited by applicant]
Notice of Allowance dated Aug. 31, 2023, 9 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
Notice of Allowance dated Nov. 15, 2023, 6 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
Office Action dated Dec. 9, 2021, 20 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
Office Action dated Sep. 22, 2022, 25 pp., for U.S. Appl. No. 17/076,357. [cited by applicant]
Response dated Feb. 7, 2022, 16 pp. to Office Action, for U.S. Appl. No. 17/076,357. [cited by applicant]
Response dated Jun. 30, 2022, 17 pp., to Final Office Action for U.S. Appl. No. 17/076,357. [cited by applicant]
Response dated Dec. 5, 2022, 21 pp., to Office Action for U.S. Appl. No. 17/076,357. [cited by applicant]
Response dated May 17, 2023, 24 pp., to Final Office Action for U.S. Appl. No. 17/076,357. [cited by applicant]
schema.org, “Getting Started”, [online][retrieved Oct. 11, 2020], pp. 9, https://schema.org/docs/gs.html. [cited by applicant]
Wikipedia, “Microdata”, May 11, 2020, pp. 5, [online] https://en.wikipedia.org/w/index.php?title=Micrdodata_(HTML)&oldid=956138522. [cited by applicant]
Wikipedia, “PageRank”, Oct. 18, 2020, pp. 15, [online] https://en.wikipedia.org/w/index.php? title=PageRank&oldid=984082672. [cited by applicant]
Xin Yan, Raymond Y.K. Lau, Dawei Song, Xue Li, and Jian Ma. 2011. Toward a semantic granularity model for domain-specific information retrieval. ACM Trans. Inf. Syst. 29, 3, Article 15 (Jul. 2011), 46 pages. DOI=http://… [cited by applicant]
Yan, Xin; Song, Dawei and Li, Xue (2006). Concept-based Document Readability in Domain Specific Information Retrieval. In: 2006 ACM CIKM International Conference on Information and Knowledge Management (CIKM 2006), Nov.… [cited by applicant]
No Author. “Peripheral neuropathy”, NHS Inform, Jun. 16, 2023, 5 pages, https://web.archive.org/web/20231102035615/https://www.nhsinform.scot/illnesses-and-conditions/brain-nerves-and-spinal-cord/peripheral-neuropathy/. [cited by applicant]
Schema.org. “Drug”, retrieved from web https://web.archive.org/web/20231207075801/http://schema.org/Drug, Dec. 7, 2023, 6 pages. [cited by applicant]
Schema.org. “LifestyleModification”, retrieved from web https://web.archive.org/web/20231004120739/http://schema.org/LifestyleModification, Oct. 4, 2023, 2 pages. [cited by applicant]
Schema.org. “Treatmentindication”, retrieved from web https://web.archive.org/web/20231004100805/http://schema.org/TreatmentIndication, Oct. 4, 2023, 2 pages. [cited by applicant]
Wikipedia. “Diabetic neuropathy”, retrieved from web https://web.archive.org/web/20231103044201/https://en.wikipedia.org/wiki/Diabetic_neuropathy, Nov. 3, 2023, 12 pages. [cited by applicant]