IP Library › Granted Patent US 12,724,818
Granted Patent B2
US 12,724,818 · App. 18/820,796 · Granted Sep 1, 2026

Computer-implemented method, device and system for generating and providing an interactive graphical user interface

Inventors: Beatriz Evangelho Feliciano (Coimbra, PT); Javier Liébana de la Barrera (Coimbra, PT); Leonardo de Oliveira Vieira Alves (Coimbra, PT); Rita Marques Costa (Coimbra, PT); Diogo Ramalho Duarte (Coimbra, PT); Pedro Gustavo Santos Rodrigues Bizarro (Coimbra, PT)
Assignee: FEEDZAI—CONSULTADORIA E INOVAÇÃO TECNOLÓGICA, S.A.
G06F16/358G06F16/345
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,724,818
App. No.
18/820,796
Granted
Sep 1, 2026
Kind
B2
Abstract

An interactive graphical user interface is generated and provided. Transactional data records are received, each comprising a plurality of data attributes. Using the data attributes, each received data record is classified into zero, one or more classes of a first classification. Each previously classified data record is classified into zero, one or more classes of a second classification, using the data attributes and the first classification. A user selection of a class of the first classification is received and a text summary for the received data records having been attributed the selected class is generated. The text summary is fed to the graphical user interface. The text summary includes the class or classes attributed by the second classification attributed to the received data records having been attributed the selected class. A graphic representation for the selected class is generated.

Claims (42)

1 . A computer-implemented method for generating, verifying and providing information in an interactive graphical user interface, comprising the steps of:

receiving, by at least one computing device, a plurality of transactional data records, each of the plurality of data records having a plurality of data attributes;

automatically classifying, by the at least one computing device:

at least one of the plurality of transactional data records into one or more classes of a first classification, as a function of the data attributes; and

the at least one of the plurality of transactional data records into one or more classes of a second classification, as a function of the data attributes and the first classification;

receiving, by the at least one computing device via the graphical user interface, a user selection of a class of the first classification;

dynamically generating, in response to the user selection, a plurality of text summaries, each including the one or more classes of the second classification for the at least one of the plurality of transactional data records having data attributes associated with the user selection, wherein generating each respective one of the text summaries includes:

automatically generating, by the at least one computing device, a prompt for a text summary of the selected class and the at least one class of the second classification;

providing the generated prompt to a text generator model; and

receiving, from the text generator model in response to the prompt, the generated respective text summary;

automatically verifying, by the at least one computing device, that data present in each of the plurality of generated text summaries are present in all of the plurality of generated text summaries;

providing, by the at least one computing device, at least one of plurality of the generated text summaries via the graphical user interface;

providing, via the graphical user interface, a graphic representation for the selected class;

providing, by the at least one computing device via the graphical user interface, the received plurality of transactional data records as tabular data; and

displaying, via the graphical user interface, the at least one of the plurality of the generated text summaries, the graphic representation, and the tabular data, including by highlighting part or parts of the at least one of the plurality of the generated text summaries, wherein the part or parts correspond to a class or classes from the second classification attributed to the received data records having been attributed the selected class.

2 . The method according to claim 1 , wherein generating the text summary further comprises generating a text summary of the class or classes attributed by the first classification and generating a text summary of the class or classes attributed by the second classification.

3 . The method according to claim 1 , further comprising displaying the classes obtained from the first classification.

4 . The method according to claim 1 , wherein the second classification is orthogonal in respect to the first classification.

5 . The method according to claim 1 , further comprising the display of classes obtained from the first classification, wherein first classification classes for which a preponderance of a class from the second classification are highlighted.

6 . The method according to claim 1 , further comprising highlighting part or parts of the generated graphic representation, in particular the part or parts being those corresponding to a class or classes from the second classification attributed to the received data records having been attributed the selected class, further in particular the part or parts being those corresponding to a class or classes from the second classification above a predetermined classification threshold.

7 . The method according to claim 1 , wherein the text generator model is an LLM, including a transformer-based model.

8 . The method according to claim 1 , wherein the first classification is based in a predetermined knowledge-area; and/or the second classification is based in a predetermined risk class.

9 . The method according to claim 1 , wherein classifying comprises applying a pretrained discriminative model, in particular the pretrained discriminative model comprising feature embedding pre-obtained from training transactional data records and corresponding classification.

10 . The method according to claim 1 , further comprising one or more of:

verifying if all numerical data present in the generated text summary is present in the received data records or present in numerical statistics computed from the received data records, in particular the numerical statistics comprising average, sum, median, deviation, minimum or maximum; and

previously including instructions in the prompt for explicitly generating precalculated numerical statistics computed from the received data records and verifying if all numerical data present in the generated text summary is present in the precalculated numerical statistics.

11 . A computer-implemented system for generating, verifying and providing information in an interactive graphical user interface, the system comprising:

at least one computing device including a memory accessing instructions stored on non-transitory processor readable media that, when executed configure the at least one computing device to:

receive a plurality of transactional data records, each of the plurality of data records having a plurality of data attributes;

automatically classify:

at least one of the plurality of transactional data records into one or more classes of a first classification, as a function of the data attributes; and

the at least one of the plurality of transactional data records into one or more classes of a second classification, as a function of the data attributes and the first classification;

receiving, by the at least one computing device via the graphical user interface, a user selection of a class of the first classification;

dynamically generating, in response to the user selection, a plurality of text summaries, each including the one or more classes of the second classification for the at least one of the plurality of transactional data records having data attributes associated with the user selection, wherein generating each respective one of the text summaries includes:

automatically generating, by the at least one computing device, a prompt for a text summary of the selected class and the at least one class of the second classification;

providing the generated prompt to a text generator model; and

receiving, from the text generator model in response to the prompt, the generated respective text summary;

automatically verifying, by the at least one computing device that data present in each of the plurality of generated text summaries are present in all of the plurality of generated text summaries;

providing, by the at least one computing device, at least one of plurality of the generated text summaries via the graphical user interface;

providing, via the graphical user interface, a graphic representation for the selected class;

providing, by the at least one computing device via the graphical user interface, the received plurality of transactional data records as tabular data; and

displaying, via the graphical user interface, the at least one of the plurality of the generated text summaries, the graphic representation, and the tabular data, including by highlighting part or parts of the at least one of the plurality of the generated text summaries, wherein the part or parts correspond to a class or classes from the second classification attributed to the received data records having been attributed the selected class.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2024
From: EVANGELHO FELICIANO, BEATRIZ; LIÉBANA DE LA BARRERA, JAVIER; DE OLIVEIRA VIEIRA ALVES, LEONARDO; MARQUES COSTA, RITA; RAMALHO DUARTE, DIOGO; SANTOS RODRIGUES BIZARRO, PEDRO GUSTAVO
To: FEEDZAI - CONSULTADORIA E INOVAÇÃO TECNOLÓGICA, S.A.
Reel/Frame 068451/0521 →
Priority Claims (2)
PT 119437 · Apr 29, 2024 · national
PT 119445 · May 2, 2024 · national
Continuity (1)
Related Publication 20250335489A1 · Oct 30, 2025
References Cited (62)
US 8060423B1 · Rukonic · 2011 [cited by examiner]
US 11170375B1 · Kramme · 2021 [cited by examiner]
US 20150026027A1 · Priess · 2015 [cited by examiner]
US 20160314146A1 · Carothers · 2016 [cited by examiner]
US 20180027006A1 · Zimmermann · 2018 [cited by examiner]
US 20210073819A1 · Hernandez · 2021 [cited by examiner]
US 20210211443A1 · Sullivan · 2021 [cited by examiner]
US 20220129923A1 · Kelton · 2022 [cited by examiner]
US 20240086815A1 · Galow · 2024 [cited by examiner]
US 20240249081A1 · UzZaman · 2024 [cited by examiner]
US 20240338378A1 · Setlur · 2024 [cited by examiner]
US 20250061291A1 · Gardner · 2025 [cited by examiner]
Holistic evaluation of language models (HELM). https://crfm.stanford.edu/helm/lite/latest/#/ leaderboard. Accessed: Apr. 16, 2024. [4 pages]. [cited by applicant]
Alvi et al. “Deep learning approach on tabular data to predict early-onset neonatal sepsis”, Journal of Information and Telecommunication, 5(2):226-246, 2021. [22 pages]. [cited by applicant]
Amarasinghe et al. “On the importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods”, In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, pp. 20921-20929, 2024.… [cited by applicant]
Branco et al. “Interleaved sequence RNNs for fraud detection”, In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD '20, p. 3101-3109, New York, NY, USA, 2020. Associa… [cited by applicant]
Cao et al. “Targetvue: Visual analysis of anomalous user behaviors in online communication systems”, IEEE Transactions on Visualization and Computer Graphics, 22(1):280-289, 2016. [10 pages]. [cited by applicant]
Cobbe et al. “Training verifiers to solve math word problems”, arXiv preprint arXiv:2110.14168, 2021. [22 pages]. [cited by applicant]
De-Arteaga et al. “A case for humans-in-the-loop: Decisions in the presence of erroneous algorithmic scores”, In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-12, 2020. [cited by applicant]
DOI. “Effective highlighting modes of graphical user interfaces in visual information search”, Universal Access in the Information Society, 22(1):111-119, Jul. 2023. [cited by applicant]
Fernandes et al. “Bridging the gap: A survey on integrating (human) feedback for natural language generation”, Transactions of the Association for Computational Linguistics, 11:1643-1668, 2023. [cited by applicant]
Gao et al. “Retrieval-augmented generation for large language models: A survey”, arXiv preprint arXiv:2312.10997, 2023. [cited by applicant]
Heer et al. “Interactive dynamics for visual analysis”, Commun. ACM, 55(4):45-54, Apr. 2012. [cited by applicant]
Holtzman et al. “The curious case of neural text degeneration”, arXiv preprint arXiv: 1904.09751, 2019. [cited by applicant]
Hopkins et al. “Visualint: Sketchy in situ annotations of chart construction errors”, Computer Graphics Forum, 39(3):219-228, Jul. 2020. [cited by applicant]
Hu et al. “Dive: A mixed-initiative system supporting integrated data exploration workflows”, In Proceedings of the Workshop on Human-In-the-Loop Data Analytics, HILDA '18, New York, NY, USA, Jun. 2018. Association for … [cited by applicant]
Jin et al. “What disease does this patient have? a large-scale open domain question answering dataset from medical exams”, Applied Sciences, 11(14):6421, 2021. [cited by applicant]
Kandpal et al. “Large language models struggle to learn long-tail knowledge”, In International Conference on Machine Learning, pp. 15696-15707. PMLR, 2023. [cited by applicant]
Keim et al. “Visual Analytics: Scope and Challenges”, pp. 76-90. Springer Berlin Heidelberg, Berlin, Heidelberg, 2008. [cited by applicant]
Kielman et al. “Foundations and frontiers in visual analytics”, Information Visualization, 8(4):239-246, Dec. 2009. [cited by applicant]
Kinkeldey et al. “BitConduite: Visualizing and Analyzing Activity on the Bitcoin Network”, In A. P. Puig and T. Isenberg, editors, EuroVis 2017—Posters. The Eurographics Association, 2017. [cited by applicant]
Kute et al. “Deep learning and explainable artificial intelligence techniques applied for detecting money laundering—a critical review”, IEEE Access, 9:82300-82317, 2021. [cited by applicant]
Kwiatkowski et al. “Natural questions: A benchmark for question answering research”, Transactions of the Association for Computational Linguistics, 7:453-466, 2019. [14 pages]. [cited by applicant]
Law et al. “Characterizing automated data insights”, In 2020 IEEE Visualization Conference (VIS), pp. 171-175, Oct. 2020. [5 pages]. [cited by applicant]
Lee et al. “Avoiding drill-down fallacies with VisPilot: assisted exploration of data subsets”, IUI '19, p. 186-196, New York, NY, USA, Mar. 2019. Association for Computing Machinery. [11 pages]. [cited by applicant]
Lee et al. “Factuality enhanced language models for open-ended text generation”, Advances in Neural Information Processing Systems, 35:34586-34599, 2022. [14 pages]. [cited by applicant]
Leite et al. “Visual analytics for event detection: Focusing on fraud”, Visual Informatics, 2(4):198-212, Dec. 2018. [15 pages]. [cited by applicant]
Leite et al. “EVA: Visual analytics to identify fraudulent events”, IEEE Transactions on Visualization and Computer Graphics, 24(1):330-339, 2018. [10 pages]. [cited by applicant]
Lewis et al. “Retrieval-Augmented Generation for Knowledge-Intensive NLP tasks”, Advances in Neural Information Processing Systems, 33:9459-9474, 2020. [16 pages]. [cited by applicant]
Liang et al. “Holistic evaluation of language models”, arXiv preprint arXiv:2211.09110, 2022. [162 pages]. [cited by applicant]
Lin et al. “TruthfulQA: Measuring how models mimic human falsehoods”, arXiv preprint arXiv:2109.07958, 2021. [39 pages]. [cited by applicant]
Liu et al. “Mtv: Visual analytics for detecting, investigating, and annotating anomalies in multivariate time series”, Proc. ACM Hum.-Comput. Interact., 6(CSCW1), Apr. 2022. [30 pages]. [cited by applicant]
Lundberg et al. “A unified approach to interpreting model predictions”, Advances in neural information processing systems, 30, 2017. [10 pages]. [cited by applicant]
Ma{tilde over (ç)}ãs et al. “GlyphSOMe: Using SOM with data glyphs for customer profiling”, In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applicat… [cited by applicant]
Ma{tilde over (ç)}ãs et al. “ATOVis—a visualisation tool for the detection of financial fraud”, Information Visualization, 21(4):371-392, 2022. [22 pages]. [cited by applicant]
Manakul et al. “SelfcheckGPT: Zero-resource black-box hallucination detection for generative large language models”, arXiv preprint arXiv:2303.08896, 2023. [14 pages]. [cited by applicant]
Mu et al. “MOOCad: Visual Analysis of Anomalous Learning Activities in Massive Open Online Courses”, In J. Johansson, F. Sadlo, and G. E. Marai, editors, EuroVis 2019—Short Papers. The Eurographics Association, 2019. [5… [cited by applicant]
Nguyen et al. “Vasabi: Hierarchical user profiles for interactive visual user behaviour analytics”, IEEE Transactions on Visualization and Computer Graphics, 26(1):77-86, 2020. [12 pages]. [cited by applicant]
Obeid et al. “Chart-to-text: Generating natural language descriptions for charts by adapt ing the transformer model”, In Proceedings of the 13th International Conference on Natural Language Generation, pp. 138-147. Asso… [cited by applicant]
Open AI. “Gpt-4 technical report”, arXiv preprint arXiv:2303.08774, 2023. [100 pages]. [cited by applicant]
Ramaiya et al. “A colossal $159 billion lost to fraud and scams, finds new research from Feedzai and the Global Anti-Scam Alliance”, Feb. 2024. [cited by applicant]
Ribeiro et al. “why should i trust you?” explaining the predictions of any classifier, In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135-1144, 2016. [10 page… [cited by applicant]
Rzeszotarski et al. “Crowdscape: interactively visualizing user behavior and output”, In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, p. 55-62, New York, NY, USA, 201… [cited by applicant]
Sheikh et al. “An approach for prediction of loan approval using machine learning algorithm”, In 2020 international conference on electronics and sustainable communication systems (ICESC), pp. 490-494. IEEE, 2020. [cited by applicant]
Silva et al. “Visualisation tool to support fraud detection”, In 2021 25th International Conference Information Visualisation (IV), pp. 77-87, 2021. [cited by applicant]
Strobelt et al. “Guidelines for effective usage of text highlighting techniques”, IEEE Transactions on Visualization and Computer Graphics, 22(1):489-498, Jan. 2016. [10 pages]. [cited by applicant]
Sultanum et al. “Datatales: Investigating the use of large language models for authoring data-driven articles”, In 2023 IEEE Visualization and Visual Analytics (VIS), pp. 231-235, Oct. 2023. [5 pages]. [cited by applicant]
Tang et al. “Vistext: A benchmark for semantically rich chart captioning”, arXiv preprint arXiv:2307.05356, Jun. 2023. [29 pages]. [cited by applicant]
Touvron et al. “Llama: Open and efficient foundation language models”, arXiv preprint arXiv:2302.13971, 2023. [27 pages]. [cited by applicant]
Wei et al. “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models”, 36th Conference on Neural Information Processing Systems (NeurIPS 2022). [14 pages]. [cited by applicant]
Zhang et al. “Siren's song in the ai ocean: a survey on hallucination in large language models”, arXiv preprint arXiv:2309.01219, 2023. [33 pages]. [cited by applicant]
Zhao et al. “#fluxflow: Visual analysis of anomalous information spreading on social media”, IEEE Transactions on Visualization and Computer Graphics, 20(12):1773-1782, 2014. [10 pages]. [cited by applicant]