IP Library Granted Patent US 12,223,265
Granted Patent B2
US 12,223,265 · App. 17/855,248 · Granted Feb 11, 2025

Explainable propaganda detection

Inventors: Preslav I. Nakov (Doha, QA); Giovanni Da San Martino (Doha, QA); Seunghak Yu (Doha, QA)
Assignees: QATAR FOUNDATION FOR EDUCATION, SCIENCE AND COMMUNITY DEVELOPMENT; MASSACHUSETTS INSTITUTE OF TECHNOLOGY
G06F40/205G06F3/04842G06F40/289
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,265
App. No.
17/855,248
Granted
Feb 11, 2025
Kind
B2
Abstract

Explainable propaganda detection is provided by parsing each sentence of a plurality of sentences in an article for structural details; identifying, via a machine learning model, dimensional features across the plurality of sentences based on the structural details; identifying, via the machine learning model, a propagandizing tactic demonstrated in each sentence of the plurality of sentences based a covariance score to the propagandizing tactic and the plurality of dimensional features identified for a given sentence; and displaying, in a user interface that includes the article, propaganda labels corresponding to the propagandizing tactic identified for each sentence of the plurality of sentences.

Claims (132)

1. A method, comprising:

parsing each sentence of a plurality of sentences in an article for structural details, wherein the plurality of sentences represent a threshold number of sentences selected from a beginning of the article;

identifying, via a machine learning model, dimensional features across the plurality of sentences based on the structural details;

identifying, via the machine learning model, a propagandizing tactic demonstrated in each sentence of the plurality of sentences based on a covariance score to the propagandizing tactic and the dimensional features identified for a given sentence; and

displaying, in a user interface that includes the article, propaganda labels corresponding to the propagandizing tactic identified for each sentence of the plurality of sentences.

2. The method of claim 1 , wherein the propagandizing tactic is selected by the machine learning model from a list comprising:

name calling;

repetition;

slogans;

appeal to fear;

doubt;

exaggeration;

flag-waving;

loaded language;

association with an out-group;

bandwagon;

casual oversimplification;

obfuscation;

appeal to authority;

binary fallacy;

thought-terminating clichés;

red herrings;

strawman arguments;

whataboutisms; and

none.

3. The method of claim 2 , further comprising, in response to receiving a veracity selection from a user to include the veracity of information included in the sentence when identifying the propagandizing tactic demonstrated in each sentence of the plurality of sentences:

identifying whether statements included in each of the sentences of the plurality of sentences are true or false;

categorizing any sentences of the plurality of sentences that includes a false statement demonstrating a lying propagandizing tactic; and

selecting the propagandizing tactic for any sentences of the plurality of sentences that exclude false statements from the list.

4. The method of claim 2 , further comprising, in response to receiving a veracity selection from a user to ignore the veracity of information included in the sentence when identifying the propagandizing tactic demonstrated in each sentence of the plurality of sentences:

categorizing false statements identically to true statements when selecting the propagandizing tactic from the list.

5. The method of claim 1 , wherein the dimensional features include:

a relative position of a given sentence in the article relative to other sentences;

a semantic stance of the given sentence relative to a title of the article;

a sentiment of the given sentence; and

an article-level prediction of the article as a whole being propaganda.

6. The method of claim 5 , wherein the semantic stance is selected from a group including:

related agreeing;

related disagreeing;

related discussing; and

unrelated.

7. The method of claim 5 , wherein the sentiment is selected from a group including:

positive;

negative;

neutral; and

compound.

8. A system, comprising:

a processor; and

a memory, that includes instructions that when executed by the processor perform operations, including:

parsing each sentence of a plurality of sentences in an article for structural details, wherein the plurality of sentences represent a threshold number of sentences selected from a beginning of the article;

identifying, via a machine learning model, dimensional features across the plurality of sentences based on the structural details;

identifying, via the machine learning model, a propagandizing tactic demonstrated in each sentence of the plurality of sentences based on a covariance score to the propagandizing tactic and the dimensional features identified for a given sentence; and

displaying, in a user interface that includes the article, propaganda labels corresponding to the propagandizing tactic identified for each sentence of the plurality of sentences.

9. The system of claim 8 , wherein the propagandizing tactic is selected by the machine learning model from a list comprising:

name calling;

repetition;

slogans;

appeal to fear;

doubt;

exaggeration;

flag-waving;

loaded language;

association with an out-group;

bandwagon;

casual oversimplification;

obfuscation;

appeal to authority;

binary fallacy;

thought-terminating clichés;

red herrings;

strawman arguments;

whataboutisms; and

none.

10. The system of claim 9 , further comprising, in response to receiving a veracity selection from a user to ignore the veracity of information included in the sentence when identifying the propagandizing tactic demonstrated in each sentence of the plurality of sentences:

categorizing false statements identically to true statements when selecting the propagandizing tactic from the list.

11. The system of claim 8 , wherein the dimensional features include:

a relative position of a given sentence in the article relative to other sentences;

a semantic stance of the given sentence relative to a title of the article;

a sentiment of the given sentence; and

an article-level prediction of the article as a whole being propaganda.

12. The system of claim 11 , wherein the semantic stance is selected from a group including:

related agreeing;

related disagreeing;

related discussing; and

unrelated.

13. The system of claim 11 , wherein the sentiment is selected from a group including:

positive;

negative;

neutral; and

compound.

14. A memory apparatus that includes instructions that when executed by a processor perform operations, comprising:

parsing each sentence of a plurality of sentences in an article for structural details, wherein the plurality of sentences represent a threshold number of sentences selected from a beginning of the article;

identifying, via a machine learning model, dimensional features across the plurality of sentences based on the structural details;

identifying, via the machine learning model, a propagandizing tactic demonstrated in each sentence of the plurality of sentences based on a covariance score to the propagandizing tactic and the dimensional features identified for a given sentence; and

displaying, in a user interface that includes the article, propaganda labels corresponding to the propagandizing tactic identified for each sentence of the plurality of sentences.

15. The memory apparatus of claim 14 , wherein the propagandizing tactic is selected by the machine learning model from a list comprising:

name calling;

repetition;

slogans;

appeal to fear;

doubt;

exaggeration;

flag-waving;

loaded language;

association with an out-group;

bandwagon;

casual oversimplification;

obfuscation;

appeal to authority;

binary fallacy;

thought-terminating clichés;

red herrings;

strawman arguments;

whataboutisms; and

none.

16. The memory apparatus of claim 15 , the operations further comprising, in response to receiving a veracity selection from a user to ignore the veracity of information included in the sentence when identifying the propagandizing tactic demonstrated in each sentence of the plurality of sentences:

categorizing false statements identically to true statements when selecting the propagandizing tactic from the list.

17. The memory apparatus of claim 14 , wherein the dimensional features include:

a relative position of a given sentence in the article relative to other sentences;

a semantic stance of the given sentence relative to a title of the article;

a sentiment of the given sentence; and

an article-level prediction of the article as a whole being propaganda.

18. The memory apparatus of claim 17 , wherein the semantic stance is selected from a group including:

related agreeing;

related disagreeing;

related discussing; and

unrelated.

19. The memory apparatus of claim 17 , wherein the sentiment is selected from a group including:

positive;

negative;

neutral; and

compound.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2025
From: QATAR FOUNDATION FOR EDUCATION, SCIENCE & COMMUNITY DEVELOPMENT
To: HAMAD BIN KHALIFA UNIVERSITY
Reel/Frame 069936/0656 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2024
From: NAKOV, PRESLAV I.; SAN MARTINO, GIOVANNI DA
To: QATAR FOUNDATION FOR EDUCATION, SCIENCE AND COMMUNITY DEVELOPMENT
Reel/Frame 066018/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: YU, SEUNGHAK
To: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Reel/Frame 065554/0673 →
Continuity (2)
Provisional Application 63216945 · Jun 30, 2021
Related Publication 20230004712A1 · Jan 5, 2023
References Cited (19)
US 8296168B2 · Subrahmanian et al. · 2012 [cited by applicant]
US 9189540B2 · Hailpern et al. · 2015 [cited by applicant]
US 9727925B2 · Subramanian et al. · 2017 [cited by applicant]
US 20170116204A1 · Davulcu · 2017 [cited by examiner]
US 20180225275A1 · Oleynikov · 2018 [cited by examiner]
US 20180285342A1 · Chew · 2018 [cited by examiner]
US 20180365562A1 · Volkova · 2018 [cited by examiner]
US 20190034823A1 · Thapliyal · 2019 [cited by examiner]
US 20190179956A1 · Krasadakis · 2019 [cited by examiner]
US 20200202071A1 · Ghulati · 2020 [cited by examiner]
US 20220164643A1 · Charnock · 2022 [cited by examiner]
US 20220199070A1 · Hsu · 2022 [cited by examiner]
US 20240185062A1 · Charnock · 2024 [cited by examiner]
Devlin, Jacob, et al. “Bert: Pre-training of deep bidirectional transformers for language understanding.” arXiv preprint arXiv:1810.04805 (2018). (Year: 2018). [cited by examiner]
Yu, Seunghak, et al. “Interpretable propaganda detection in news articles.” arXiv preprint arXiv:2108.12802 (2021). (Year: 2021). [cited by examiner]
Da San Martino, Giovanni, et al. “Fine-grained analysis of propaganda in news article.” Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference o… [cited by examiner]
Nanavati et al., “Identifying Propaganda in Online News Articles Using a Cross-Disciplinary Approach”, Workshop on Bias, Disinformation, Misinformation, and Propaganda in Online New and Social Media at Socinfo (2019), H… [cited by applicant]
Rashkin et al., “Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking”, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (2017), Copenhagen, Denmark,… [cited by applicant]
Recasens et al., “Linguistic Models for Analyzing and Detecting Biased Language”, Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (2013), Sofia, Bulgaria, Association for Computat… [cited by applicant]