Classification of Fake News by Fine-tuning Deep Bidirectional Transformers based Language Model

Aggarwal, Akshay and Chauhan, Aniruddha and Kumar, Deepika and Mittal, Mamta and Verma, Sharad (2020) Classification of Fake News by Fine-tuning Deep Bidirectional Transformers based Language Model. EAI Endorsed Transactions on Scalable Information Systems, 7 (27): e10. ISSN 2032-9407

[thumbnail of eai.13-7-2018.163973.pdf]
eai.13-7-2018.163973.pdf - Published Version
Available under License Creative Commons Attribution No Derivatives.

Download (2MB) | Preview


With the ever-increasing rate of information dissemination and absorption, “Fake News” has become a real menace. People these days often fall prey to fake news that is in line with their perception. Checking the authenticity of news articles manually is a time-consuming and laborious task, thus, giving rise to the requirement for automated computational tools that can provide insights about degree of fake ness for news articles. In this paper, a Natural Language Processing (NLP) based mechanism is proposed to combat this challenge of classifying news articles as either fake or real. Transfer learning on the Bidirectional Encoder Representations from Transformers (BERT) language model has been applied for this task. This paper demonstrates how even with minimal text pre-processing, the fine-tuned BERT model is robust enough to perform significantly well on the downstream task of classification of news articles. In addition, LSTM and Gradient Boosted Tree models have been built to perform the task and comparative results are provided for all three models. Fine-tuned BERT model could achieve an accuracy of 97.021% on NewsFN data and is able to outperform the other two models by approximately eight percent.

Item Type: Article
Uncontrolled Keywords: Fake news, Transfer learning, Deep learning, Natural language processing
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
QA75 Electronic computers. Computer science
Depositing User: EAI Editor II.
Date Deposited: 22 Oct 2020 12:32
Last Modified: 22 Oct 2020 12:32

Actions (login required)

View Item
View Item