Toggle Main Menu Toggle Search

Open Access padlockePrints

Automatic Sentiment Analysis of Citizen Comments: The Case of the Albania Earthquake

Lookup NU author(s): Professor Sean WilkinsonORCiD

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

© 2026 by the authors.Collecting and analysing data after an earthquake is essential to determine its impact. In 2014, the European Mediterranean Seismological Centre launched the LastQuake system. Its app collects reports on the intensity users feel, along with comments that provide situational awareness. However, text data collected through crowdsourcing platforms is unstructured. Therefore, natural language processing techniques such as sentiment analysis and aspect-based sentiment analysis are necessary to extract meaningful information. On the 26 November 2019, following an earthquake in Albania, the LastQuake app recorded 28,220 reports with user comments. For the current analysis, we sampled comments posted on the exact day of the earthquake, in Albanian: 1678 comments (6%). The most frequent polarity detected in comments from LastQuake app users was negative (52%), followed by positive and neutral. However, manual classification is time-consuming and not feasible during the emergency phase. Therefore, we tested the accuracy of two automatic classification models for sentiment analysis: ‘troberta’ and ‘txlm’. These models were fine-tuned using already-classified text data from the 2020 Aegean earthquake. Using the manual classification as the reference to evaluate the accuracy of the automatic classification models for sentiment analysis yields accuracies of 71% for the ‘troberta’ model and 56% for the ‘txlm’ model.


Publication metadata

Author(s): Contreras D, Veliu E, Antypas D, Hervas J, Landes M, Fallou L, Koxhaj D, Bossu R, Wilkinson S, Camacho-Collados J, Dushi E

Publication type: Article

Publication status: Published

Journal: GeoHazards

Year: 2026

Volume: 7

Issue: 2

Online publication date: 27/05/2026

Acceptance date: 19/05/2026

Date deposited: 13/07/2026

ISSN (electronic): 2624-795X

Publisher: Multidisciplinary Digital Publishing Institute (MDPI)

URL: https://doi.org/10.3390/geohazards7020062

DOI: 10.3390/geohazards7020062

Data Access Statement: The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.


Altmetrics

Altmetrics provided by Altmetric


Funding

Funder referenceFunder name
EP/P025641/1EPSRC

Share