Toggle Main Menu Toggle Search

Open Access padlockePrints

RMAAC: Joint Markov Games and Robust Multiagent Actor-Critic for Explainable Malware Defense in Social IoT

Lookup NU author(s): Yizhou Shen

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

© 2004-2012 IEEE.The end-edge-cloud-based Social Internet of Things (SIoT) faces increasing threats from malware. To address these challenges, we propose an explainable novel malware defense framework that integrates Markov games with multi-agent deep reinforcement learning under an end-edge-cloud-based SIoT collaborative architecture. The framework models the interactions between malicious SIoT nodes and edge devices as a multi-agent game problem, incorporating multi-layer defense mechanisms to achieve precise descriptions of attack-defense behaviors. By combining Markov games with the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, we develop the Robust Multiagent Actor-Critic (RMAAC) algorithm, which enables adaptive strategy optimization. To enhance system interpretability, we introduce SHapley Additive exPlanations (SHAP) value analysis into the defense decision-making process, providing transparent insights into feature contributions and decision rationales. Extensive experimental results demonstrate that the proposed RMAAC algorithm significantly outperforms existing methods, including MADDPG and Minimax Multi-Agent Deep Deterministic Policy Gradient (M3DDPG), in multiple performance metrics such as episode reward, hacking success rate, and cumulative defense number. Through systematic parameter optimization, including batch size and agent interaction speed, the framework provides an effective and sustainable solution for explainable malware defense in SIoT environments.


Publication metadata

Author(s): Shen S, Hong T, Shen Y, Wu X, Dong J, Wu J

Publication type: Article

Publication status: Published

Journal: IEEE Transactions on Dependable and Secure Computing

Year: 2025

Volume: 22

Issue: 6

Pages: 7091-7106

Print publication date: 01/11/2025

Online publication date: 04/08/2025

Acceptance date: 02/04/2018

ISSN (print): 1545-5971

ISSN (electronic): 1941-0018

Publisher: Institute of Electrical and Electronics Engineers Inc.

URL: https://doi.org/10.1109/TDSC.2025.3595097

DOI: 10.1109/TDSC.2025.3595097


Altmetrics

Altmetrics provided by Altmetric


Share