Toggle Main Menu Toggle Search

Open Access padlockePrints

Novel Intrusion Detection Strategies With Optimal Hyper Parameters for Industrial Internet of Things Based On Stochastic Games and Double Deep Q-Networks

Lookup NU author(s): Yizhou Shen

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

IEEEThe Industrial Internet of Things (IIoT) has experienced rapid growth in recent years, with an increasing number of interconnected devices, thereby expanding the attack surface. Effectively detecting intrusions is crucial for safeguarding IIoT systems from malicious attacks. However, due to the dynamic and complex nature of the IIoT environment, designing an intrusion detection strategy that balances accuracy and efficiency remains a significant challenge. In this paper, we propose a novel intrusion detection strategy based on stochastic games and deep reinforcement learning (DRL) for detecting attacks effectively while balancing detection accuracy and efficiency in the IIoT. We model the interaction between attackers and detectors as dynamic adversarial stochastic games with incomplete information, theoretically analyze Nash equilibria, and construct a node-based simulation of interconnected infrastructure within the IIoT. We then propose a novel algorithm DDQN-LP combining Double Deep Q-Networks with “lazy penalty” to determine optimal strategies and encourage agents to promptly conclude the game to reduce overhead. Furthermore, we identify different optimal hyperparameters for training our DRL agents and evaluate their efficacy both theoretically and empirically. We compare our proposed algorithm with other reinforcement learning algorithms, and simulations demonstrate our approach has better performance with a higher detection rate as well as lower consumption.


Publication metadata

Author(s): Yu S, Wang X, Shen Y, Wu G, Yu S, Shen S

Publication type: Article

Publication status: Published

Journal: IEEE Internet of Things Journal

Year: 2024

Issue: ePub ahead of Print

Online publication date: 28/05/2024

Acceptance date: 02/04/2018

ISSN (print): 2576-3180

ISSN (electronic): 2327-4662

Publisher: IEEE

URL: https://doi.org/10.1109/JIOT.2024.3406386

DOI: 10.1109/JIOT.2024.3406386


Altmetrics

Altmetrics provided by Altmetric


Share