Toggle Main Menu Toggle Search

Open Access padlockePrints

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Lookup NU author(s): Dr Bin Qian, Professor Raj Ranjan

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

IEEEStreaming video analytics focuses on the real-time analysis of streaming video data from multiple resources, such as security cameras, and IoT devices with video capabilities. It involves applications of various techniques to extract valuable information from live video streams. Edge computing and cloud computing facilitate video stream analytics by utilizing computation resources across both ends, enabling both high accuracy and low latency. However, video streaming behaviours are dynamic and constantly evolving across the edge and the cloud. The network conditions, computing resources, and video content can change rapidly, making it crucial to continuously adjust the analytics methods to provide accurate results. Previous works both based on deep neural networks (DNNs) or heuristic algorithms learn a suitable deployment plan for streaming video analytics applications from historical data or synthetic data and therefore are not able to capture the dynamics. Hence, we propose reinforcement learning-based methods that can adapt to ongoing changes in video streaming behaviours. To ensure the scalability of video analytics in distributed environments, we implement OSMOTICGATE2, a distributed streaming video analytics system that features optimized processing pipelines and multi-agent RL-based controllers for fast adapting the system configurations across the edge and the cloud. Experiments on a real testbed show that our method outperforms baselines, assuring real-time video analysis and high accuracy in dynamic and distributed environments.


Publication metadata

Author(s): Qian B, Xuan Y, Wu D, Wen Z, Yang R, He S, Chen J, Ranjan R

Publication type: Article

Publication status: Published

Journal: IEEE Network

Year: 2024

Pages: epub ahead of print

Online publication date: 09/05/2024

Acceptance date: 02/04/2024

ISSN (print): 0890-8044

ISSN (electronic): 1558-156X

Publisher: Institute of Electrical and Electronics Engineers Inc.

URL: https://doi.org/10.1109/MNET.2024.3398724

DOI: 10.1109/MNET.2024.3398724


Altmetrics

Altmetrics provided by Altmetric


Share