Toggle Main Menu Toggle Search

Open Access padlockePrints

Logical Optimisation and Cost Modelling of Stream-Processing Programs Written in a Purely-Functional Framework

Lookup NU author(s): Jonathan DowlandORCiD, Professor Paul WatsonORCiD, Dr Adam Cattermole

Downloads


Abstract

We present a vision for the automatic optimisation of distributed stream processing programs. StrIoT --- a distributed stream-processing framework built using purely-functional programming --- enables a set of validated logical optimisation rules to generate a set of possible deployment plans. A cost model then filters and ranks the plans before the best is automatically deployed across the cloud and edge devices. We describe StrIoT's functional operators for writing stream-processing programs; the design, implementation and performance of StrIoT's logical optimiser; and the cost model, which filters and ranks re-written programs and deployment plans in terms of two non-functional requirements: bandwidth and cost. The StrIoT vision is being explored through an open-source proof-of-concept implementation. We present our initial results with a motivating example before outlining the success criteria for future work in this area.


Publication metadata

Author(s): Dowland J, Watson P, Cattermole A

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC)

Year of Conference: 2022

Pages: 267-272

Print publication date: 14/03/2023

Acceptance date: 15/10/2022

Date deposited: 01/03/2023

Publisher: IEEE/ACM

URL: https://doi.org/10.1109/UCC56403.2022.00048

DOI: 10.1109/UCC56403.2022.00048

ePrints DOI: 10.57711/46ed-sq75

Library holdings: Search Newcastle University Library for this item

ISBN: 9781665460873


Share