Browse by author
Lookup NU author(s): Jonathan DowlandORCiD, Professor Paul WatsonORCiD, Dr Adam Cattermole
We present a vision for the automatic optimisation of distributed stream processing programs. StrIoT --- a distributed stream-processing framework built using purely-functional programming --- enables a set of validated logical optimisation rules to generate a set of possible deployment plans. A cost model then filters and ranks the plans before the best is automatically deployed across the cloud and edge devices. We describe StrIoT's functional operators for writing stream-processing programs; the design, implementation and performance of StrIoT's logical optimiser; and the cost model, which filters and ranks re-written programs and deployment plans in terms of two non-functional requirements: bandwidth and cost. The StrIoT vision is being explored through an open-source proof-of-concept implementation. We present our initial results with a motivating example before outlining the success criteria for future work in this area.
Author(s): Dowland J, Watson P, Cattermole A
Publication type: Conference Proceedings (inc. Abstract)
Publication status: Published
Conference Name: 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC)
Year of Conference: 2022
Pages: 267-272
Print publication date: 14/03/2023
Acceptance date: 15/10/2022
Date deposited: 01/03/2023
Publisher: IEEE/ACM
URL: https://doi.org/10.1109/UCC56403.2022.00048
DOI: 10.1109/UCC56403.2022.00048
ePrints DOI: 10.57711/46ed-sq75
Library holdings: Search Newcastle University Library for this item
ISBN: 9781665460873
