Toggle Main Menu Toggle Search

Open Access padlockePrints

Optimization of Echo State Networks by Covariance Matrix Adaption Evolutionary Strategy

Lookup NU author(s): Dr Kai Liu, Dr Jie ZhangORCiD


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Echo state networks (ESNs) have been shown to be an effective alternative to conventional recurrent neuralnetworks due to its simple training process and good fitting performance of time series modelling tasks. In the primary ESN principle, the random setting of reservoir is considered to be the main advantage of ESN. However, because of the randomly generated connectivity and weight parameters, appropriate setting of the structural parameters which can significantly influence the modelling accuracy is considered a key issue in building ESN models. Evolutionary Strategy (ES) has been shown being a powerful stochastic global optimization method. Moreover, covariance matrix adaption evolutionary strategy (CMA-ES) is an artistically and parallel search method which transforms the searching covariance matrix to guide the best search direction. This paper proposes a CMA-ES-ESN method to optimize several structural parameters of an ESN such as reservoir size, leak rate and spectral radius factor. Finally, the results are compared with those from the original ESN and GA-ESN, ESN optimized by genetic algorithm.

Publication metadata

Author(s): Liu K, Zhang J

Editor(s): Xiandong Ma

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: 24th International Conference on Automation and Computing (ICAC 2018)

Year of Conference: 2018

Pages: 677-682

Online publication date: 01/07/2019

Acceptance date: 14/06/2018

Publisher: IEEE


DOI: 10.23919/IConAC.2018.8749124

Library holdings: Search Newcastle University Library for this item

ISBN: 9781862203419