Toggle Main Menu Toggle Search

Open Access padlockePrints

A new gradient descent approach for local learning of fuzzy neural models

Lookup NU author(s): Dr Wanqing ZhaoORCiD


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


The majority of reported learning methods for Takagi-Sugeno-Kang (TSK) fuzzy neural models to date mainly focus on improvement of their accuracy. However, one of the key design requirements in building an interpretable fuzzy model is that each obtained rule consequent must match well with the system local behavior when all the rules are aggregated to produce the overall system output. This is one of the distinctive characteristics from black-box models such as neural networks. Therefore, how to find a desirable set of fuzzy partitions and, hence, identify the corresponding consequent models which can be directly explained in terms of system behavior, presents a critical step in fuzzy neural modeling. In this paper, a new learning approach considering both nonlinear parameters in the rule premises and linear parameters in the rule consequents is proposed. Unlike the conventional two-stage optimization procedure widely practiced in the field where the two sets of parameters are optimized separately, the consequent parameters are transformed into a dependent set on the premise parameters, thereby enabling the introduction of a new integrated gradient descent learning approach. Thus, a new Jacobian matrix is proposed and efficiently computed to achieve a more accurate approximation of the cost function by using the second-order Levenberg-Marquardt optimization method. Several other interpretability issues regarding the fuzzy neural model are also discussed and integrated into this new learning approach. Numerical examples are presented to illustrate the resultant structure of the fuzzy neural models and the effectiveness of the proposed new algorithm, and compared with the results from some well-known methods. © 2012 IEEE.

Publication metadata

Author(s): Zhao W, Li K, Irwin GW

Publication type: Article

Publication status: Published

Journal: IEEE Transactions on Fuzzy Systems

Year: 2013

Volume: 21

Issue: 1

Pages: 30-44

Print publication date: 01/02/2013

Online publication date: 22/05/2012

ISSN (print): 1063-6706

ISSN (electronic): 1941-0034

Publisher: IEEE


DOI: 10.1109/TFUZZ.2012.2200900


Altmetrics provided by Altmetric