Toggle Main Menu Toggle Search

Open Access padlockePrints

From arithmetic to logic based AI: A comparative analysis of neural networks and tsetlin machine

Lookup NU author(s): Jie lei, Adrian Wheeldon, Dr Rishad Shafik, Professor Alex Yakovlev


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


© 2020 IEEE.Neural networks constitute a well-established design method for current and future generations of artificial intelligence. They depends on regressed arithmetic between perceptrons organized in multiple layers to derive a set of weights that can be used for classification or prediction. Over the past few decades, significant progress has been made in low-complexity designs enabled by powerful hardware/software ecosystems. Built on the foundations of finite-state automata and game theory, Tsetlin Machine is increasingly gaining momentum as an emerging artificial intelligence design method. It is fundamentally based on propositional logic based formulation using booleanized input features. Recently developed Tsetlin Machine hardware architecture has demonstrated competitive performance and accuracy as well as opportunities for by-design energy efficiency and explainability. In this paper, we investigate these two architectures closely and perform a comprehensive, comparative analysis considering their architectural subtleties implemented in low-level C language and ignoring any specialized implementations. We study the impact of hyperparameters on both arithmetic and logic basis of learning in terms of performance, accuracy and energy efficiency. We show that Tsetln Machine consistently outperforms artificial neural network in terms of learning convergence and energy efficiency by up to 15×at the cost of higher energy consumption per epoch.

Publication metadata

Author(s): Lei J, Wheeldon A, Shafik R, Yakovlev A, Granmo O-C

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: ICECS 2020 - 27th IEEE International Conference on Electronics, Circuits and Systems, Proceedings

Year of Conference: 2020

Pages: -

Online publication date: 28/12/2020

Acceptance date: 02/04/2018

Publisher: Institute of Electrical and Electronics Engineers Inc.

URL: .10.1109/ICECS49266.2020.9294877

DOI: 10.1109/ICECS49266.2020.9294877

Library holdings: Search Newcastle University Library for this item

ISBN: 9781728160443