ETHEREAL: Energy-efficient and High-Throughput Inference using Compressed Tsetlin Machine

Duan, S; Shafik, R; Yakovlev, A

doi:10.1109/IWASI66786.2025.11121985

ETHEREAL: Energy-efficient and High-Throughput Inference using Compressed Tsetlin Machine

Lookup NU author(s): Dr Shengyu Duan ORCiD, Professor Rishad Shafik ORCiD, Professor Alex Yakovlev ORCiD

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.

Abstract

© 2025 IEEE. The Tsetlin Machine (TM) is a novel alternative to deep neural networks (DNNs). Unlike DNNs, which rely on multi-path arithmetic operations, a TM learns propositional logic patterns from data literals using Tsetlin automata. This fundamental shift from arithmetic to logic underpinning makes TMs ideal for low-cost applications. In TM, literals are often included by both positive and negative clauses within the same class, canceling out their impact on individual class definitions. We exploit this property to develop compressed TM models, enabling energy-efficient and high-Throughput inferences for machine learning (ML) applications. We introduce a training approach that incorporates excluded automata states to sparsify TM logic patterns in both positive and negative clauses. This exclusion is iterative, ensuring that highly class-correlated (and therefore significant) literals are retained in the compressed inference model, ETHEREAL, to maintain strong classification accuracy. Compared to standard TMs, ETHEREAL TM models can reduce model size by up to 87.54%, with only a minor accuracy compromise. We validate the impact of this compression on eight real-world Tiny machine learning (TinyML) datasets against standard TM, equivalent Random Forest (RF) and Binarized Neural Network (BNN) on the STM32F746G-DISCO platform. Our results show that ETHEREAL TM models achieve over an order of magnitude reduction in inference time (resulting in higher throughput) and energy consumption compared to BNNs, while maintaining a significantly smaller memory footprint compared to RFs.