Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles

Orestis Konstantaropoulos, Theodoris Mallios, Maria Papadopouli · 2025

Read Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles by Orestis Konstantaropoulos, Theodoris Mallios, Maria Papadopouli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14023.txt.

Description

Orestis Konstantaropoulos, Theodoris Mallios, and Maria Papadopouli build an energy-saving team of spiking networks in a paper from 2025. Big AI models use too much power for small devices. Spiking networks, inspired by the brain, fire only when needed and suit special low-power chips.

A large teacher model guides a set of small student spiking networks. Each student masters a distinct slice of the teacher's knowledge. All students see the same input at once. The core trick is dynamic activation: only some students wake for each input. That cuts energy while keeping the team's skill. The design narrows the gap between spiking and standard networks.

Catalog record

CREATOROrestis Konstantaropoulos, Theodoris Mallios, Maria Papadopouli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14023

Browse the full library · About the Tower of Babel