(GG) MoE vs. MLP on Tabular Data
Andrei Chernov · 2025
Read (GG) MoE vs. MLP on Tabular Data by Andrei Chernov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03608.txt.
Description
Andrei Chernov compares mixture-of-experts networks with plain multilayer perceptrons on tabular data in a 2025 study. Tables of rows and columns still dominate business and science data, yet fancy neural designs often fail to beat a simple perceptron there. Ensembles of perceptrons have recently beaten advanced deep methods while costing less.
Rather than build deeper models, Chernov asks whether the perceptron itself can be swapped for something more efficient. Gated mixture designs route each row to a few expert subnetworks. The comparison tracks accuracy against parameter count and speed. Practical guidance follows for analysts choosing models for everyday tabular problems.
Catalog record
| CREATOR | Andrei Chernov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03608