Feed

68 materials

Sort by
News27 September 2026

Active Weights Instead of a Full Matrix: INT8 Decoding of a Spiking Model on CPU

The article describes a C++ implementation for a language model with binary spike gating: sparse projections are processed in INT8, and computations account only for active weights. In a single-threaded test, the early INT8 version achieved 23.31 tokens/s versus 9.82 for FP32 and reduced memory usage for weights from 3355.2 to 1087.4 MiB; switching dense projections to INT4 reduced decoding throughput.

Active Weights Instead of a Full Matrix: INT8 Decoding of a Spiking Model on CPU
Read
News26 September 2026

SymbolicLight V1: a language model with sparse spikes and a continuous residual pathway

The article presents a dual-stream architecture that combines LIF spiking dynamics with continuous context processing and local attention; four models are trained from scratch on Chinese and English data. Encoder probes show around 90% zero spikes, but average perplexity is 7.7% worse than that of a similarly sized GPT-2, and measured generation is noticeably slower—the results outline a trade-off between sparsity, quality, and computational efficiency.

SymbolicLight V1: a language model with sparse spikes and a continuous residual pathway
Read
News21 September 2026

ER-KAN vs noise: robustness of Kolmogorov–Arnold network variants under data scarcity

A comparison of efficient-KAN architectures on noisy and small samples shows that at σ=0.1, ChebyKAN's error on a clean reference increases by a factor of 10.6, whereas the proposed ER-KAN's error increases by only a factor of 1.4. Robustness is provided by shared Gaussian RBF bases, gradual noise injection during training, and entropy-weighted regularization; the work also introduces a noise degradation ratio metric and demonstrates a 4.2-fold reduction in MSE relative to MLP on a PINN for a damped oscillator, while honestly reporting the failure with the Burgers equation.

ER-KAN vs noise: robustness of Kolmogorov–Arnold network variants under data scarcity
Read