M. A. Hakbilen — research notes

ML architecture researcher

Mehmet Arda
Hakbilen

( kael valen )

I study why modern sequence architectures are shaped the way they are — and rebuild them from scratch to find out which of their assumptions survive outside language.

Now running

PRISM — a modality-portable SSD + Gated Delta Rule backbone

PTB-XL · Speech Commands · sCIFAR-10
Draft aimed at ICML 2026 ES-FoMo IV

read the repo →
01

Research

::

PRISM: one backbone, three signal types, no per-modality tuning.

Hybrid linear-recurrent backbones win on language, but their design choices are language-specific. PRISM interleaves Mamba-2-style SSD blocks with Gated Delta Rule blocks at 3:1 and applies the same backbone — identical hyperparameters — to 12-lead ECG, spoken commands, and sequential images. Both mixers are implemented from scratch and held honest by numerical-equivalence tests against the production kernels.

The follow-up, MoM, lets a per-token router choose which memory primitive handles each token instead of fixing the ratio by hand. The first spike gate failed: routing doesn't collapse, but recall lags the GDR-only baseline. That's the current problem.

Pipeline validation — PTB-XL super-diag, val macro-AUC

configauc
PRISM hybrid (SSD + GDR)0.8908
Gated DeltaNet only0.8906
PRISM legacy (S4D + GDR)0.8882
Mamba-2 only (SSD)0.8836
ResNet1D0.8828
small Transformer0.8769

hidden 64 · 4 layers · 2 epochs · 1 seed · RTX 5060. Pipeline validation, not the paper's numbers — the full matrix runs at ~8M params, 3 seeds.

02

Projects — an index

::
prismmodality-portable SSD + Gated Delta Rule sequence backboneactivetrainscopeloss-spike flight recorder for LLM training runsPyPIlatch-langa programming language of my owncrates.ioconnorterminal-native CI/CD runner — DAG execution, no YAMLpublicweavelocal-first, plugin-based productivity systemactiveopen-glyphpixel-art editor for the Nothing Phone glyph matrixpublicbeyond_transformerPULSE — the predecessor to PRISM, kept as the design recordsupersedednanonetmonitoring & control for distributed services, ~70k linesarchived

everything above is original work — no forks. the full list, including the experiments that didn't make the cut, is on github.

03

Toolbox

::
machine learningPyTorch · Triton · CUDA
systemsRust · Go · C++
webTypeScript · React · Next.js
environmentNixOS · Docker · Git

the laptop runs NixOS; two of the repos are just dotfiles. PRISM trains on a single RTX 5060 — small hardware is a feature: if the architecture doesn't fit in 8 GB, the architecture changes.

04

Contact

::

Write to me — mehmetardahakbilen2005@gmail.com

Research chatter, collaboration, or just to argue about state-space models.