Kyberne Lab / EventMix

Sparse Event Transition Language Model

Generate with the deeper pretrained membrane-free model whose only sequence state is a fixed event transition matrix.

0 attention layers
12 repeated event mixers
12.5% exact event rate
fixed transition state

self-supervised predictive event model

12-Head Predictive Recurrent Generation

Connecting to the pretrained EventMix service.

generated text

Autoregressive Output

No generation yet.

next-token distribution

-

runtime state

event-transition-service-v1

Prompt tokens
-
Generated tokens
-
Event rate
-
Matched order
-
Cached state
-
Elapsed
-

experimental checkpoint

Local Learning. No Membrane Potential.

Tokenizer
-
Trainable params
-
Model buffers
-
Trained tokens
-
Train steps
-
Best step
-
Validation loss
-
Validation PPL
-
Test PPL
-
Memory contribution
-
Story repetition
-
Micro reasoning
-

parallel predictive memory

Recurrent Event Banks x 6

Byte BPE1,024 symbols
Current Eventsigned 12.5%
INT8 Statesix parallel timescales
Event Memorylocal INT4 updates
Context Rerankeight candidates
Model dim
672
Layers
6
Heads
12
Events / head
7