Factorised tied weights, vectorized decayed-accumulator recurrence. Best val perplexity: 60.57
This is a base/pretrained LM, not chat-tuned -- it will continue text rather than follow instructions.
Files info
