Train a tiny model on your own text

Paste some text or upload a .txt file, pick a few settings and watch a small language model learn from it, on CPU, in under a minute.

Training text (paste here, or upload a file below) Or upload a .txt file (if a file is chosen, the pasted text is ignored)

At most 204,800 bytes (200 KiB) of UTF-8 text, at least 256 bytes.

Training steps (10–1000)

Model size

Context length (16–128 bytes)

Optimization tricks

Cosine learning rate schedule Dropout 0.1