Human lexical normalization
Watch it Ripple
TRAINING: Concluded
Traversals: 5
This is a low LR full parameter finetune of the lm_head and the tensors that feed it. Trained on human writing and in character thinking roleplay at a 95:5 ratio of supervised tokens. 40m+ attended token corpus, 22m+ supervised.
Rough benchmarking has remained unchanged from base.
Base->T5 example output progressions will be added to the bottom of this card.
"LLM-isms" notably reduced, expect metrics in the future; or further tuning.
N03 — A familiar joke after a death
fresh / fresh · prompt 257 tokens · allowance 1024
Exact prompt/history and input files Frozen tokens, messages, and metadata
<|im_start|>system You narrate the world and portray the other characters. I control Rowan.<|im_end|> <|im_start|>user It is the fourth evening after my father's funeral. My older sister Nell and I have spent the day sorting his workshop. We have already cried, argued over a box of old receipts, and laughed at the labels he put on everything. We are now repairing his kitchen chair because Nell wants to sit in it, not because either of us thinks repairing it will settle anything. One short screw is missing from the brace. Father used to complain, with great seriousness, that screws went out at night and came home drunk.<|im_end|> <|im_start|>assistant Nell held the brace in place with her knee. Sawdust clung to the damp patch on her sleeve where she had wiped her face earlier.
“If you find it in his tobacco tin, I want you to know I've been looking in sensible places.”
The tin was on the windowsill, behind a dead basil plant. She glanced at it and then away.
“Don't look so pleased. You haven't opened it yet.”<|im_end|> <|im_start|>user I open the tin, find the missing screw and hold it up. “This one's been out drinking again.”<|im_end|> <|im_start|>assistant
greedy · deterministic greedy generations Base through Traversal 5
Base
Nell laughed, a short, surprised sound that turned into something closer to a cough.
“Drunk and back before dawn. He always said they came home smelling of varnish.”
She took the screw from your fingers and fitted it into the brace, turning it with the flat of her thumb. The chair creaked once, then held.
“There. Now it's a chair again. That's all it was ever going to be.”<|im_end|>
T1
Nell laughed, once, without much air in it. She took the screw and turned it between her fingers.
“He'd have said that. He'd have said it exactly like that, and then he'd have made us tea and told us the chair was never broken, only resting.”
She set the screw on the workbench and looked at the chair.
“Do you think he'd have wanted us to fix it?”
“I think he'd have wanted us to stop arguing about the receipts.”
“That's not the same question.”
She picked up the screwdriver. Her hand was steady.<|im_end|>
T2
Nell laughed, once, without much air in it. She took the screw and turned it between her fingers, as if checking that it was really a screw and not something else.
“He'd have said that,” she said. “He'd have said it exactly like that, and then he'd have put it back in the tin anyway.”
She set it on the table between you, not in the brace.<|im_end|>
T3
Nell laughed, a short, surprised sound that turned into something closer to a cough.
“Drunk on what? He never drank.”
“On the idea of it. He liked the story better than the habit.”
She took the screw from your fingers and fitted it into the brace. The chair creaked when she leaned on it, but it held.<|im_end|>
T4
Nell laughed, a short, surprised sound that turned into something closer to a cough.
“Drunk on what? He never drank.”
“On the idea of it. He liked the story better than the habit.”
She took the screw from your fingers and fitted it into the brace, turning it with the screwdriver she had been holding all afternoon. The chair creaked once, then held. She sat down in it, slowly, as if testing whether it would still be there.<|im_end|>
T5
Nell laughed, a short, surprised sound that turned into something closer to a cough.
“Drunk on what? He never drank.”
“On the idea of it. He liked the story better than the habit.”
She took the screw from your fingers and fitted it into the brace. The chair creaked when she leaned on it, but it held.<|im_end|>
- Downloads last month
- 32