Jarxi

Bolderdash

Speculative Decoding and MTP: Why Guessing Is Free

A forward pass over five tokens costs about the same as over one. That gap is the entire speedup, and MTP is how the model drafts guesses to fill it.

I saw “MTP round-trip” on a checklist for a Megatron conversion pipeline and had no idea what it meant. Two acronyms, one hyphen, apparently important enough that someone had listed it as a thing t......

What special: true Actually Changes

It changes nothing when you tokenize. It changes everything when you detokenize, and only if skip_special_tokens is on. Measured against GLM 5.2's tokenizer.

I found the question in my own eval script, which is the embarrassing way to find things. 12text = tokenizer.decode(output[0, input_len:], skip_special_tokens=True).strip()text = re.sub(r"<......

After the Hexo Skill, a Plugin for Tone

My first Claude Code skill has 700+ downloads on ClawHub, which surprised me enough to write another. This one holds the voices I post in, and it will keep growing.

The first Claude Code skill I wrote was a selfish one. I publish this blog with Hexo, the workflow has enough sharp edges that I kept re-explaining it, so I wrote it down once: front matter templat......

What Actually Gets Tokenized in SFT

The model never sees your messages list, only the rendered string. Once that clicks, add_generation_prompt, loss masks and the double-BOS bug all line up behind it.

tok.apply_chat_template(msgs, add_generation_prompt=True) I have copied that line more times than I can count without thinking about what any of it does. The official example writes it that way, th......

Multi-level Account and User Design: One User, One Account

A three-level account and user model — legal entity, account, user. Why we rejected this design, then shipped it two months later when one rule changed.

Most billing bugs are not arithmetic. They are identity: whose balance pays for this request. Get the identity model wrong and every table downstream grows a second nullable column and an if. This ......

Reddit Growth Strategy: Warm-Up, Targeting, and Auto-Fix

How we keep daily Reddit ops on track without tripping moderator wires or API restrictions

Why Reddit still matters for startup storytellingIf you build in public, Reddit is one of the few places where startup founders and marketers actually trade notes in real time. Our current Reddit g......

How I Plan to Build in Public

Playbook for shipping an autonomous personal finance assistant in public

Why build in public?Sharing the journey of my personal finance assistant is the best way to attract the right audience: people who want trustworthy AI companions and engineers who care about solid ......

Using the blog-hexo skill

Draft + publish workflow in one place

OverviewThe blog-hexo skill merges the drafting and publishing flows so you can go from first idea to deployed post without context switching. This note explains how to use each mode and what to wa......