residual

residual

about

hi, I write slow, long notes here — mostly machine learning & interpretability, sometimes type and interfaces. nothing polished. highlight any sentence to argue with it.

more about me · every post · rss

writing (03)

  1. Notes toward a quieter interface

    What I kept, what I threw out, and why most good typographic decisions turn out to be subtractions.

    pinned5 min

  2. Activation patching, slowlynew

    Interpretability, slowly 2/2 — What the normalised patching score actually measures, and three ways it quietly misleads.

    3 min

  3. Reading the residual streamnew

    Interpretability, slowly 1/2 — A working mental model for where a transformer keeps its intermediate state, and three ways to start looking at it.

    5 min

updates

  • 2026.11.17 — added highlight comments
  • 2026.11.17 — new post: activation patching, slowly
  • 2026.11.09 — started a series on interpretability
  • 2026.10.28 — site is up :)

now

2026.11.17 01:40

mood: tired but curious

reading
the elements of typographic style
building
this site, slowly
into
sparse autoencoders