Connor's Substack

Language Modeling, Part 7: BPE Tokenization

Welcome to Part 7 of this series on language modeling.

Feb 24 • Connor Davis

1

Language Modeling, Part 6: Transformers

In Part 6 of this series on language modeling, we upgrade our model architecture from the LSTM to the Transformer.

Feb 14 • Connor Davis

Language Modeling, Part 5: Reverse Engineering LSTM Cells

In Part 5 of this series on language modeling, we linger a bit on the LSTM to peek under the hood in order to better understand the network’s internals.

Feb 5 • Connor Davis

1

January 2026

Language Modeling, Part 4: LSTMs

Welcome to Part 4 of a series on language modeling.

Jan 24 • Connor Davis

1

Language Modeling, Part 3: Vanilla RNNs

This is Part 3 of a series on language modeling.

Jan 16 • Connor Davis

5

Language Modeling, Part 2: Training Dynamics

Part 2 of a series on language modeling with neural networks.

Jan 8 • Connor Davis

2

December 2025

Language Modeling, Part 1: Neural Probabilistic Language Model

I’ve a goal to understand how language models work, so I’ve been ramping up on their academic lineage and implementing what I learn in code.

Dec 31, 2025 • Connor Davis

2

September 2025

August 2025

June 2025

Nth Order Effects

What do tariffs and the meteoric rise of Oliver Anthony have in common?

Jun 25, 2025 • Connor Davis

April 2025