Chapter I
Language Modelling
Prediction as repeated conditional probability.
What this chapter covers
- Probability
- Conditional probability
- Next-token prediction
- Cross-entropy
- Perplexity
Propositions
Not yet written. The topics above are the plan for this chapter; each will become a proposition with its own figure.