Chapter IV
Scaling
What more parameters, data and compute actually buy.
What this chapter covers
- Parameter count
- Data
- Compute
- Scaling laws
- Compute and data trade-offs
- Inference scaling
Propositions
Not yet written. The topics above are the plan for this chapter; each will become a proposition with its own figure.