Chapter VI
Training Systems
The machine underneath.
What this chapter covers
- GPU
- Memory
- Batch size
- Mixed precision
- Distributed training
- Checkpointing
- Profiling
- Inference
Propositions
Not yet written. The topics above are the plan for this chapter; each will become a proposition with its own figure.