Md. Asif Uddin

Book VII

Practice

losses, training dynamics, evaluation

Turn knowledge into research: reading papers, forming a question, running an experiment that means something, and writing it down.

10 chapters0 propositions written

  1. Chapter IReading PapersExtracting the claim, the method and the caveat.Reading an abstract · Identifying the claim · Identifying the method · Understanding figures · Finding limitations · Following citations · Reproducing resultsnot yet written
  2. Chapter IIProblem FormulationTurning an interest into a question.Identifying a problem · Defining the research question · Hypothesis · Assumptions · Baselines · Evaluationnot yet written
  3. Chapter IIIDataset PracticeMost of the work.Dataset discovery · Collection · Cleaning · Annotation · Splitting · Leakage · Imbalance · Preprocessingnot yet written
  4. Chapter IVExperimental DesignMaking a result mean something.Baseline · Ablation · Controls · Hyperparameters · Reproducibility · Random seeds · Experiment trackingnot yet written
  5. Chapter VEvaluationChoosing the number you will be judged on.Choosing metrics · Classification metrics · Segmentation metrics · Generative evaluation · Calibration · Statistical significance · Confidence intervalsnot yet written
  6. Chapter VITraining SystemsThe machine underneath.GPU · Memory · Batch size · Mixed precision · Distributed training · Checkpointing · Profiling · Inferencenot yet written
  7. Chapter VIIDebugging ModelsA decision tree for when nothing works.Data · Labels · Preprocessing · Implementation · Optimisation · Model capacitynot yet written
  8. Chapter VIIIReproducibilityBeing able to get the same answer twice.Code organisation · Configuration · Environments · Seeds · Logging · Experiment tracking · Version control · Dataset versions · Model checkpointsnot yet written
  9. Chapter IXResearch CommunicationWriting it down so it survives.Writing a paper · Making figures · Making presentations · Explaining methods · Writing limitations · Responding to reviewersnot yet written
  10. Chapter XResearch ProjectsComplete worked projects, end to end.Question · Literature · Hypothesis · Data · Baseline · Method · Experiment · Ablation · Evaluation · Analysis · Conclusionnot yet written