Summa
Md. Asif Uddin
Deep learning researcher — vision, medical imaging, vision-language models, causal inference, bioinformatics and gene sequence analysis
Correlation is cheap. Only an intervention costs anything.
— the author
Dhaka, Bangladesh

Prologue
I spend most of my time trying to understand AI and learn how to build useful AI systems. I work with different models, train and fine-tune them, modify existing architectures, and sometimes build new approaches when a problem needs it. I enjoy taking an idea, understanding how it works, and then trying to apply it to a real problem.
My undergraduate thesis, HierarchiRetina, is one example of this, and it is now under review at the IEEE Journal of Biomedical and Health Informatics, with the preprint on arXiv. It is a cascade that screens retinal photographs for diabetic retinopathy, segments the lesions and vessels, and grades the eye, evaluated end to end so that every case missed at the first step counts as an error. I have worked on the full process, from finding and preparing the data to training and evaluating the models. Getting the data was also a major part of the work. I visited hospitals, contacted researchers and institutions, and went through more than 37 published papers looking for suitable datasets. Most requests were declined, but the authors of FGADR responded and allowed us to use their dataset.
Alongside my thesis, I work with my advisors on different research problems. One project on open-world species recognition has already been completed and submitted for publication. Another project focuses on kidney disease. We are working with CT scan images to develop automated analysis and generate reports from the scans. These projects have helped me understand how AI can be adapted to very different problems and domains.
More recently, I have started working on a problem in computational biology. Instead of only asking which genes are related to Alzheimer’s disease, the work looks at what might happen to a microglial cell when a specific gene is knocked down. We then compare the model’s predictions with experimental CRISPR screens. I find this interesting because it brings together AI, biology, and experimental research.
Next is an MSc in Computer Science and Engineering at BRAC University, starting in Fall 2026. My proposal has already been accepted. I want to continue doing research while also building a career in AI and machine learning. I do not see research and industry as two separate paths. I want to keep learning through research while building AI systems that can solve real problems.
Outside computer science, I have broad interests in philosophy, law, public policy, science, and society. I also love cooking and trying new recipes. I enjoy learning about how ideas shape the way we understand the world, how technology affects people, and how we can use what we learn to build things that are genuinely useful.
Compendium
HierarchiRetina
Diabetic retinopathy screening and grading, evaluated end to end
Rank Radii Transfer as Quantiles
Placing unseen species inside the taxonomy, not in flat clusters
Automated Renal Reporting
The aim: a generator that cannot emit a value it did not measure
HCGT-PG
What would happen if you knocked the gene down
Instrumenta propria
Fig. I
HSMoE-AUNet
A microaneurysm is a few dark pixels. A cotton wool spot is a soft pale patch. They do not respond to the same design.
Hierarchical sparse mixture-of-experts attention U-Net on a ConvNeXt-Small encoder, with a different expert set per lesion type. Custom experts: MultiScaleExpert, BrightSpotExpert, EdgeEnhancingExpert, SoftRegionExpert, TextureExpert.
Fig. II
SwinHRUNetPP
Vessel segmentation needs global context and hairline spatial precision at once, and most hybrids trade one away.
A Swin-based high-resolution U-Net++ hybrid, arrived at by rejection rather than by design.
Rejected along the way
- SwinV2-Large
- smp UNet++
- plain SwinUNet
- Lovász loss
- BoundaryLoss
- warm-restart scheduling
- label smoothing
- encoder freezing
Each of these made the result worse.
Fig. III
MultiScaleMANet
Microaneurysms vanish at low resolution and lose context at high resolution.
Three branches — full 512×512 through EfficientNet-B4, four 256×256 patches through a shared EfficientNet-B0, sixteen 128×128 patches through the same encoder — with spatial reassembly and bottleneck fusion. Alignment was proved on paper before implementation.
Fig. IV
RichAttentionUNet
A baseline worth trusting has to be one you can account for line by line.
Written from scratch with no pretrained weights: residual conv blocks with SE channel attention, an ASPP multi-scale bottleneck, attention gates in the decoder, deep supervision heads.
Fig. V
Custom losses
Off-the-shelf losses reward the wrong thing on sparse, bright, or boundary-defined lesions.
DualEdgeBoundaryLoss, OpticDiscSuppressionLoss, SoftBoundaryLoss, probability-weighted RegionCoherenceLoss, an FOV-masked composite loss, clDice.
Axioms
- HierarchiRetina, Stage IIIA number nobody can compare with their own is a report about your hardware, not a result.
- HierarchiRetina, Stage IThe test set is opened once, after the threshold is locked. There is no second first look.
- Renal length, KUB CTMeasure in millimetres, not in slices. The scanner's axes are not the organ's.
- Rank radii, unseen cladesA threshold does not survive a change of population. Its quantile does.
- Taxonomic placement, refusalRefusal is a prediction. A model that cannot decline will place every specimen somewhere.
- HCGT-PG, the estimandWhere measurement is cheap, correlation is free. Only an intervention charges for it.
Elementa
A structured journey through the core mechanisms of modern AI. A course in deep learning, built to be read in order or explored by interest. From foundations and neural networks to bioinformatics and intelligent systems. Each entry is a proposition: a claim, its dependencies, with figures and mathematics.
- Book INeural networksthe perceptron, backpropagation, optimisation, convolution, recurrence, latent variables, graphs
- Book IIFoundationstokenisation, attention, the transformer block
- Book IIIVisionViT, DINOv2, self-supervised visual representation
- Book IVLarge Language Model (LLM)Transformers, attention mechanisms, prompt engineering, fine-tuning.
- Book VVision-language (VLM)contrastive pretraining, fusion, VLM architectures
- Book VICausal inferenceDAGs, interventions, counterfactuals, perturbation
- Book VIIBioinformaticssingle-cell data, gene regulatory networks, perturbation screens
- Book VIIIPracticelosses, training dynamics, evaluation
- Book I · Chapter XIII · Prop. 1A latent-variable model explains each observation by a code it never sees, and its likelihood is an integral over every code.
- Book I · Chapter XIII · Prop. 2The ELBO falls short of the log-evidence by exactly the divergence from the encoder's distribution to the posterior.
- Book I · Chapter XIII · Prop. 3The reparameterisation trick moves the randomness off the path of the gradient.
Marginalia
Reviews of books and models, and notes that did not fit anywhere else.
Instrumentarium
Fig. i
Languages
Python (primary). C (coursework level).
Everything below is written in the first of these.
Fig. ii
Deep learning
PyTorch, timm, segmentation_models_pytorch. Mixed-precision training with GradScaler tuning, EMA, test-time augmentation, k-fold CV with resumable per-fold checkpointing, class-imbalance handling (pos_weight, weighted samplers), threshold calibration on validation only, ordinal regression (CORN), mixture-of-experts, cross-attention fusion, attention gates, ASPP, GeM pooling, deep supervision, frozen-backbone transfer, Grad-CAM.
Training discipline more than library familiarity.
Fig. iii
Architectures used hands-on
ConvNeXt V2, Swin UNETR V2, DINOv2/v3, EfficientNet, U-Net, U-Net++, Attention U-Net, SwinHRUNetPP, HSMoE-AUNet, image-text encoders.
I build, train, modify and evaluate these rather than only reading about them.
Fig. iv
Medical imaging
Fundus photography, non-contrast CT, NIfTI and DICOM handling, FOV masking with morphological erosion, CLAHE on the green channel, retinal cropping, patch extraction and stitching, lesion-level connected-component evaluation, de-identification, radiologist report parsing.
Most of this is preprocessing nobody writes papers about.
Fig. v
Evaluation
QWK, ICC, AUC-ROC, AUC-PR, Dice, IoU, NMI, lesion-level and image-level recall, sensitivity/specificity tradeoff analysis, per-dataset breakdowns, held-out test discipline and leakage assertions.
The per-dataset breakdown is the part that matters.
Fig. vi
Causal inference and computational biology
Causal graphs and DAGs, d-separation, interventions, counterfactual reasoning, gene perturbation analysis, gene regulatory network inference, multi-omics integration and biomarker discovery.
Currently extending this direction toward single-cell foundation models, genomic sequence models and perturbation-based causal analysis.
Fig. vii
Data
pandas, NumPy, Albumentations, OpenCV, Matplotlib, Seaborn, scikit-learn, nbformat.
Ordinary tools, used daily.
Fig. viii
Backend
FastAPI, REST APIs, SQLAlchemy, JWT auth, Alembic, AWS S3, CloudFront.
From building CSMMS, in the appendix.
Fig. ix
MODEL FAMILIARITY
Beyond the architectures I have used hands-on, I regularly study modern vision, multimodal, language, medical imaging and computational biology models. This includes SigLIP 2, EVA-CLIP, SAM 3, nnU-Net, ViT, Qwen, Llama, DeepSeek, Kimi, MedGemma and genomic models such as AlphaGenome and Geneformer. I focus on understanding their architecture, training objective, scaling behavior, benchmarks, limitations and practical use rather than treating familiarity with a model as equivalent to hands-on experience. The model notes I keep are part of this ongoing study.
I study, compare and reproduce modern models to understand their architecture, training objectives, benchmarks, limitations and where they fit into my own research.
Fig. x
READING
I love reading books and research papers. My current reading is centered on machine learning, causality and computational biology. Key books include The Book of Why, Causality: Models, Reasoning, and Inference, Causal Inference in Statistics: A Primer, and Elements of Causal Inference: Foundations and Learning Algorithms. The reading is not separate from the research work. It is mainly about understanding what can be inferred from data, where the assumptions enter, and how interventions can provide stronger evidence than observation alone.
I read research papers and technical books to build the theoretical foundation behind the models and methods I use, especially in machine learning, causality and computational biology.
Fig. xi
Other
Git, Jupyter, LaTeX, lex/yacc, CUDA-level debugging.
One machine, a great deal of patience.
Not yet: SQL, propensity score methods, Mendelian randomization.
Chronicle
Fall 2026 —
BRAC University, Dhaka
MSc, Computer Science and Engineering.
Thesis proposal accepted: HCGT-PG. Supervisor: Dr. Badhan Das.
Fall 2021 – Summer 2026
BRAC University, Dhaka
BSc, Computer Science and Engineering.
Thesis: HierarchiRetina, supervised by Rafeed Rahman; not publicly released, and the work is now under review at IEEE JBHI. Coursework in machine learning, deep learning, compilers, theory of computation, DBMS, operating systems, algorithms and software engineering.
2020
Uttara High School and College, Dhaka
Higher Secondary Certificate.
Science.
2018
Ullapara Merchant Pilot High School, Sirajganj
Secondary School Certificate.
Science.
Courseworkmachine learning, deep learning, compilers, Python, theory of computation, DBMS, operating systems, algorithms, software engineering.
Appendix
Systems work: where models stop being isolated learners and become architectures. The chapters above concern what a model learns; these concern how intelligence is assembled across vision, language models, vision-language models, and retrieval through model architecture, multimodal integration, retrieval pipelines, reranking, inference, and evaluation. The discipline is no longer only about learning representations, but about designing systems that can perceive, retrieve, reason, and answer. Each project below opens its own page.
- ResearchLensEvidence-grounded literature retrievalA research assistant over 106 indexed papers that answers only from passages it actually retrieved, cites them, and refuses when the evidence is not there. Grounding is enforced in code rather than requested of the model, and it runs locally with no API key.Read the project
- LocalScholarA private, laptop-scale research assistantBuilt because two scoping reviews needed more PDFs than any hosted chatbot would take. A permanent library on the laptop that answers across every paper at once, grounds each claim in a page you can open, refuses what it cannot answer, and sends nothing off the machine.Read the project
- Criminal Law Q&A AssistantAnswers on Bangladesh criminal law, grounded in the statute and checked against itAsk about Bangladesh criminal law in English or Bangla, by text, voice or photo, and get an answer drawn from the statute itself. Every quotation is checked against the source before it is shown, every citation says when its section last changed, and questions the law does not answer are declined.Read the project
- PRISMA-LocalScreening a systematic review on your own hardwareScreening a systematic review means ranking thousands of records without missing one, often on data that cannot leave the institution. Small open models fine-tuned to score each record in a single token, an honest result against two baselines, and a precision bug that hid inside a good AUC.Read the project
- Vi-GraphDiagram images turned into editable, queryable graphsTurns a picture of a diagram into an editable, queryable graph. A fine-tuned Qwen3-VL-2B lifts graph similarity from 0.581 to 0.740 on 500 held-out diagrams, and the page reports the classical OCR pipeline that ties it, and why the model struggles on the densest diagrams.Read the project
- Glass-Box ViTA Vision Transformer rebuilt from scratch and verified layer by layer against a pretrained ViT-BaseA Vision Transformer rebuilt from basic PyTorch layers and proved to be the same function as a pretrained ViT-Base: all 100 intermediate stages match exactly, with a maximum difference of 0.0, on CPU and GPU. Then used to measure which design choices actually matter.Read the project
- WinnowA free, self-hostable platform for systematic reviewsA free, open-source platform that runs a whole systematic review on a server the lab owns: search exports in, PRISMA 2020 diagram out. Security is enforced in the database, and every performance figure was written as a budget first, then measured on 100,000-record reviews.Read the project
- SANDHI Research LabA public website, member workspace and administration in one applicationA research lab's public website, member workspace and administration in one application, built from first commit to production in fourteen days. Invitation-only accounts, mandatory two-factor sign-in, and fast on free tiers even though every page renders on demand.Read the project
- SANDHI appThe research lab's Android app, a second client of the website rather than a second systemThe Android app of SANDHI Research Lab: the research map, projects, papers, people and news for anyone, and two-factor sign-in for members. It has no backend of its own. It reads the website's API under the same permission rules as the site's pages, so the app and the site never disagree. Released on 18 October 2026 as a signed 57 MB APK.Read the project
- LucyAn AI desktop companion that runs entirely on the MacA 3D anime-style companion who lives on the Mac's screen, talks in a natural voice and listens when you say her name, with no account and no network needed. Speech recognition, voice and model all run on the machine, and Rust owns every network call.Read the project
- Officina AIAn execution tracer for Python, C and Java, with a tutor that explains the traceWrite a program, press Trace, and step through what it actually did, forwards and back, in Python, C or Java, in the browser. The trace comes from running the program, never from a model; a tutor then explains any step from the recorded facts.Read the project
- OfficinaA notebook that compiles and runs Python, C, C++ and Java in the browserA notebook that compiles and runs Python, C, C++ and Java in the browser and nowhere else. C and C++ are compiled for real by clang built to WebAssembly, Python runs with the network removed, and nothing you write is uploaded.Read the project
- MONAIThe metric that hid the failuresA silent bug in MONAI, the library most medical segmentation work is built on: a prediction that missed entirely was dropped from the HD95 average instead of being scored. Found, traced to torch.quantile, fixed with twelve regression tests, and merged upstream on 6 October 2026.Read the project
- CSMMSCampus Student Management and Marketplace SystemThe backend of a campus marketplace and student services system: a filtered, paginated item API, image upload to S3 delivered through CloudFront, and service impact metrics computed live.Read the project
- Food Expiry PredictionCNN and Random Forest models that estimate when food will spoilPredicting when fruit, vegetables and packaged food will expire, to cut food waste. A CNN judges freshness from photographs, while Random Forest and MLP models weigh temperature, humidity and how long the food has been stored.Read the project
- Compiler symbol tableScoped name lookup for a lex and yacc/bison front endA scoped symbol table for a compiler front end in lex and yacc/bison, where function parameters land inside their function's scope and every if and for block gets its own. Portable across macOS and Linux.Read the project