Md. Asif Uddin

    Chapter 6 V.6

    Visual Reasoning

    Visual reasoning fails where the patch grid cannot resolve the question being asked of it.

    Reasoning fails where the token grid cannot resolve the question.

    How this chapter is built

    M2Substantive

    The derivations are the chapter. A reader who skips the algebra has not learned it.

    basics2/9what the words mean
    concept2/2what to picture
    theory0/2why it works, and when it does not
    mathematics0/9derive it, then compute it
    practice0/6build it, break it, read the papers

    Five strands, not one. Mathematics is the spine; the other four are the body. A chapter cannot pay its way out of teaching with problems, nor out of problems with teaching.

    Before you start

    The problem

    Counting, grounding and spatial relations are where these models visibly break. The cause is often not reasoning at all but resolution: the evidence was discarded at patchification, before any reasoning could occur.

    Context length against output resolutionTwo axes: sequence context and output resolution. Earlier models occupy one corner or the other — fine resolution over a short window, or a long window with binned outputs. AlphaGenome occupies the corner that was assumed unreachable.contextresolution ↑ · context →SpliceAI, BPNet10kb, base resolutionEnformer, Borzoi200–500kb, 32–128bp binsAlphaGenome1Mb, base resolutionthe corner nobody hadThe constraint was computational rather than conceptual. Eleven output modalities at once, from one sequence.
    Fig. 6 — Context against output resolution. Every earlier model sits on one edge or the other; the claim is that the corner between them was an engineering limit rather than a law.

    What this chapter covers

    • OCR
    • Grounding
    • Spatial reasoning
    • Counting
    • Chart understanding
    • Document understanding
    • Visual question answering

    Apparatus

    The mathematics this chapter leans on, held in Book 0 so it can be assumed here without being taught here. Not a gate — follow a link when a step stops making sense.

    Distributions, discrete and continuous 0.PR.01

    Notation

    • PPatch size, in pixels along one side
    • HSpatial height in pixels
    • W (spatial)Spatial width in pixels
    • TSequence length in tokens

    Propositions

    Not yet written. The topics above are the plan for this chapter; each will become a proposition with its own figure.

    Worked problems

    0/3 problems0/3 variants0/6 exercisesowes 9 more

    Not yet written. At M2 this chapter owes 3 worked problems across 3 distinct variants, and 6 exercises, every one with a published solution. The build enforces that from the day the chapter is marked published.