Divide by depth for instant 3D

(gabrieloc.com)

93 points | by gabrieloc 2 days ago

7 comments

  • tmoertel 1 hour ago
    The explanation of "What's that extra 1 for?" in the column representation of 3-d coordinates (x y z 1) could benefit from mentioning that translation—moving things—is not a linear transformation (the origin is not mapped to itself) but an affine transformation. Therefore, you cannot represent translation in 3-d space with a 3x3 matrix. What you can do, though, is embed that 3-d space within a 4-d space fixed at some coordinate on its 4th dimension, typically w=1. Then, a translation in the original 3-d space can be represented as a linear transformation in the 4-d space and thus can also be represented by a 4x4 matrix multiplication. So the extra 1 is actually what allows all common 3-d operations, including translation, to be done via linear algebra and thereby harness the brutal power of matrix multiplication on modern computing devices.
    • globalnode 24 minutes ago
      nice intuition there, this comment prompted me to consider a simpler example, 2d embedded within 3d. does the 2d plane (embedded in 3d) go through the 3d origin (where 0 maps to 0) and is thus a linear transformation in 3d but a 2d affine transform in 2d? it feels like this is the case?
  • aappleby 6 hours ago
    FWIW, if you start with "The view frustum is a 90 degree pyramid with the tip cut off at z = 1 and the 'end' at infinity", you can then work out how to map that to a NDC using a matrix and perspective divide.

    I've used that when teaching short "Graphics 101" (not in the first session though) and the math comes out more intuitive than the usual "here's how to calculate a perspective matrix, don't ask where these numbers come from" version.

    • Lerc 2 hours ago
      I tend to do it with a window.

      Students can easily imagine the pyramid from an eye to the window frame, and that it keeps going.

      Then I point to an object outside the window and say imagine strings going from the corners of the object to your eye. To do this they would have to go through the window, where do they do that. 3d graphics is finding out where on the window the strings go through so you can stick a picture of thing outside onto the window and it looks exactly the same.

    • psvv 5 hours ago
      For me learning on my own, it was even illustrative to not use a near plane and see how things behind the camera would still appear in front of it.

      A lot of 3D graphics can be derived pretty easily just from knowing a few basics like divide by depth. I think knowing how to construct a transformation matrix from a coordinate system basis is another one -- that would remove the need to look up how to construct a perspective matrix, for example.

      A few things like that will get you pretty far and you can kind of take the same journey of discovery as early 3D pioneers. That's one of the best ways to learn because you're much more likely to remember something you figured out compared to something you just read about.

      It gets tricky with perspective-correct textures, but running into issues like that on your own (even if not solved on your own) is part of the fun of learning, I think.

  • gabrieloc 2 days ago
    Hi! I wrote a few notes on how 3D cameras work with interactive examples to hopefully demystify a pretty complex topic that I once struggled with. Maybe this is useful for someone here, and if not, there are fun sliders to play with!
    • dyarosla 6 hours ago
      The visuals and sliders are great!

      Maybe consider clipping the ball properly on the edges of the sides of the view frustum ?

      Similarly the near and far could also be clipped; i know this is not true of the math necessarily but is the expected result in 3d graphics applications.

  • JKCalhoun 1 hour ago
    Like the post, I wrote an old-school 3D engine that does the same math—renders flat-shaded polygons in an HTML5 Canvas.

    Demo: https://engineersneedart.com/Phosphor3DTest/

    (cursor keys drive the sand crawler, square-brackets change FOV)

    Sources: https://github.com/EngineersNeedArt/Phosphor3D

    (I was seeing a few anomalies and sent Claude to investigate—found a math error or two. There are still some anomalies in depth sorting the polygons but not due to the code, I believe—instead the model itself.)

  • skzv 3 hours ago
    Awesome. To take this a step further, I used this math to turn 2D photos into 3D scenes with depth maps: https://blog.skz.dev/3d-reconstruction-from-public-photos
  • TN1ck 4 hours ago
    The sliders are great UX on mobile, love the detail to attention.
  • xcafebabe 5 hours ago
    [dead]