DRAM Crunch: Lessons for System Design

2 comments

• _alphageek 2 hours ago
  The weak link in the argument is the "1-2 GB DRAM stays stable" claim. That tier is stable because demand sits elsewhere. If AI workloads actually migrate down-capacity at scale (which is what the piece advocates), pricing pressure follows them.
• babblingfish 3 hours ago
  This is what keeps Amodei and Altman up at night. Their whole moat is data centers. But what if we didn't need the data centers?
  [-]
  • wmf 3 hours ago
    This article is an ad for Hailo and frontier AI will never run on the edge so A & A have nothing to worry about.

    (I define frontier AI as that which doesn't run on the edge... gotcha.)