How Tech, Business, and Culture Are Quietly Redefining the Future
Observations from a small island, connecting micro-signals to larger shifts in tech, business, and culture.
Latest Small Island Research Notes
The Linear Narrative Around AI Memory Demand May Be Starting to Show Small Cracks
2026-03-26
Executive Summary
In current discussions around AI infrastructure, the market broadly assumes that memory demand will continue rising steadily as models scale, inference workloads expand, and HBM and DRAM remain under supply pressure. This narrative is grounded in real conditions, which is also why it appears especially durable.
But once the focus shifts from demand itself to system design, the picture becomes less straightforward. As memory supply, cost, and capacity allocation increasingly become real constraints, the more important question may no longer be whether memory demand will grow, but rather along which path it will grow.
This article outlines four possible paths. First, constraints may trigger an efficiency revolution, accelerating technologies aimed at reducing memory use and lowering compute intensity. Second, constraints may also drive architectural reconfiguration, shifting pressure away from a single component and toward a redistribution across memory tiers and system roles. Third, demand itself may not unfold smoothly. The path from experimentation to large-scale deployment may include pauses, delays, and volatility. Fourth, cost and pricing mechanisms may feed back into design choices and further reshape the demand curve.
Based on current technology and industry signals, the first two paths appear especially worth watching. Recent NVIDIA research on KV cache compression and related system design suggests that the problems that central platform companies are trying to solve may no longer be limited to how to make compute larger, but also how to keep the overall system expanding while critical resources remain scarce.
This does not mean the main direction of AI memory demand has reversed. A more reasonable interpretation may be that demand will still grow, but the way it grows, the pace at which it grows, and how pressure is distributed may become more complex than the market’s familiar linear narrative suggests. For that reason, the linear narrative around AI memory demand may already be starting to show small cracks.
Explore more notes from Small Island Research Notes on Tech and Future, a project by Researcher and Research.
Latest Small Island Research Notes
The Linear Narrative Around AI Memory Demand May Be Starting to Show Small Cracks
2026-03-26
Executive Summary
In current discussions around AI infrastructure, the market broadly assumes that memory demand will continue rising steadily as models scale, inference workloads expand, and HBM and DRAM remain under supply pressure. This narrative is grounded in real conditions, which is also why it appears especially durable.
But once the focus shifts from demand itself to system design, the picture becomes less straightforward. As memory supply, cost, and capacity allocation increasingly become real constraints, the more important question may no longer be whether memory demand will grow, but rather along which path it will grow.
This article outlines four possible paths. First, constraints may trigger an efficiency revolution, accelerating technologies aimed at reducing memory use and lowering compute intensity. Second, constraints may also drive architectural reconfiguration, shifting pressure away from a single component and toward a redistribution across memory tiers and system roles. Third, demand itself may not unfold smoothly. The path from experimentation to large-scale deployment may include pauses, delays, and volatility. Fourth, cost and pricing mechanisms may feed back into design choices and further reshape the demand curve.
Based on current technology and industry signals, the first two paths appear especially worth watching. Recent NVIDIA research on KV cache compression and related system design suggests that the problems that central platform companies are trying to solve may no longer be limited to how to make compute larger, but also how to keep the overall system expanding while critical resources remain scarce.
This does not mean the main direction of AI memory demand has reversed. A more reasonable interpretation may be that demand will still grow, but the way it grows, the pace at which it grows, and how pressure is distributed may become more complex than the market’s familiar linear narrative suggests. For that reason, the linear narrative around AI memory demand may already be starting to show small cracks.