Skip to content
View original post on X: Rohan PaulX· 40/100AI score40/100

Marvell shows photonic module placing HBM and DDR up to 50 meters from GPUs

AISummary

Marvell's Dave Lazovsky shows a small photonic module that moves HBM and DDR memory up to 50 meters from a GPU, compared with the usual 1.5 mm. The post says latency stays in the hundreds of nanoseconds, which it calls close enough for practical memory use.

Post on XView on X
Rohan PaulVerified on X
@rohanpaul_ai

Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.

this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.

For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.

Latency stays in the hundreds of nanoseconds, close enough for practical memory use.
Basically, Memory and compute now scale on separate axes instead of being locked together. https://x.com/MarvellTech/status/2112227641759871266/video/1

Source: Rohan Paul · x.comPublished · added here