Interesting that Samsung still pursues PIM. IIRC they had a paper in ISCA21 or 22 where they showed HBM2 module with PIM, which back then impressed me quite a lot.
That being said, I am not sure what’s the killer application for this technology, and without such application adoption is unlikely.
As I understand it, the killer app is llms. You could run MACs directly in RAM, offloading a lot of work from CPU and cutting down on insane (external) memory bandwidth required.
Imagine (this is a fantasy pitch but sort of accurate for some use cases) wanting to run a larger llm and all you have to do is buy more RAM so it fits.
That being said, I am not sure what’s the killer application for this technology, and without such application adoption is unlikely.
reply