“To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered,” writes Framework CEO Nirav Patel in a post about today’s announcements. “We spent months working with AMD to explore ways around this but ultimately determined that it wasn’t technically feasible to land modular memory at high throughput with the 256-bit memory bus. Because the memory is non-upgradeable, we’re being deliberate in making memory pricing more reasonable than you might find with other brands.”
😒🍎
Edit: to be clear, I was only trying to point out that “we’re being deliberate in making memory pricing more reasonable than you might find with other brands” is clearly targeting the Mac Mini, because Apple likes to price-gouge on RAM upgrades. (“Unamused face looking at Apple,” get it? Maybe I emoji’d wrong.) My comment is not meant to be an opinion about the soldered RAM.
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
To anyone complaining about non-replaceable RAM: This machine is for AI, that is why.
Think of it like a GPU wirh a CPU on the side, vs the other way around.
Inference requires very fast ram transfer speed, and that is only possible (currently) on soldered buses. Even this is pretty slow at 256Gb/s, but it’s RAM size of 96GB to GPU makes it interesting for larger models.
I don’t get the point. Framework laptops are interesting because they are modular but for desktop PCs that’s the default. And Framework’s PCs are less modular than a standard PC because the RAM is soldered
Holy moly this is awesome! I am in for the 128GB SKU.
That’s 96GB of usable VRAM! And way more CPU bandwidth than any desktop Zen chip.
I know people are going to complain about non upgradable memory, but you can just replace the board, and in this case it’s so worth it for the speed/power efficiency. This isn’t artificial crippling, it physically has to be soldered, at least until LPCAMM catches on.
My only ask would be a full X16 (or at least a physical X16/electrical x8) PCIe slot or breakout ribbon. X4 would be a bit of a bottleneck for some GPUs/workloads… Does Strix Halo even support that?
I understand the memory constraints but it does feel weird for framework, is all I have to say. But that’s also the general trajectory of computing from what it seems. I really want lpcamm to catch on!
Apparently Framework did try to get AMD to use LPCAMM, but it just didn’t work from a signal integrity standpoint at the kind of speeds they need to run the memory at.
Eventually most system RAM will have to be packaged anyway. Physics dictates that one pays a penalty going over pins and mobo traces, and it gets more severe with every advancement.
It’s possible that external RAM will eventually evolve into a “2nd tier” of system memory, for background processes, spillover, inactive programs/data, things like that.
That would be fine. But as long as it can use it as RAM and not just a staging ground.
Keep in mind that it would be pretty slow, as it doesn’t make sense to burn power and die area on a wide secondary bus.
Soldered on ram and GPU. Strange for Framework.
Apparently AMD couldn’t make the signal integrity work out with socketed RAM. (source: LTT video with Framework CEO)
IMHO: Up until now, using soldered RAM was lazy and cheap bullshit. But I do think we are at the limit of what’s reasonable to do over socketed RAM. In high performance datacenter applications, socketed RAM is on it’s way out (see: MI300A, Grace-{Hopper,Blackwell},Xeon Max), with onboard memory gaining ground. I think we’ll see the same trend on consumer stuff as well. Requirements on memory bandwidth and latency are going up with recent trends like powerful integrated graphics and AI-slop, and socketed RAM simply won’t work.
It’s sad, but in a few generations I think only the lower end consumer CPUs will be possible to use with socketed RAM. I’m betting the high performance consumer CPUs will require not only soldered, but on-board RAM.
Finally, some Grace Hopper to make everyone happy: https://youtube.com/watch?v=gYqF6-h9Cvg
Sound like a downgrade to me I rather have capability of adding more ram than having a soldered limited one doesn’t matter if it’s high performance. Especially for consumer stuff.
I definitely wouldn’t mind soldered RAM if there’s still an expansion socket. Solder in at least a reasonable minimum (16G?) and not the cheap stuff but memory that can actually use the signal integrity advantage, I may want more RAM but it’s fine if it’s a bit slower. You can leave out the DIMM slot but then have at least one PCIe x16 expansion slot. A free one, one in addition to the GPU slot. PCIe latency isn’t stellar but on the upside, expansion boards would come with their own memory controllers, and push come to shove you can configure the faster RAM as cache / the expansion RAM as swap.
Heck, throw the memory into the CPU package. It’s not like there’s ever a situation where you don’t need RAM.
All your RAM needs to be the same speed unless you want to open up a rabbit hole. All attempts at that thus far have kinda flopped. You can make very good use of such systems, but I’ve only seen it succeed with software specifically tailored for that use case (say databases or simulations).
The way I see it, RAM in the future will be on package and non-expandable. CXL might get some traction, but naah.
Ye the soldered ram is for sure making me doubt framework now.
Apparently AMD wasn’t able to make socketed RAM work, timings aren’t viable. So Framework has the choice of doing it this way or not doing it at all.
In that case, not at all is the right choice until AMD can figure out that frankly brain dead easy thing.
Oh yeah I’m sure you could’ve done it no problem
“brain dead easy thing”… All you need is to just manage signal integrity of super fast speed ram to a super hungry state of the art soc that benefits from as fast of memory as it can get. Sounds easy af. /s
They said that it was possible, but they lost over half of the speed doing it, so it was not worth it. It would severely cripple performance of the SOC.
The only real complaint here is calling this a desktop, it’s somewhere in between a NUC and a real desktop. But I guess it technically sits on a desk top, while also being an itx motherboard.
Not really sure who this is for. With soldered RAM is less upgradeable than a regular PC.
AI nerds maybe? Sure got a lot of RAM in there potentially attached to a GPU.
But how capable is that really when compared to a 5090 or similar?
The 5090 is basically useless for AI dev/testing because it only has 32GB. Mind as well get an array of 3090s.
The AI Max is slower and finicky, but it will run things you’d normally need an A100 the price of a car to run.
But that aside, there are tons of workstations apps gated by nothing but VRAM capacity that this will blow open.
Framework releasing a Mac Mini was certainly not on my bingo card for this year.
I wasn’t prepared. I’ve been eyeing a mini for a while and this thing kills it on value compared to what I would get in a similar price point.
What alternatives were you considering, and how does the product from Framework compare?
Mac mini and studio. The overall power comparison remains to be seen but cost to spec ratio I would have had to spend over 6k and couldn’t have 16tb of memory, frameworks was around 3200.
Looks like a pile of shit for easily-impressionable morons, but that’s to be expected from framework.
What exactly do you want instead?
Great products for great prices!
Like what, specifically, instead of this?
Lol. Are you nuts? Am I really supposed to sit here and list off what makes a great product for a great price?
Let’s be real. You don’t like how I criticized how people like you are getting taken for a ride so you’re desperate to make it seem like it’s not true.
The sooner you realize how you’re being taken advantage of, the sooner you can start to do something about it.
Am I really supposed to sit here and list off what makes a great product for a great price?
I don’t understand what you are asking for.
You don’t have to be extensive, but… what would you want instead? A more traditional Mini PC? A dGPU instead? A different size laptop? Like, if you could actually tell Framework what you want, in brief, what would you say?
Fair enough.
I skimmed it for a few seconds, got a little bit ill at the $1100 starting price, and then it occurred to me: what is this for?
Wasn’t framework’s whole thing about making modular laptops? What value are they bringing to the mini-ITX market? They’re already modular. In fact, it looks like they’re taking away customizability with soldered RAM.
You asked me what I want, and this is definitely what I don’t want. If they wanted to make this product appealing to me, they’d have to lower the price and live more modest lifestyles with the more modest profit margins.
Edit: After closer inspection (albeit, not that close so I may have missed something) it looks like this… thing doesn’t even have a dedicated GPU. Yeah, framework can suck my fucking balls lol.
You can literally get a 4070 gaming laptop these days for ~$1000 and framework is trying to push this shit? They can fuck off so hard it’s not even funny. This is why the free world never has enough to go around, because we waste our excess on dumb shit like this.
Here’s a gaming laptop with a 4070 and a 144hz screen for $900 at Walmart:
Fuck framework.
This is ostensibly more of a workstation/dev thing. The integrated GPU is more or less like a very power efficient laptop 4070/4080 with unlimited VRAM, depending on which APU you pick, and the CPU is very fast, with desktop Ryzen CCDs but double the memory bandwidth of what even an 9800 X3D has. In that sense, it’s a steal compared to Nvidia DIGITs or an Apple M4 Max, and Mini PC makers alternatives haven’t really solidified yet.
I think Framework knows they can’t compete with a $900 Walmart laptop and the crazy bulk pricing/corner cutting they do, nor can they price/engineer things (with the same bulk discounts) at the higher end like a ROG Z13/G14.
So… this kinda makes sense to me. They filled a gap where OEMs are enshittifying things, which feels very framework to me.
