Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
The version with 128GB ram is $1999.
Nvidia’s equivalent (DIGITS) is $2,999.
How do you know that it is equivalent? Or what the price is?
Equivalent as in 128gb of unified RAM targeting casual ML workloads. The price should be on any news article about it.
I mean there’s more to a computer than how much RAM it has.
I only see 3rd party sources for pricing, nothing directly from Nvidia. And indeed Framework did say in their presentation that there was no price.