Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone
Tom's Hardware · By Shane Downing ·
A homelab builder on Reddit has run Moonshot AI’s 2.8-trillion-parameter Kimi K3 AI model on discontinued second-gen Optane PMem 200 memory, using a 40-core 3rd-gen Xeon Scalable CPU and not a GPU for inference. The build runs hot, and the builder’s advice is that you “treat…