News
Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second
Tom's Hardware · By Shane Downing ·
The Brief
- A homelabber upgraded a second-generation Optane-based AI build by adding two RTX 3090 GPUs.
- The setup runs the 2.8-trillion-parameter Moonshot Kimi K3 model at 3.11 tokens per second.
- Moving almost half of the model onto a RAM drive reportedly boosted performance by 41 percent.
Why it matters
It shows how a consumer-grade homelab with multiple GPUs and optimized memory placement can run a very large model, though the reported speed is modest and the details come from a single hobbyist build.
Who’s affected
- Homelab enthusiasts running local large language models
- Kimi K3
- #homelab
- #local-llm
- #optane
- #gpu
- #kimi
A homelabber detailed improvements to the second-gen Optane AI build in a follow-up post on Reddit , showing the addition of two RTX 3090s to run the 2.8-trillion-parameter Moonshot Kimi K3 model at 3.11 tokens per second. Transferring almost half the model onto a RAM drive added…