International
The Morning Dev

Only the news worth knowing

‹
 

News

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

Tom's Hardware · By Shane Downing ·

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

The Brief

  • A homelabber upgraded a second-generation Optane-based AI build by adding two RTX 3090 GPUs.
  • The setup runs the 2.8-trillion-parameter Moonshot Kimi K3 model at 3.11 tokens per second.
  • Moving almost half of the model onto a RAM drive reportedly boosted performance by 41 percent.

Why it matters

It shows how a consumer-grade homelab with multiple GPUs and optimized memory placement can run a very large model, though the reported speed is modest and the details come from a single hobbyist build.

Who’s affected

  • Homelab enthusiasts running local large language models

A homelabber detailed improvements to the second-gen Optane AI build in a follow-up post on Reddit , showing the addition of two RTX 3090s to run the 2.8-trillion-parameter Moonshot Kimi K3 model at 3.11 tokens per second. Transferring almost half the model onto a RAM drive added…

Timeline

  1. Tom's Hardware reports on the homelabber's follow-up post detailing the upgraded build

  2. Latest from Tom's Hardware

    Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

How do you feel about this?

0 Comments