International
The Morning Dev

Only the news worth knowing

‹
 

Release

Lawyer’s $9,450 private AI server of 12 used Nvidia V100s now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4

Tom's Hardware · By Shane Downing ·

Lawyer’s $9,450 private AI server of 12 used Nvidia V100s now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4

The Brief

  • A lawyer upgraded a private AI server from eight to twelve used Nvidia V100 GPUs.
  • The server now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4, per Tom's Hardware.
  • Reported performance reaches up to 184 tokens per second for code; long documents start answering in about half the time.

Why it matters

It shows that large open-weight mixture-of-experts models can be run on cheap, used datacenter GPUs in a private setup, which matters for developers weighing local inference against hosted APIs.

Who’s affected

  • Developers running local LLM inference on older Nvidia GPUs
  • Teams considering private hosting of DeepSeek models

A lawyer has upped the ante by upgrading his private AI server from eight to 12 used Nvidia V100s, which can run every DeepSeek V4.1 Flash expert at 4-bit NVFP4. Performance can reach up to 184 tokens per second for code, and long documents start answering in about half the time…

Timeline

  1. Tom's Hardware reports the lawyer's server upgrade to 12 V100 GPUs running DeepSeek V4.1 Flash at 4-bit NVFP4

  2. Latest from Tom's Hardware

    Lawyer’s $9,450 private AI server of 12 used Nvidia V100s now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4

How do you feel about this?

0 Comments

    Lawyer’s $9,450 private AI server of 12 used Nvidia V100s now runs every DeepSeek V4.1 Flash expert at 4-bit NVFP4 – The Morning Dev