# Inkling-2-Mini in 5.4 GB Memory

Source: [Hacker News: Front Page](https://github.com/ShinMegamiBoson/lookatmyquant) · 2026-11-21 · Community
Page: https://themorning.dev/story/inkling-2-mini-in-5-4-gb-memory-c6e0f6fe1d32263b
Kind: release · Impact: medium

## In brief

- LookAtMyQuant compresses the text weights of Inkling-2-Mini, a Thinking Machines model, from 18.89 GB.
- Two compressed versions are offered, at about 5.38 GB and 8.87 GB.
- The model has 26.4 billion physical parameters, of which 5.4 billion are active.

## Why it matters

A model of this size shrinking to roughly 5.4 GB makes it more practical to run locally on machines with limited memory.

## Coverage

- [LookAtMyQuant comprime Inkling-2-Mini para 5,38 GB](https://dev.to/guiadeti/lookatmyquant-comprime-inkling-2-mini-para-538-gb-2kfl) — DEV Community: python, 2026-11-21
- [Inkling-2-Mini in 5.4 GB Memory](https://github.com/ShinMegamiBoson/lookatmyquant) — Hacker News: Front Page, 2026-11-21

Tags: quantization, local-llm, model-compression, inkling-2-mini, memory-optimization

---

Brief generated by AI (claude-haiku-5-5) from the reporting listed under Coverage. Headlines belong to their publishers. The Morning Dev – https://themorning.dev
