./tools/ram-calculator — a free tool

What size model can your machine actually run?

Type your unified memory (Apple Silicon) or GPU VRAM (PC) below. You get a memory budget and a straight verdict on the model sizes that fit — 7B, 13B, 32B, and 70B at 4-bit and 8-bit quantization.

Rather see it by real model than by size? → model-fit: which real models fit your machine

Wondering whether to buy hardware or just rent the API? → cost calculator: 3-year cloud vs. local

WANT THIS SET UP FOR YOU?on-site /packages

The calculator tells you what fits. If you'd rather have it running than figured out, that's the service.

see the packages → get the setup audit or book a call