What a Local AI Setup Actually Costs, Start to Finish
The model weights are mostly free. You pay for the machine and the labor of making it safe and useful. What a private-AI project looks like from audit to handoff, and what each price tier buys.
Summary
The first surprise for most buyers is that the model is not the expensive part. The open-weight models that make local AI work are largely free to download; what you actually pay for is the hardware and the labor of selecting it, securing it, and making it genuinely useful to your staff. A private-AI project has a recognizable shape — audit, scope, hardware, install, validation, handoff, support — and the price scales with how much of that you want done for you rather than on you. This post walks through the shape and the tiers so you can see where the money goes and where it doesn't.
The project has a shape
Every local-AI deployment, whether it is a two-week engagement or a two-day one, follows the same arc:
- Audit. What do you actually want the model to do, on what data, for how many people, under what constraints?
- Scope. Pick the model, the hardware, and the integration surface, and price it against the requirements.
- Hardware. Buy and unbox the machine (or use one you already own).
- Install and configure. Inference stack, model download, quantization, access controls, encryption, audit logging.
- Validate. Test the thing against your real tasks and your real data, not a demo.
- Handoff and train. Show staff what it does well and where to stop trusting it.
- Support. Keep it patched and working.
You can do all of that yourself. Most regulated small businesses don't want to, and the price tiers are really just a question of which steps you are buying.
The audit: paying to scope it correctly
An on-site audit is the fixed-price entry point — $899 — and it exists because the most expensive mistake in this business is buying the wrong machine. The audit is where we look at your actual workloads, your data, your headcount and concurrency, and your compliance obligations, and turn that into a concrete recommendation: this model, this box, this memory, this budget. If the honest answer is "you don't need on-prem, the cloud is fine for what you do," the audit is where you hear it, before you spend four figures on hardware. Paying a small amount to scope correctly is cheaper than paying a large amount to scope incorrectly.
Hardware is the biggest line item
The machine is where most of the project cost actually lives. For a single practitioner or a small office, a capable workstation-class box lands in the low-to-mid four figures — a Mac Studio starts at $2,499 (M5 Max), $5,499 with M5 Ultra, with up to 512 GB of unified memory, and compact local-AI boxes like NVIDIA's DGX Spark sit in the same broad range. Bigger memory buys the ability to run bigger models and serve more simultaneous users; that trade is exactly what the RAM calculator and the model-fit tool are for. You may already own something usable, and part of the audit is telling you when your existing machine is good enough.
Deployment tiers: what scales
The deployment work — turning a box into a secure, working, documented system — scales with complexity. Our packages step up in three tiers, and the difference is not "the cheap one is worse." It is how much integration and how much hardening the job requires:
- $4,500 covers a straightforward single-machine setup: one model, local use, standard access controls, encryption at rest, and a documented handoff. This is the right shape for a solo practitioner or a small office with one clear use case.
- $9,500 is for a real office deployment: multiple users, concurrent access, a heavier model or several models, structured output for a specific workflow, and the configuration that keeps a busy staff from stomping on each other.
- $18,000+ is the deep-integration tier: custom tooling against your existing systems, a compliance posture with audit logging and a documented risk analysis, and the kind of environment a regulated firm needs to defend in front of an auditor.
The tiers are ranges because the right number depends on what you already have and what you actually need — that is what the audit is for. What you are buying in all three is the same thing: the labor of making it correct, secure, and useful.
Ongoing: the part nobody budgets for
A local-AI system is not a one-time purchase; it is a small server you now own. Ongoing plans — starting at $750/mo, and $2,500/mo for heavier environments — cover patching, model updates, monitoring, and someone to call when it breaks. The honest framing is that this is the equivalent of paying your own IT to keep a server alive, except the server also runs your models. Skip it and you own the operations burden yourself, which is fine if you have someone technical on staff and a liability if you don't.
The small-ticket items
Not everything is a four-figure engagement. There are digital downloads in the $29–$69 range for things you can consume on your own, and remote advisory at $250 and $650 for a scoped consultation where you do the hands-on work and we tell you what to do. If you are technical and want to self-install, the remote tier is the cost-effective way to get the audit's judgment without the on-site visit.
What you are not paying for
Three things it is worth understanding clearly:
The model weights. The open-weight models are largely free. You are not paying a per-seat license to an AI vendor; you are paying for hardware and labor.
Per-token charges. There is no meter. Once the box is running, the marginal cost of a query is electricity, not a token bill.
A business associate agreement. Because there is no third party holding your data, there is no BAA to negotiate — that problem is structurally gone. (The compliance obligations that remain are covered in the HIPAA post.)
The flip side of all three is that you are now carrying the fixed cost of a machine and the responsibility for it. The setup guide walks through what that responsibility actually looks like, step by step.
Key takeaways
- The model is not the expensive part. Weights are mostly free; you pay for hardware and labor.
- The audit is cheap insurance. $899 to scope correctly is cheaper than four figures spent on the wrong machine.
- Hardware is the biggest line. A capable machine is low-to-mid four figures, scaling with memory and concurrency — size it with the RAM calculator.
- Deployment scales with integration. $4.5k single-machine, $9.5k office, $18k+ deep-integration — the tiers buy more integration and hardening, not "a better model."
- Budget for ongoing. $750/mo to $2,500/mo keeps it patched and supported; otherwise you own the operations burden.
- There is no meter and no BAA. Flat cost, no per-token charges, and no third party holding your data — in exchange for a fixed cost and a responsibility you now carry yourself.
Sources
- Apple Newsroom — Mac Studio announcement (starting price, up to 512 GB unified memory): https://www.apple.com/newsroom/2026/09/the-new-mac-mini-and-mac-studio-are-available-today/
- NVIDIA — DGX Spark product page: https://www.nvidia.com/en-us/products/workstations/dgx-spark/
The $899 audit, the $4.5k / $9.5k / $18k+ deployment tiers, and the $750–$2,500/mo support plans are RobotNurse's own fixed prices (published on this site's pricing pages), not third-party benchmarks. Hardware figures are Apple's and NVIDIA's published starting prices.
Everything in these notes I also do for hire: local AI set up on hardware you own, configured on-site, then handed over with enough documentation that you do not need me afterward. If that sounds more useful than another weekend of reading forum threads, the details are at /work. No obligation from an email, and the posts stay free either way.