Practical tools for system, network, security, and operations administrators.

CLD-C0163 · AI/ML & GPU Cloud

Self-Hosted LLM vs API Costs

Compare a self-hosted model with an API as an estimate you type. Do not expose a port, and do not put a customer prompt in the note.

Updated 25 October 2026 · Comparison

This is an original planning guide. It is not a vendor manual, an official standard, or legal advice. Example addresses use documentation ranges. Review every command before you paste it.

What this hour is for

Self-Hosted LLM vs API Costs is a calculator and a hosting note. The numbers are not a bill. Do not publish the self-hosted port. Do not put a customer prompt, a key, or a secret in the note. Do not start a service during the reading.

Write the account, project, or repository you administer, the name of this change, and the time. A second change waits until this line has been read back.

The browser tool drafts text or reads a paste you already hold. It does not log in, it does not scan, and it does not apply.

192.0.2.10/24, gateway 192.0.2.1, 198.51.100.0/24, 203.0.113.0/24, and 2001:db8::/32 are documentation. example.com is a documentation name. A sample password is replaced.

The change you can finish

Apply nothing while you are writing the note. When the lab window opens, it is one change on the account named in the ticket. Read the draft, then the account, then decide.

Rollback is the previous file, the previous plan, or the lab resource you can delete because it was only a lab.

  1. Write the comparison as an estimate.
  2. Leave keys out of the note.
  3. Do not publish a port.
  4. Do not start the service.
  5. Stop.

Mistakes that outlive the statement

Self-Hosted LLM vs API Costs goes wrong in a small set of ways. The list is here so the ticket can forbid them before the window.

Decisions to write down

One decision for Self-Hosted LLM vs API Costs: The figure is an estimate. No key is in the note. Nothing is published. Nothing is started. And one comparison is enough.

Checks before you call it done

Confirm this before you call the change done: The estimate is labelled. No key is in the note. Nothing was started. No port was published. And a second person can say it is not a bill. If one of those fails, stop.

# LLM cost estimate. Not a bill.
# Do not publish the port. Do not paste a key.

Before you leave the account

Self-Hosted LLM vs API Costs ends when the account in the note is the account in the ticket. If it is not, stop.

The draft stays a draft until a person has read the names in it. A generator does not log in, does not apply, and does not scan.

192.0.2.10/24, gateway 192.0.2.1, 198.51.100.0/24, 203.0.113.0/24, and 2001:db8::/32 are documentation. example.com is a documentation name. A sample password is replaced. It is not a password you keep. 10.0.0.0/16 is a sample prefix, not a network you publish unless you already use it.

prompt-for-this is a reminder that a secret is missing. It is not an access key, a token, or a password you save. An Azure secret draft may contain a sample password. Replace it. Do not file it.

One change is the window. If two things move and the result is wrong, you will not know which one did it.

If the same step fails twice, stop for the day. Restore the copy you took first.

A second person reads the account and the change aloud. If they cannot find them in the ticket, the note is not done.

This page is a planning guide. It is not a vendor manual, not an official standard, not legal advice, and not an audit opinion. You do not apply it against an account you do not administer.

Tools for this guide

These tools run in the browser on this site. They do not log into your machines.

More in this cluster

The pillar for this page, and the next published pages filed with it.