smartllm

The smart layer above the model

An OpenAI-compatible API to open-weights models on our own hardware in Austria. Aliases that carry policy. Privacy in stages, up to an LLM-backed check. And every number on this page is measured nightly — not promised.

nightly-benchmark bench.smartllm — live datasheet
0
Tokens served
0
Measured throughput, up to
0
Open-weights models
0
Data stays in the EU
Benchmarked nightly with published methodology. Median of repeated runs, warm-up discarded.
what this actually is

One layer that organises everything in one place

Your app talks to a name. What happens behind it — which model, which provider, how much privacy — you configure here and change any time, without touching a line of code. Try it:

your app
big-fat-model
unchanged in your code
ALLSmartLLM
Target
  • own models
  • OpenRouter · your key
resolves to Qwen 3.5 · 397B
Privacy
  • off
  • pseudonymize
  • strict
not needed — prompt stays in the house
own hardware · AT
15 open-weights models in Upper Austria. Prompts terminate on hardware we own.
OpenRouter · your key
Your contract, your key. Leaves the EU only through the masking layer.
What your app sends
Please reply to Mr. Huber, the mayor of Musterstadt,
at Bauer GmbH re invoice 2026-0417,
account AT61 1904 3002 3457 3201.
API key for the import: sk-live-9f2ac41b8e
What the target sees — own hardware
Please reply to Mr. Huber, the mayor of Musterstadt,
at Bauer GmbH re invoice 2026-0417,
account AT61 1904 3002 3457 3201.
API key for the import: sk-live-9f2ac41b8e
Unchanged — the prompt stays on our hardware in Austria.
01

Own inference

Open-weights models on hardware we own — in Upper Austria. No sub-processors, no third countries, no reselling of third-party APIs.

15 models · benchmarked nightly · operator based in Wels
02

One name, any model

An alias bundles model, provider and policy. It points at our own models — or, with your own key, outside. Switching models means: change it here, nothing else.

frontier · big-fat-model · external allowed
03

Privacy on tap

Per alias in stages: names, addresses, IBANs — and API keys, tokens and credentials that end up in prompts by accident. Only what's allowed to leave, leaves.

mask · pseudonymize · strict with LLM check on own HW
layer

Inference is the raw material. This is the layer that makes it usable.

The smart part was never the model. It's what surrounds it: routing, policy, privacy, proof.

One API, your aliases

An alias is more than a model name — it bundles model, provider and privacy policy. Swap the model centrally; your application never changes.

big-fat-model ──► kimi-k3 kimi-k3.1
// alias updated · zero code changes · apps keep running

Privacy in stages

Mask, pseudonymize, or go strict: an LLM on our own hardware double-checks for indirect identifiers before anything leaves the EU.

mask pseudonymize strict
Please reply to <<PERSON_1>> from <<ORG_1>> regarding invoice <<IBAN_1>>
Mapping lives in request memory only. Never stored, never logged.

Your data stays in Europe

Our own hardware in Austria. No sub-processors, no third countries. External frontier models are reachable — but only through the masking layer.

your app ──► ALLSmartLLM · AT ─▍ third country
Prompts terminate on hardware we own — or leave masked, by your policy.

Measured, not promised

Nightly benchmarks with published methodology. Detection recall for the privacy layer as a number, not an adjective.

Qwen 3.5 397B
26.5 t/s
Nemotron 3 Omni
39.9 t/s
Nemotron Cascade 2
40.2 t/s
Decode rate, streaming, median of repeated nightly runs.
start

First response in under five minutes

If your software speaks OpenAI, it already speaks ALLSmartLLM. Change one URL.

step 1

Create your account

10M tokens free to test and set up. No card, no subscription.

free tokens10,000,000
step 2

Get your API key

One key, all models, all aliases. Usage-based, nothing else.

SMARTLLM_API_KEY••••••••••••
step 3

Make your first request

Call an alias, not a model version. Privacy is one parameter.

curl https://api.smartllm.at/v1/chat/completions \
  -H "Authorization: Bearer $KEY" \
  -d '{
    "model": "frontier",
    "privacy": {"mode": "pseudonymize"},
    "messages": [...]
  }'

Later, host it yourself: same API on your own hardware. When your box is running, you change one URL — done.

models

Curated open-weights models

Vetted, benchmarked, and kept current. Aliases follow our recommendation — or pin a version and stay.

Model Alias Context Measured Status
Qwen 3.5 397B frontier 256K 26.5 t/s loaded
Nemotron 3 Omni 128K 39.9 t/s on-demand
Nemotron Cascade 2 256K 40.2 t/s on-demand
Phi 4 16K on-demand
Qwen 3.6 35B mid vision coder 32K 53.5 t/s loaded
15 models · all on dedicated hardware in Upper Austria View all models & nightly benchmarks →
pricing

€8 per million tokens. That's the pricing page.

All models, one price. 10M tokens free. No base fee, no subscription — usage only.