Open-weights decision model

torchcast-decision-12b

Ask for private hosting, call it as an API, run it locally, or get it pre-installed.

Dedicated hosting · on request

Hosting torchcast-decision-12b needs the author’s OK

Best for steady traffic and privacy.

torchcast-decision-12b is released under CC BY-NC 4.0, which limits commercial use. Tell us what you want to do and we ask the author for you. We reply within one business day.

Not self-serve yet

We’ll email you once. Nothing else.

Hosted API

Best for trying it or low volume.

On request

Want torchcast-decision-12b as pay-per-token? Tell us. We add models based on demand.

We’ll email you once when it’s live. Nothing else.

Run locally

Best for testing offline.

One installer checks your hardware, downloads torchcast-decision-12b and starts a local endpoint.

Needs
40 GB GPU memory · runs on RTX PRO 6000 Blackwell (96 GB)
Licence
The model's listed licence does not allow commercial use.
Get the installer The installer is free for individuals and small companies. The model’s licence still applies (CC BY-NC 4.0).

Pre-installed hardware

Best for data that must stay on site.

A ready-to-run box with torchcast-decision-12b installed, delivered to you. Suggested: NVIDIA RTX PRO 6000 Blackwell (96 GB) workstation.

from $25,359 one-off, indicative
Ask for a quote We reply within one business day.

Model facts

Model
torchcast-decision-12b
Author
Torchcast AI
Size
12B parameters · about 33 GB GPU memory to serve (BF16)
Base
google/gemma-4-12B-it
Weights
torchcast-ai/torchcast-decision-12b
Licence
CC BY-NC 4.0
JevBench
#10 on the open-weights board · capability 71.7 · details

Benchmark data from Benchmark Heaven. Model names belong to their authors; we host the published weights.

Dedicated hosting — good to know

What exactly do I get?

A private, OpenAI-compatible endpoint that serves only torchcast-decision-12b on GPUs reserved for you, with API keys you control, a live status page, request counts and spend. The model is pinned to an exact published revision.

How is it billed?

From your prepaid Decision Models balance, in blocks: one hour at a time for “always on”, 15 minutes at a time while warm for “scale to zero”. VAT is applied when you top up. The next block is charged just before the current one ends. When your balance can’t cover the next block, the endpoint stops — you are never billed beyond your balance. Optional daily and monthly caps.

What does “scale to zero” mean?

After a quiet period (15 minutes by default) we stop the GPU. The next request wakes it; until it is ready the endpoint answers 503 with a Retry-After header. A cold start takes a few minutes: a fresh GPU host loads the server and the weights (the estimate for your choice is shown above). Great for batch jobs and prototypes; pick “always on” for live traffic.

EU or Global?

EU — hosting in EU, built for GDPR, aligned with the EU AI Act. Runs on GPUs of an EU provider in EU data centres. Global — lowest price. GPUs from independent and data-centre providers worldwide. Choose EU for personal or regulated data.

Do you store my prompts?

No. Requests pass straight through to your model server; we keep only counts (requests, tokens, errors) for your dashboard. Your prompts are processed on the GPU that runs your endpoint — on Global that GPU belongs to an independent or data-centre provider, so choose EU for personal or regulated data.