FOUNDRY · MODEL SERVICES

Your data cannot leave.
Your AI can still be good.

Foundry trains a domain model inside your perimeter and hands you weights you own outright. You do not need a corpus to start: a few hundred real examples is enough, and we build the rest. Start with a one week audit that will tell you whether you need a model at all.

01/

One week corpus audit first, free while we build our first references

02/

full builds $15k to $120k

03/

no corpus required to start

04/

air-gap capable

Why this exists

A general model that has never seen your vocabulary

Every open checkpoint was trained on public web text. It has never seen your taxonomy, your regulatory vocabulary or your document formats. Running it on your own GPUs makes it private. It does not make it good at your job.

Foundry closes the gap: a model that knows your domain, serving on hardware you own, with the weights in your hands and no licence attached to them.

vllm.internal.acme-bank.corpsame box
general checkpoint
> classify: "NOSTRO recon break, val dt T+2"
› label: payment_issue
› confidence: 0.41
› tokens in: 31
private. does not know your vocabulary.
your domain model
> classify: "NOSTRO recon break, val dt T+2"
› label: nostro_break.value_date
› confidence: 0.96
› tokens in: 14
private. trained on your ground truth.

Build one when any of these is true

Your vocabulary breaks general models

Jargon, regulatory language and document formats that public web text never covered.

Inference cost is a line item

A frontier API on a repeated narrow task is the most expensive option. A small model trained for it costs a fraction, on hardware you own.

The data cannot leave the building

If hosted fine-tuning is closed to you for the same reasons as hosted inference, this is the path left.

What goes in

You do not need a corpus to commission a model

Most teams think they don't have enough data. Usually they mean volume, and we can solve for volume.

You bring the corpus

Your documents, tickets, filings, logs or code. We check duplication, PII, balance and template collapse first, and tell you in writing if it is too thin to build on. The cheapest path, with the least risk.

You bring a few hundred examples

How most projects start. About 500 real cases define the domain, and we expand them synthetically into training volume that stays within their distribution. Every rung is available this way.

You bring nothing but the domain

We curate a licence-filtered corpus from public sources and build against an eval suite agreed with you up front. It is how we trained our finance model on Hugging Face.

What a corpus plan looks like

Your path sets the token budget and the timeline, and the audit week settles it. Delivery is the same either way.

Synthetic data is decontaminated against the eval suite, so the scores at the end still mean something.

  foundry corpus plan acme_9b.yaml
# seed set you actually handed us
seed examples        412 real
  deduplicated         397
  quality filtered     361

# volume we generate from it
synthetic expansion  361 → 84,000
  grounded in seed distribution
  eval contamination   clean

# corpus we curate, when you have none
public domain crawl  11.4B tokens
  licence filtered     8.9B

total corpus         9.1B tokens
# your 412 examples set the target.
# they are not the training set.
What we build

Most people who ask for a model from scratch should not buy one

Three rungs. Picking the right one usually saves you money.

01

Fine-tuning

You want new behaviour, format, or task performance.

Instruction tuning or LoRA on an open-weights base. Delivered as safetensors and GGUF, deployable on your existing vLLM or Ollama setup.

2 weeks
from $15,000
min 500 examples
02

Continued pretraining

You want new domain knowledge, not just new behaviour.

Corpus construction, continued pretraining on an open base, then post-training. Most of the value of a from-scratch build at a fraction of the cost, and the right answer for most teams who ask for rung 3.

3 to 5 weeks
from $30,000
min 100M tokens or 500 seed examples
03

Pretraining from scratch

Only correct when one of these is true.
  • Your languages tokenize badly on existing vocabularies, making general models both expensive and inaccurate
  • Your data is not natural text: sequences, telemetry, logs, structured signals with no usable pretrained base
  • Every training token must be certifiable, so inheriting a model with an unauditable corpus is not permitted

Tokenizer design, corpus pipeline, architecture selection, pretraining, post-training, eval harness, technical report.

6 to 9 weeks
from $60,000
compute billed at cost plus 15%
min 10B tokens or 500 seed examples
Send the details Book the corpus audit

The clock starts at data access, not at signature. Training is rarely the long pole: a 9B model over 122B tokens is days on the right pod, and we shorten it with compute, never by cutting evaluation. Corpus readiness moves the date.

How Foundry works

We broke three of our own models learning this.

A bad config burns the compute. We check everything that can't be undone before a GPU hour is spent.

  • 1

    Scoped before it is sold

    One week, free while we build our first references. We audit your data, measure tokenizer fit and train small models on your corpus to see where the curve goes. You get a written report either way, and roughly half conclude that retrieval or a fine-tune is enough.

  • 2

    Gated while it runs

    The corpus is a versioned pipeline with lineage, verified PII redaction and checked balance. Configuration checks block the mistakes that cost us three models, and training records a second curve, because this failure never shows in the loss.

  • 3

    Validated before it ships

    We open the weights up (dead embedding rows, layer contribution, special-token health) and smoke-test them on your serving stack. Eval targets on your held-out ground truth are agreed in writing first. If the weights miss them, the remediation is ours.

  • 4

    Delivered, then done

    Safetensors and GGUF, the eval harness and the configs to reproduce the run. Serve them on your own vLLM or Ollama. The engagement ends there.

  foundry precheck acme_9b.yaml
# checked before a single GPU hour is billed

P1  weight decay excludes norm gains   BLOCK
     exclusion list is empty: every
     parameter decays, including the
     RMSNorm gains. invisible in loss.

P2  checkpoint interval fits tenure    BLOCK
     10000 steps on spot capacity:
     every preemption restarts at zero

P15 licence permits delivery terms     pass
P16 eval sets decontaminated           pass
P17 tokenizer fertility measured       warn

# 2 blocking. run not started.

Billing is by milestone: 30% on corpus delivery, 30% at the mid-training checkpoint with evaluation, 40% on final delivery. Compute is passed through at cost plus 15% and billed separately.

Where the build runs

Built for sealed networks first, available to everyone else

Built for isolated networks, but not limited to them. Where it runs is a compliance decision, not a product tier.

Inside the air gap

Offline install from mirrored images, training on isolated hardware, delivery on physical media. No licence server, telemetry or callbacks: your firewall rules are the control. Read the security page →

On your hardware

On your cluster or cloud account, against storage you control, with our engineers driving. For when residency rules bind the data but the network is not sealed. We bill engineering time only.

On our GPUs

No compliance boundary? Then you do not pay for one. You bring the domain, we bring the compute and the training stack, passed through at cost plus 15%.

Delivery is identical everywhere: safetensors and GGUF, the eval harness, the corpus pipeline and the training configuration, owned outright.

Depth

We have been to the bottom of this stack

Most custom-model vendors run someone else’s fine-tuning API behind a project plan. We pretrained a 9B mixture-of-experts model from scratch on 122 billion tokens (TPU v6e, MaxText and JAX): tokenizer, corpus pipeline, architecture, training loop and evaluation.

The technical report is public, including where the model underperforms and what we would do differently. Ask the same of anyone you let near your training data.

Read the technical report →

9B
parameters pretrained from scratch
122B
training tokens
TPU v6e
MaxText and JAX
Open
published report and eval harness

Everyone else rents you a model. We hand you one.

The weights end up yours

Safetensors and GGUF, the eval harness and the configs. No per-seat AI tax and no renewal date.

No outbound dependencies

Local inference, offline licence validation, your own SMTP and storage. Block us at the perimeter and it keeps working.

Small enough to actually run

Built in the 9B class, sparse where it helps, so it serves on the GPUs already in your rack.

Ask first

Not ready for a call? Send us the details.

A model engineer reads every one of these and replies in writing, usually within two working days. No sequence, no nurture track.

  • 1
    The task you want the model to do, in one or two sentences.
  • 2
    Roughly what data you hold for it: volume, languages, and whether it is natural text. “Almost none” is a valid answer and does not end the conversation.
  • 3
    The constraint that rules out a hosted API, if there is one. If there is not, say so. Plenty of builds run on our GPUs.

Prefer email? Write to contact@thinkingdbx.com. If your question is really "which rung do I need", the audit week answers it faster.

Start here

Start with the corpus audit

Bring the task and whatever data you have. We'll tell you which rung you need, including when the answer is don't build.

Or email contact@thinkingdbx.com.

  • 1

    Weights

    safetensors and GGUF, owned outright, no licence to renew.

  • 2

    Eval harness

    Built on your ground truth, so you can re-run it on every future version.

  • 3

    Corpus pipeline

    Versioned, contract enforced, with lineage from source rows to model version.

  • 4

    Training configuration

    The exact configs and report, so another team could reproduce the run.