Blog
Working notes for teams scoping a fine-tuning project: data volume, training methods and the running cost after launch. Each post cites the provider pages or papers it relies on.
What does it cost to host a fine-tuned model?
That turns on the billing unit for serving. Some charge tuned models per token at or near base-model rates; others put tuned models on dedicated GPUs billed by the second, minute or hour whether or not requests arrive. At low traffic, per-token serving is usually far cheaper. At steady high traffic, dedicated capacity can win.
Costs, last revised
How much data do you need to fine-tune an LLM?
For a narrow task with a clear right answer (classification, extraction, a fixed output format), a few hundred checked examples is often enough to see whether fine-tuning helps. Broader tasks need thousands. Whatever the size, hold back a separate evaluation set first, and spend on quality before quantity.
Data, last revised
LoRA, full fine-tuning and distillation in plain English
LoRA trains a small set of extra weights and leaves the base model untouched, so it is cheaper and easy to swap. Full fine-tuning updates every weight, costs more and can go further. Distillation trains a smaller model to copy a larger one's outputs, trading some quality for much cheaper serving.
Methods, last revised
Get a quote
Only three things are needed: the company's ZIP code, where to send our answer, and a short sketch of the project in taps. The answer names providers whose published offers line up with it.
Keep data out of this form: no samples, records, weights or keys. Describing the task in words gives us enough to work with.
This site is an introduction service, and a provider it introduces you to may pay it a fee. Your details stay with us until you approve a named provider.
Received. Thanks for the outline.
- Next we set it against the published offers of fine-tuning providers: their models, methods and deployment options.
- An email follows naming the ones that fit, with a reason for each. Your details go nowhere until you approve one.
- From there, that provider deals with your team directly and prices the job. This site plays no part in the contract.