← All resources
GUIDE / FIELD NOTES

When is it time to fine-tune?

A practical starting point for choosing between prompting, retrieval, and adapting a model.

Start with a baseline

Build a small representative evaluation set and test your best prompt first. Record the failures you want to fix. Fine-tuning is easier to assess when you have a clear starting point.

Match the tool to the problem

Retrieval is useful when the model needs access to changing facts. Prompting can be enough for simple instructions. Fine-tuning is worth exploring when you need repeatable behaviors, a specific output format, or a consistent domain style. These approaches can work together.

Evaluate before deploying

Keep examples out of the training dataset for evaluation. Compare quality, latency, and cost against your baseline. Start with a limited rollout and revisit the decision when the task or data changes.

Bring your use case.

Explore the Forgedata platform or request early access to discuss what you are building.