LoRA
Low-rank adaptation
A fine-tuning technique that trains a small set of extra weights instead of the whole model. Cheaper, faster, easy to swap.
01In short
A fine-tuning technique that trains a small set of extra weights instead of the whole model. Cheaper, faster, easy to swap.
02Video
slot · videoLoRA in 90 secondsadd: GUIDES['lora'].video
03Guide
slot · guide
A step-by-step guide for “LoRA” goes here. Suggested outline:
- What it is — in one paragraph
- Why it matters in production
- How to do it — 3 to 7 steps
- Pitfalls we see in the field
04Checklist
slot · checklist
Four to eight things a team can tick before go-live.
05FAQ
slot · FAQ
The three questions clients actually ask about “LoRA”.
06Related terms
Training & adaptationFine-tuningFurther training a pre-trained model on your own examples to change its behaviour, format or style.Training & adaptationDistillationTraining a smaller model to imitate a larger one. You keep much of the quality at a fraction of the cost.Training & adaptationOverfittingWhen a model learns its training examples too well and fails on new ones.
Where we help · Build