LoRA (low-rank adaptation)

LoRA freezes the large model and adds a few extra trainable parameters. This drastically reduces memory and computing requirements; results often come close to full fine-tuning.

LoRAs are particularly well known for image models: they can teach a model a particular style, product or character. The small LoRA files are easy to swap and combine.