LoRA（低秩适配）

Efficient fine-tuning that trains only a few low-rank matrices.

LoRA freezes original weights and trains low-rank side matrices only, cutting trainable parameters by over 99% and slashing memory and storage. QLoRA adds 4-bit quantization, enabling single-GPU fine-tuning of large models.