Topic: fine-tuning
-
LoRA: low-rank adaptation and what its memory savings actually cover
LoRA learns a low-rank update while keeping base weights frozen. It reduces trainable parameters and their optimizer state, but the base model, activations and deployment compatibility still matter.
Machine-readable: JSON