LoRA Doesn't Approximate Fine-Tuning. It Changes What You Can Teach

LoRA isn't a discount version of full fine-tuning— it's a different optimization landscape, and preference optimization exposes exactly why that disti

Read Original

Related