---
name: peft-lora-qlora
description: Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models
  (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter
  serving. HuggingFace's official library integrated with transformers ecosystem.
license: MIT
---

# peft-lora-qlora

Read [the full guide](references/full-guide.md) when this skill applies.