Transformers + PEFT + TRL
Composable Python APIs when you need control over loading, adapters, trainers, and alignment objectives.
Verify: Pin mutually compatible versions and test the exact model architecture, quantizer, and distributed launcher.
Open official documentation