In this post, I'll be covering LoRA training and its recent incorporation into prime-rl for both SFT and RL finetuning, including practical implementation details & experimental training results for some of our RL environments.
prime-rl has full support for LoRA. We plan on continuing improving it with better LoRA algorithms and more efficient implementations. We also are working on MoE support, as well as the ability to train multiple LoRA adapters at the same time in preparation for our upcoming Reinforcement Fine-tuning API launch.