The best LoRA alternatives

7 tools that do a similar job to LoRA, 7 of them open source. Each entry says what it does and who it suits, so you can pick the one that fits instead of the most famous.

You're replacing

LoRA

Python package loralib for adapting large PyTorch language models with small trainable low-rank matrices.

1. 1

   QLoRA

   Open source · MIT · ★ 11.1k

   A research method and code for fine-tuning large language models with much less GPU memory.

   Best for: Researchers reproducing or extending the QLoRA paper's finetuning results; Developers who want to finetune a large open LLM on limited GPU memory

   Full review LoRA vs QLoRA
2. 2

   Nano-vLLM

   Open source · MIT · ★ 16.3k

   A small, readable Python re-implementation of vLLM for running language models quickly.

   Best for: Developers who want to understand how LLM inference engines work internally; Students studying LLM serving and optimization techniques

   Full review LoRA vs Nano-vLLM
3. 3

   PyG

   Open source · MIT · ★ 24.1k

   A PyTorch library for building and training graph neural networks on structured data.

   Best for: Researchers who want ready-made implementations of published graph neural network methods; Python developers already comfortable with PyTorch who want to work on graph data

   Full review
4. 4

   ONNX Runtime

   Open source · MIT · ★ 22.2k

   A cross-platform library for running and training machine learning models quickly.

   Best for: Developers who want to deploy a trained model inside an application or service; Teams running the same model across Windows, Linux, macOS, or ARM devices

   Full review
5. 5

   pytorch-grad-cam

   Open source · MIT · ★ 13k

   Python library that shows which parts of an image a computer vision model looked at to make its prediction.

   Best for: Researchers comparing explainability methods for image models; Engineers debugging CNN or Vision Transformer classifiers in PyTorch

   Full review
6. 6

   Weights & Biases

   Open source · MIT · ★ 11.3k

   Python library to track, visualize, and manage machine learning experiments and models.

   Best for: Machine learning engineers who want to compare training runs over time; Researchers tuning hyperparameters across many experiments

   Full review
7. 7

   Petals

   Open source · MIT · ★ 10.7k

   Run big language models by sharing the work across volunteers' GPUs, BitTorrent-style.

   Best for: Developers who want to experiment with large open models like Llama 3.1 or BLOOM without owning the hardware to run them alone; Researchers prompt-tuning large models on their own tasks

   Full review

How we pick: tools in the same category that solve the same problem, projects that name each other as alternatives, and open-source projects that describe themselves as an alternative to LoRA. We don't take payment for placement.