6 Open Source LLM Tools You Should Know

6 LLM Tools to Build Better Products & Do Things Faster

As the open-source ecosystem around Large Language Models (LLMs) continues to grow, developers and researchers are building an impressive set of tools to simplify everything from training to inference.

In this blog post, we spotlight six standout open-source projects — Transformer Lab, STORM, LLMs.txt Generator, YourBench, LiteLLM, and LoRAX — that address real-world challenges like benchmarking, serving, and managing fine-tuned models at scale.

Whether you’re fine-tuning models, evaluating their performance, or deploying them in production, these tools offer practical solutions to help streamline your workflow and make LLM development more accessible and efficient.

Table of Contents:

1. Transformer Lab — Open Source LLM Toolkit

2. STORM

3. LLMs.txt generator

4. YourBench

5. LiteLLM

6. LoRAX: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

---

---

1. Transformer Lab — Open Source LLM Toolkit

Transformer Lab is a 100% open-source toolkit for Large Language Models. You can use the Transformer Lab toolkit to train, tune, and chat with LLMs on your own Machine.

• One-click Download Hundreds of Popular Models

• Download any LLM from Huggingface

• Fine-tune / Train Across Different Hardware

• RLHF and Preference Optimization

• Work with LLMs Across Operating Systems

• Chat with Models

• Use Different Inference Engines

• Evaluate models

• RAG (Retrieval Augmented Generation)

• Build Datasets for Training

• Calculate Embeddings

• Full REST API

• Run in the Cloud

• Convert Models Across Platforms

• Plugin Support

• Embedded Monaco Code Editor

• Prompt Editing

• Inference Logs

2. STORM