To Data & Beyond

To Data & Beyond

Share this post

To Data & Beyond
To Data & Beyond
6 Open Source LLM Tools You Should Know
Copy link
Facebook
Email
Notes
More

6 Open Source LLM Tools You Should Know

6 LLM Tools to Build Better Products & Do Things Faster

Youssef Hosni's avatar
Youssef Hosni
May 05, 2025
∙ Paid
11

Share this post

To Data & Beyond
To Data & Beyond
6 Open Source LLM Tools You Should Know
Copy link
Facebook
Email
Notes
More
1
Share

Get 50% off for 1 year

As the open-source ecosystem around Large Language Models (LLMs) continues to grow, developers and researchers are building an impressive set of tools to simplify everything from training to inference.

In this blog post, we spotlight six standout open-source projects — Transformer Lab, STORM, LLMs.txt Generator, YourBench, LiteLLM, and LoRAX — that address real-world challenges like benchmarking, serving, and managing fine-tuned models at scale.

Whether you’re fine-tuning models, evaluating their performance, or deploying them in production, these tools offer practical solutions to help streamline your workflow and make LLM development more accessible and efficient.

Table of Contents:

  1. Transformer Lab — Open Source LLM Toolkit

  2. STORM

  3. LLMs.txt generator

  4. YourBench

  5. LiteLLM

  6. LoRAX: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs


My New E-Book: LLM Roadmap from Beginner to Advanced Level

Youssef Hosni
·
June 18, 2024
My New E-Book: LLM Roadmap from Beginner to Advanced Level

I am pleased to announce that I have published my new ebook LLM Roadmap from Beginner to Advanced Level. This ebook will provide all the resources you need to start your journey towards mastering LLMs.

Read full story

1. Transformer Lab — Open Source LLM Toolkit

Transformer Lab is a 100% open-source toolkit for Large Language Models. You can use the Transformer Lab toolkit to train, tune, and chat with LLMs on your own Machine.

  • One-click Download Hundreds of Popular Models

  • Download any LLM from Huggingface

  • Fine-tune / Train Across Different Hardware

  • RLHF and Preference Optimization

  • Work with LLMs Across Operating Systems

  • Chat with Models

  • Use Different Inference Engines

  • Evaluate models

  • RAG (Retrieval Augmented Generation)

  • Build Datasets for Training

  • Calculate Embeddings

  • Full REST API

  • Run in the Cloud

  • Convert Models Across Platforms

  • Plugin Support

  • Embedded Monaco Code Editor

  • Prompt Editing

  • Inference Logs

2. STORM

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2025 Youssef Hosni
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More