awesome-llm-services

<p align="center">
  <img src="./assets/splash.webp" alt="Awesome LLM Services" width="100%">
</p>

<p align="center">
  <a href="https://awesome.re"><img src="https://awesome.re/badge.svg" alt="Awesome"></a>
  <img src="https://img.shields.io/badge/services-138%2B-blue" alt="Services">
  <a href="https://visitorbadge.io/status?path=https%3A%2F%2Fgithub.com%2Fav%2Fawesome-llm-services"><img src="https://api.visitorbadge.io/api/combined?path=https%3A%2F%2Fgithub.com%2Fav%2Fawesome-llm-services&countColor=%23263759&style=flat" /></a>
  <a href="https://discord.gg/8nDRphrhSF"><img src="https://img.shields.io/badge/Discord-Harbor-blue?logo=discord&logoColor=white" alt="Discord"></a>
  <a href="https://github.com/av/harbor"><img src="https://img.shields.io/badge/av-Harbor-black.svg" alt="av/harbor repo link"></a>
</p>

A list of **138+** LLM services, tools, and infrastructure for running AI locally. Criteria for inclusion:
- Open Source
- Self-hostable
- Friendly to containerization (Docker, Podman, etc.)
- Relates to homelab or personal AI use cases
- Well-documented with setup instructions

Relevance score (<img src="./assets/rocket.svg" width="16" height="16" style="vertical-align: middle;"> 0–100%): a composite metric of **Popularity** (logarithm of stars) and **Recency** (exponential decay with a 90-day half-life). This highlights projects that are both widely recognized and actively maintained.

## Contents

- [<img src="./assets/message-square.svg" width="16" height="16" style="vertical-align: middle;"> Frontends](#-frontends) - Chat interfaces and web UIs (19)
- [<img src="./assets/cpu.svg" width="16" height="16" style="vertical-align: middle;"> Backends](#-backends) - Inference engines and model servers (23)
- [<img src="./assets/satellite.svg" width="16" height="16" style="vertical-align: middle;"> Satellites](#-satellites) - Companion services and integrations (91)
- [<img src="./assets/workflow.svg" width="16" height="16" style="vertical-align: middle;"> Workflow & Automation](#-workflow--automation) - Visual programming platforms (13)
- [<img src="./assets/plug.svg" width="16" height="16" style="vertical-align: middle;"> API & Proxies](#-api--proxies) - LLM gateways and aggregators (24)
- [<img src="./assets/audio-lines.svg" width="16" height="16" style="vertical-align: middle;"> Audio & Speech](#-audio--speech) - TTS and STT services (6)
- [<img src="./assets/terminal.svg" width="16" height="16" style="vertical-align: middle;"> CLI Tools](#-cli-tools) - Terminal-based LLM tools (23)
- [<img src="./assets/flask-conical.svg" width="16" height="16" style="vertical-align: middle;"> Evaluation](#-evaluation) - Benchmarking and testing (2)
- [<img src="./assets/wrench.svg" width="16" height="16" style="vertical-align: middle;"> MCP Tools](#-mcp-tools) - Model Context Protocol (20)

---

## <img src="./assets/message-square.svg" width="16" height="16" style="vertical-align: middle;"> Frontends

Chat interfaces and web applications for interacting with language models.

#### <img src="https://github.com/Mintplex-Labs.png?size=200" width="14" height="14" style="vertical-align: middle;"> **[AnythingLLM](https://github.com/Mintplex-Labs/anything-llm)**<br>
<img src="./assets/rocket.svg" width="16" height="16" style="vertical-align: middle;"> 85% &nbsp; <img src="./assets/star-b3.svg" width="16" height="16" style="vertical-align: middle;"> 63.5k &nbsp; <img src="./assets/circle-dot.svg" width="16" height="16" style="vertical-align: middle;"> issues 3.7k (295 open, 3.4k closed) &nbsp; <img src="./assets/git-commit-horizontal.svg" width="16" height="16" style="vertical-align: middle;"> 2026-07-17<br>
<a href="https://github.com/Mintplex-Labs/anything-llm"><img src="https://img.shields.io/github/v/release/Mintplex-Labs/anything-llm?style=flat&label=release&color=7d8590" alt="Mintplex-Labs/anything-llm release"></a> <a href="https://github.com/Mintplex-Labs/anything-llm"><img src="https://img.shields.io/github/license/Mintplex-Labs/anything-llm?style=flat&label=license&color=7d8590" alt="Mintplex-Labs/anything-llm license"></a> &nbsp; <img src="https://img.shields.io/badge/Frontend-000000?style=flat" alt="Frontend"> <img src="https://img.shields.io/badge/Partial%20Support-000000?style=flat" alt="Partial Support"> <img src="https://img.shields.io/badge/RAG-000000?style=flat" alt="RAG"><br>
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

#### <img src="https://github.com/AstrBotDevs.png?size=200" width="14" height="14" style="vertical-align: middle;"> **[AstrBot](https://github.com/AstrBotDevs/AstrBot)**<br>
<img src="./assets/rocket.svg" width="16" height="16" style="vertical-align: middle;"> 80% &nbsp; <img src="./assets/star-b3.svg" width="16" height="16" style="vertical-align: middle;"> 36.5k &nbsp; <img src="./assets/circle-dot.svg" width="16" height="16" style="vertical-align: middle;"> issues 6.3k (1.0k open, 5.3k closed) &nbsp; <img src="./assets/git-commit-horizontal

... (truncated)