Self-Hosted Index

Categories / Generative Artificial Intelligence (GenAI)

LLMKube

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

LLMKube preview image
Website
https://llmkube.com
Source code
https://github.com/defilantech/LLMKube
GitHub stars
249
Repository activity
1 November 2026
Latest release
v0.10.15, 31 October 2026
Health
Active From the repository record in this build
License
Apache-2.0
Platforms
Go, Docker, K8S
Categories
Generative Artificial Intelligence (GenAI)

More in Generative Artificial Intelligence (GenAI)

  • Ollama

    Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

    Replaces ChatGPT, OpenAI API

    185,606 stars Active

    31 Oct 2026 v0.40.13

  • Open-WebUI

    User-friendly AI Interface, supports Ollama, OpenAI API.

    Replaces ChatGPT, Claude

    157,488 stars Active

    29 Oct 2026 v0.12.5

  • LobeHub

    Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

    Replaces ChatGPT, Claude

    83,681 stars Active

    1 Nov 2026 v2.3.1-canary.2

  • AnythingLLM

    All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

    Replaces ChatGPT, Claude

    67,832 stars Active

    30 Oct 2026 v1.19.0

  • LocalAI

    Run your AI models locally and generate images and audio.

    Replaces OpenAI API

    50,117 stars Active

    2 Nov 2026 v4.12.1