Categories / Generative Artificial Intelligence (GenAI)
LLMKube
Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

- Website
- https://llmkube.com
- Source code
- https://github.com/defilantech/LLMKube
- GitHub stars
- 249
- Repository activity
- 1 November 2026
- Latest release
- v0.10.15, 31 October 2026
- Health
- Active From the repository record in this build
- License
- Apache-2.0
- Platforms
- Go, Docker, K8S
More in Generative Artificial Intelligence (GenAI)
Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Replaces ChatGPT, OpenAI API
185,606 stars Active
31 Oct 2026 v0.40.13
157,488 stars Active
29 Oct 2026 v0.12.5
LobeHub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
83,681 stars Active
1 Nov 2026 v2.3.1-canary.2
AnythingLLM
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
67,832 stars Active
30 Oct 2026 v1.19.0
50,117 stars Active
2 Nov 2026 v4.12.1