LLM Hoster

Turn your Android phone into a powerful, private AI server — no cloud, no subscription, no data leaving your device. LLM Hoster lets you download and run large language models (LLMs) directly on your phone using the llama.cpp inference engine, and exposes a fully compatible API over your local network. Use it with any client that supports the baseAPI/v1API — Open WebUI, Continue.dev, Chatbox, LM Studio, or your own apps. ━━━━━━━━━━━━━━━━━━━━ 🔒 COMPLETELY PRIVATE Your data never leaves your device. No internet required for inference. No API keys, no cloud costs, no telemetry. What happens on your phone stays on your phone. 📥 ONE-TAP MODEL DOWNLOADS Browse and download GGUF models from Hugging Face with a single tap. Just paste a repo name like "author/model_name-GGUF" — the app automatically finds and downloads the best quantized version for mobile. 🌐 /v1-COMPATIBLE API Expose a real REST API on your LAN: • GET /v1/models • POST /v1/chat/completions • POST /v1/completions Connect from your laptop, tablet, or any device on the same network. 💬 BUILT-IN CHAT Chat with your loaded model directly inside the app. No external client needed for quick conversations. ⚡ PERFORMANCE TUNING Fine-tune inference for your device: • CPU core allocation (2–8 threads) • KV cache quantization (q4_0, q8_0) • Context window size (2K–16K tokens) • Batch size control • GPU layer offloading • Flash Attention support 🔧 RUNS IN THE BACKGROUND A foreground service keeps the server alive even when you switch apps. Stop it anytime from the notification shade. ━━━━━━━━━━━━━━━━━━━━ SUPPORTED MODELS Works with any GGUF-format model. Recommended starting points: • Llama 3.2 (1B / 3B) • Phi-3 Mini • Gemma 2 (2B) • Qwen 2.5 (1.5B / 3B) • Mistral 7B (Q4 quantized) Smaller quantized models (Q4_K_M, Q4_0) run best on phones. Models are stored locally and persist across sessions. ━━━━━━━━━━━━━━━━━━━━ USE CASES • Private AI assistant with zero cloud dependency • Development & testing of LLM-powered apps • Offline AI in areas with limited connectivity • Learning and experimenting with open-source models • Serving AI to multiple devices on your home network ━━━━━━━━━━━━━━━━━━━━ No ads. No tracking. No accounts. Just AI on your phone. Download LLM Hoster and start hosting your own private AI server today.