⚡

China Mirror - All files hosted on domestic servers, no VPN required, faster downloads

🚀 One-Click Install (Recommended)

Run the following command in terminal to automatically download and configure everything:

curl -fsSL https://lingkong.xyz/install.sh | bash

Supports macOS (Apple Silicon) and Linux (x86_64), auto-downloads models and configures environment

🤖 AI Model Files

gemma-3n-E2B-it-Q4_K_M.gguf Required
Gemma 3n text model - 4-bit quantized, supports multi-turn chat
💾 2.6 GB 📊 Q4_K_M
⬇ Download
gemma-3n-vision-mmproj-f16.gguf Optional
Vision model - supports image analysis and description
💾 570 MB 🎨 Vision
⬇ Download
gemma-3n-audio-mmproj-f16.gguf Optional
Audio model - supports speech transcription and audio analysis
💾 1.3 GB 🎤 Audio
⬇ Download
📦 Total models size: 4.5 GB

💻 Program Files

llama-lingkong-macos-arm64.tar.gz
macOS Apple Silicon (M1/M2/M3) inference engine
💾 ~50 MB  macOS ARM64
⬇ Download
llama-lingkong-linux-x86_64.tar.gz
Linux x86_64 inference engine (CPU)
💾 ~50 MB 🐧 Linux x64
⬇ Download
llama-lingkong-linux-x86_64-cuda.tar.gz CUDA
Linux x86_64 with NVIDIA CUDA acceleration (Ubuntu 22.04+)
💾 ~80 MB 🐧 Linux x64 🎯 CUDA 12.x
⬇ Download
webui.tar.gz
Web interface - includes chat UI and API service
💾 ~80 MB 🌐 Python Flask
⬇ Download

🔌 Network Issues? Manual Download

If download is interrupted, use download tools (like wget) and manually place files in the specified directory:

📁 Model Files Location

~/.lingkong/models/

i.e.: /Users/your-username/.lingkong/models/ (macOS) or /home/your-username/.lingkong/models/ (Linux)

📋 Steps

  1. Create directory: mkdir -p ~/.lingkong/models
  2. Download model files using your download tool
  3. Move downloaded .gguf files to ~/.lingkong/models/
  4. Keep file names unchanged:
    • gemma-3n-E2B-it-Q4_K_M.gguf (required)
    • gemma-3n-vision-mmproj-f16.gguf (optional)
    • gemma-3n-audio-mmproj-f16.gguf (optional)
  5. Run install script, it will skip existing models:
    curl -fsSL https://lingkong.xyz/install.sh | bash

🔄 Resume Download

Use wget with resume support, can continue download after interruption:

💡 Tip: wget -c will auto-resume, just re-run if interrupted

📂 Complete Install Directory Structure