Essential Resources
A curated collection of tools, model repositories, and communities for running local LLMs.
Model Repositories
Hugging Face
The primary hub for open-source AI models.
- huggingface.co - Browse thousands of models
- TheBloke - Quantized models for local use
- MaziyarPanahi - GGUF format models
Model Recommendations
| Model | Provider | Best For |
|---|---|---|
| Llama 3.2 | Meta | General purpose, coding |
| Mistral 7B | Mistral AI | Balanced performance |
| Phi-3 | Microsoft | Lightweight, capable |
| Gemma 2 | Open weights, efficient | |
| Qwen 2.5 | Alibaba | Multilingual support |
Tools and Platforms
Runners
| Tool | Platform | Difficulty |
|---|---|---|
| Ollama | Linux/macOS/Windows | Beginner |
| LM Studio | Windows/macOS/Linux | Beginner |
| KoboldCPP | Windows/Linux | Intermediate |
| Text Generation WebUI | All | Advanced |
Development
- llama.cpp - Core inference engine
- vLLM - High-throughput serving
- LocalAI - OpenAI-compatible API for local models
Hardware
GPUs
Pre-built Systems
- System76 - Linux laptops/desktops
- Puget Systems - Workstation builds
Communities
Forums and Discords
- r/LocalLLaMA - Reddit community
- Ollama Discord - Official Ollama chat
- LM Studio Discord - LM Studio community
- Hugging Face Discord - General AI discussion
News and Blogs
- The Decoder - AI news
- Hugging Face Blog - Model releases and tutorials
- Mistral Blog - Official announcements
Documentation
- Ollama Docs - Installation and usage
- llama.cpp Wiki - Advanced configuration
- Hugging Face Course - Free AI/ML education
Contributing
Found a resource that should be here? Let us know. This list will grow as the local AI ecosystem expands.