Concept · Building with AI

Local model

Also called: local models, running models locally, run locally, run a model locally, local AI, local LLM, on-device model, self-hosted model, offline model

A model that is downloaded and run on a person's own computer or a company's own servers, not on a provider's. The data stays on that machine, and speed depends on its hardware.

For example: A developer downloads an open-weight model and runs it on a desktop computer with a strong GPU. The prompts never leave the building.

Connects to 20

• Weights Concept
• GPU Concept
• Open source vs open weights Concept
• Inference Concept
• Data privacy Concept
• Quantization Concept
• Apple Silicon Concept
• Hugging Face Tool
• Model provider Concept
• Llama Tool
• Gemma Tool
• FunctionGemma Tool
• Google AI Edge Gallery Tool
• Apple Foundation Models Tool
• LM Studio Tool
• SQLite Tool
• ONNX Tool
• Superwhisper Tool
• MacWhisper Tool
• Hex Tool