Community index

Boards

Discussion about local models, runtimes, hardware, and projects.

Models & Inference

Models, quantization, evaluation, and local inference software.

Models & QuantizationModel releases, quantization, evaluation, and practical tradeoffs. Runtimes & ToolingLocal inference runtimes, APIs, integrations, and tooling.

Hardware & Projects

The machines, workflows, and projects that make local AI useful.

HardwareGPUs, CPUs, memory, thermals, laptops, and practical upgrades. Projects & WorkflowsShare useful local-AI projects and repeatable workflows.