Models & Inference
Models & Quantization
Model releases, quantization, evaluation, and practical tradeoffs.
Paste ur ggufs
Models & Quantization · 1 replies · 62 views · 1 month, 2 weeks ago
What quantization level do you actually settle on for daily use?
Models & Quantization · 0 replies · 52 views · 1 month, 2 weeks ago