Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

932

Base only

Active filters: 4bit

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 754 • 35

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 10 days ago • 14.3k • 51

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 10 days ago • 15k • 39

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 18.9k • 268

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 10 days ago • 18.1k • 69

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 4 days ago • 24.6k • 35

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated 4 days ago • 1.26k • 3

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 4 days ago • 2.18k • 5

Susant-Achary/smollm3-indian-recipes

Text Generation • Updated Jul 9, 2025 • 3 • 1

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 20.7k • 133

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated Mar 2 • 21.6k • 29

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 10 days ago • 7.57k • 22

LifetimeMistake/Qwen3-VL-Embedding-2B-AWQ-4bit

Feature Extraction • 2B • Updated Mar 31 • 330k • 2

Jiunsong/SuperGemma4-31b-abliterated-mlx-4bit

Text Generation • 31B • Updated Apr 15 • 14.5k • 43

majentik/gemma-4-31B-it-TurboQuant-AWQ-4bit

Image-Text-to-Text • Updated May 6 • 1

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 4 days ago • 12.3k • 8

MLXBits/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated May 12 • 732 • 21

aufklarer/Nemotron-3.5-ASR-Streaming-0.6B-MLX-4bit

Automatic Speech Recognition • 0.2B • Updated 25 days ago • 324 • 3

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated 4 days ago • 1.17k • 4

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 4 days ago • 3.6k • 7

DJLougen/Harmonic-Hermes-9B-MLX-4bit

Text Generation • 1B • Updated 15 days ago • 208 • 1

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 4 days ago • 5.01k • 5

Alennnndy/Qwen3.6-27B-GPTQ-4bit

Text Generation • 27B • Updated 6 days ago • 25 • 1

shamsghi/Qwen-9B-Claude-Fable-5-1M-MLX-4bit

Text Generation • 1B • Updated 5 days ago • 594 • 2

mradermacher/Ghanam-7B-Base-Pashto-v0.1-i1-GGUF

7B • Updated 10 days ago • 1.78k • 2

Mer0vin8ian/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 1 day ago • 1 • 1

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 9 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 10 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 7 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 5 • 2