Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,145

Base only

Active filters: 6-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 97.7k • 147

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 18, 2024 • 77.6k • 11

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 7 • 37

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • 8B • Updated Oct 29, 2024 • 1.65k • 7

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • 7B • Updated Nov 6, 2024 • 47 • 2

Float16-cloud/llama3.2-typhoon2-3b-instruct-mlx-6bit

Text Generation • 0.7B • Updated Dec 21, 2024 • 26 • 1

mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit

Text Generation • 0.7B • Updated Apr 23, 2025 • 583 • 4

dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated Apr 28, 2025 • 25 • 32

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 39.3k • 3

Ex0bit/MYTHOS-26B-A4B-PRISM-PRO-DQ-MLX

Image-Text-to-Text • 6B • Updated Apr 11 • 3.04k • 21

nightmedia/Qwen3.6-35B-A3B-Holo3-Qwopus-Instruct-qx64-hi-mlx

Image-Text-to-Text • 9B • Updated Apr 22 • 734 • 2

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-6Bit

Text Generation • 27B • Updated May 13 • 117 • 7

deepsweet/Qwen3.6-35B-A3B-MLX-oQ6

Text Generation • 8B • Updated May 10 • 68 • 3

Jundot/Qwen3.6-27B-oQ6-mtp

7B • Updated May 12 • 1.29k • 7

Jundot/Qwen3.6-35B-A3B-oQ6-mtp

8B • Updated May 12 • 971 • 5

nightmedia/Qwen3.6-35B-A3B-MTP-Holo3-Qwopus-Coder-qx64y-hi-mlx

Image-Text-to-Text • 9B • Updated May 26 • 2.48k • 4

lmstudio-community/Qwen3.6-27B-MLX-6bit

Image-Text-to-Text • 6B • Updated Jun 2 • 955k • 3

mlx-community/gemma-4-12B-6bit

Any-to-Any • 3B • Updated Jun 3 • 901 • 3

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.32k • 6

lexrivera/zerank-2-reranker-mlx-6Bit

Text Ranking • 0.9B • Updated Jun 15 • 34 • 1

deadbydawn101/RavenX-OpenFable-Qwopus-Coder-Holo3-Qwen3.6-35B-A3B-MTP-mlx

Text Generation • 35B • Updated 26 days ago • 224 • 5

porschefreak/Qwen3.6-35B-A3B-MTP-Holo3-Qwopus-Coder-qx64y-hi-mlx-mlx-4Bit

Image-Text-to-Text • 35B • Updated 27 days ago • 842 • 1

AtomicChat/ornith-9b-MLX-6bit

Text Generation • 9B • Updated 20 days ago • 2.88k • 2

deepsweet/Ornith-1.0-35B-MLX-oQ6

Text Generation • 8B • Updated 19 days ago • 299 • 1

pipenetwork/Hy3-6bit

Text Generation • 295B • Updated 10 days ago • 309 • 1

AnuAmba/Ornith-9B-6bpw-exl3

Text Generation • 5B • Updated 9 days ago • 122 • 1

georgeis55/Nemotron-Labs-3-Puzzle-75B-A9B-MLX-6bit

Text Generation • 75B • Updated 8 days ago • 756 • 2

tekosML/Nemotron-Labs-3-Puzzle-75B-A9B-MLX-4bit-experts-6bit

Text Generation • 75B • Updated 6 days ago • 284 • 1

felkf/Qwen3.6-35B-A3B-Fable-5-Distill-oQ6-fp16-mtp

8B • Updated about 15 hours ago • 145 • 1

nathansutton/Ornith-1.0-35B-Q6-MLX

Text Generation • 35B • Updated 4 days ago • 272 • 1