Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: IQ4_NL

Brunobkr/OFFELLIA_IQ4_NL_gemma-4-12B-it.gguf

Image-Text-to-Text • 12B • Updated 4 days ago • 506 • 1

roleplaiapp/SmallThinker-3B-Preview-IQ4_NL-GGUF

Text Generation • 3B • Updated Jan 16, 2025 • 4

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 539 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 415 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 544 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 596 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 1.37k • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 432 • 2

sunil-pathak/gemma-4-E4B-it-IQ4_NL

Text Generation • 8B • Updated Apr 19 • 30

tatvaAi/gemma-4-E4B-it-IQ4_NL

Text Generation • 8B • Updated Apr 14 • 15

sunil-pathak/Qwen3.5-9B-IQ4_NL

Text Generation • 9B • Updated Apr 19 • 35

sunil-pathak/gemma-4-E2B-it-IQ4_NL

Text Generation • 5B • Updated Apr 17 • 74

sunil-pathak/gemma-3n-E2B-it-IQ4_NL

Text Generation • 4B • Updated Apr 19 • 7

sunil-pathak/Mistral-7B-Instruct-v0.3-IQ4_NL

Text Generation • 7B • Updated Apr 19 • 5