Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,889

Full-text search

Active filters: 4-bit

cognitivecomputations/DeepSeek-R1-0528-AWQ

Text Generation • Updated 6 days ago • 1.81k • 12

openbmb/MiniCPM4-8B-Eagle-FRSpec-QAT-cpmcu

Text Generation • Updated 2 days ago • 38 • 7

Tongyi-Zhiwen/QwenLong-L1-32B-AWQ

Updated 10 days ago • 431 • 9

openbmb/MiniCPM4-8B-marlin-cpmcu

Text Generation • Updated 2 days ago • 31 • 5

mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit-DWQ

Text Generation • Updated 10 days ago • 1.53k • 7

wikeeyang/UniWorld-V1-NF4

Any-to-Any • Updated about 14 hours ago • 12 • 4

openbmb/MiniCPM4-8B-marlin-Eagle-vLLM

Text Generation • Updated 2 days ago • 65 • 4

openbmb/MiniCPM4-8B-marlin-vLLM

Text Generation • Updated 2 days ago • 113 • 4

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 18 days ago • 103k • 65

mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit

Text Generation • Updated 9 days ago • 1.62k • 4

mlx-community/Qwen3-30B-A3B-4bit-DWQ-053125

Text Generation • Updated 5 days ago • 556 • 3

mlx-community/Qwen3-Embedding-4B-4bit-DWQ

Feature Extraction • Updated 1 day ago • 150 • 3

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 45.2k • 59

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated Mar 29 • 8.06k • 81

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 27 days ago • 99.1k • 33

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 46.8k • 54

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated Mar 29 • 8.32k • 20

Qwen/Qwen3-8B-AWQ

Text Generation • Updated 18 days ago • 103k • 7

mlx-community/Qwen3-4B-4bit-DWQ

Text Generation • Updated 7 days ago • 920 • 3

mlx-community/DeepSeek-R1-0528-4bit

Text Generation • Updated 10 days ago • 2.31k • 10

speakleash/Bielik-11B-v2.6-Instruct-MLX-4bit

Text Generation • Updated 1 day ago • 17 • 2

speakleash/Bielik-11B-v2.6-Instruct-AWQ

Text Generation • Updated 1 day ago • 40 • 2

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.6k • 365

TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 64 • 24

TheBloke/WizardCoder-Python-13B-V1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 379 • 76

TheBloke/MythoMax-L2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 1.57k • 11

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 543 • 39

TheBloke/meditron-7B-AWQ

Text Generation • Updated Nov 30, 2023 • 32.9k • 3

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 9.25k • 137

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 134k • 45