Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,628

Base only

Active filters: gguf-my-repo

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 3 days ago • 491 • 7

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 1 day ago • 425 • 4

mitkox/FastContext-1.0-4B-SFT-Q5_K_M-GGUF

4B • Updated 3 days ago • 294 • 3

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 1 day ago • 240 • 3

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 7.89k • 47

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 485 • 5

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated 23 days ago • 4.77k • 10

FlameF0X/Apodex-1.0-mini-Q4_K_M-GGUF

Text Generation • 36B • Updated 6 days ago • 217 • 2

RachidAR/ablation-model-fineweb-v1-Q6_K-GGUF

2B • Updated Apr 23, 2024 • 5 • 1

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 427 • 3

mtsdurica/madlad400-3b-mt-Q4_K_M-GGUF

Translation • 3B • Updated Jul 13, 2024 • 67 • 5

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 6.8k • 15

RagnarokChan/Qwen2.5-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 55 • 1

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_0-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 48 • 1

argearriojas/Phi-3.5-mini-instruct-Q4_0-GGUF

Text Generation • Updated Sep 27, 2024 • 74 • 1

Hasaranga85/Llama-3.2-3B-Instruct-abliterated-Q4_K_M-GGUF

4B • Updated Oct 8, 2024 • 685 • 2

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 2.63k • 18

lahirum/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Oct 23, 2024 • 1.02k • 1

panos345/Qwen2.5-Coder-1.5B-Q4_0-GGUF

Text Generation • 2B • Updated Oct 24, 2024 • 40 • 1

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 5, 2024 • 5.82k • 48

Maites/SmolLM2-1.7B-Instruct-Q4_0-GGUF

2B • Updated Nov 25, 2024 • 22 • 1

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 1.36k • 11

AlicanKiraz0/Seneca-Cybersecurity-LLM-Q4_K_M-GGUF

8B • Updated Mar 15, 2025 • 148 • 40

matrixportalx/Ministral-3b-instruct-Q4_0-GGUF

Text Generation • 3B • Updated Jan 2, 2025 • 14 • 1

itlwas/phi-1_5-Q4_K_M-GGUF

Text Generation • 1B • Updated Jan 8, 2025 • 7 • 2

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Text Generation • 12B • Updated Jan 16, 2025 • 7 • 2

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 31, 2025 • 453 • 10

Maddio/Qwen2.5-7B-Instruct-Tool-Planning-v0.1-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 21, 2025 • 16 • 1

matrixportalx/Mathstral-7B-v0.1-Q4_0-GGUF

7B • Updated Feb 27, 2025 • 3 • 1

alphaduriendur/Qwen2.5-Coder-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Mar 5, 2025 • 22 • 1