Inference Providers
Active filters: INT4
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation
• 565B • Updated • 714
• 3
nwzjk/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16-W4A16-G128
Text Generation
• 565B • Updated • 16
• 1
iSolver-AI/test123-quantized.w4a16
Image-Text-to-Text
• Updated • 5
RedHatAI/phi-4-quantized.w4a16
Text Generation
• 15B • Updated • 80.8k
• 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text
• 24B • Updated • 1.64k
• 10
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation
• 676B • Updated • 7.55k
• 7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
• 109B • Updated • 9.57k
• 13
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation
• 4B • Updated • 20.2k
• 4
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation
• 2B • Updated • 6.3k
• 3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation
• 0.8B • Updated • 3.67k
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation
• 33B • Updated • 1.72k
• 12
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation
• 15B • Updated • 594
• 1
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation
• 8B • Updated • 43.5k
• 4
WaveCut/PixelWave_FLUX.1-schnell_04_SVDQuant-int4
Text-to-Image
• Updated • 26
• 1
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation
• 31B • Updated • 3.25k
• 7
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation
• 676B • Updated • 257
• 13
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text
• 405B • Updated • 4.43k
• 1
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation
• 1T • Updated • 334
• 12
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
• 4B • Updated • 19
• 2
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation
• 4B • Updated • 1
RedHatAI/Qwen3-4B-Thinking-2507-quantized.w4a16
Text Generation
• 4B • Updated • 287
RedHatAI/Qwen3-4B-Instruct-2507-quantized.w4a16
Text Generation
• 4B • Updated • 219
RedHatAI/Qwen3-30B-A3B-Thinking-2507-quantized.w4a16
Text Generation
• 5B • Updated • 163
RedHatAI/Qwen3-30B-A3B-Instruct-2507-quantized.w4a16
Text Generation
• 5B • Updated • 1.62k
• 2
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Text Generation
• 12B • Updated • 872
• 3
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation
• 12B • Updated • 177
EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16
Text Generation
• 5B • Updated • 238
• 1
EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16
Text Generation
• 5B • Updated • 6
RedHatAI/Ministral-3-14B-Instruct-2512-FP8-dynamic
Text Generation
• 14B • Updated • 132
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation
• 12B • Updated • 76
• 1