Real hardware. Real numbers. No vendor spin.
101.6tok/s · mistral:7b-instruct-v0.3-q4_0 · AMD Ryzen 9 3950X + RX 9070 XT
62.3tok/s · mistral:latest · AMD Ryzen 7 5700G + RX 5700 XT
11.0tok/s · bifrost-1a-overflow · AMD Ryzen 7 5700G iGPU Vega 8
131.8tok/s · Qwen3-1.7B-GGUF · AMD Ryzen AI Max+ 395 (Radeon 8060S)
49.0tok/s · llama3.2:1b · AMD Ryzen AI Max+ 395 XDNA2 NPU
5.0tok/s · llama3.3:70b · AMD Ryzen AI Max+ 395 (Radeon 8060S) [llama-server T2.5]
AMD Ryzen 9 3950X + RX 9070 XT GPU AMD Radeon RX 9070 XT 16GB RDNA4 · OS Windows 11 Pro · ROCm 7.1 gfx1201
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
mistral:7b-instruct-v0.3-q4_0ollama21256101.6bifrost
Granite-4.1-8B (Q4_K_M)ollama4525676.6bifrost
gemma4:e4bollama3125668.6bifrost
Qwen3.5-9B (Q4_K_M)ollama2525664.3bifrost
qwen3:14bollama4725655.4bifrost
phi4:14bollama2525652.6bifrost
bifrost-t1bollama4310647.1bifrost
AMD Ryzen 7 5700G + RX 5700 XT GPU RX 5700 XT 8GB RDNA1 · OS Windows 11 · ROCm N/A
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
mistral:latestollama2125662.3hearth
mistral:7bollama2119657.3hearth
Ministral-8B-2410 (Q4_K_M)ollama1825650.5hearth
bifrost-1a-hearthollama1642923.8hearth
AMD Ryzen 7 5700G iGPU Vega 8 GPU Vega 8 iGPU 16GB GTT · OS Windows 11 · ROCm N/A
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
bifrost-1a-overflowollama13725611.0hearth-vega8
bifrost-distillollama8472566.1hearth-vega8
AMD Ryzen AI Max+ 395 (Radeon 8060S) GPU Radeon 8060S 96GB unified · OS Ubuntu 24.04 · ROCm 7.2 gfx1151
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
Qwen3-1.7B-GGUFlemonade19512131.8forge
functiongemma:latest retired 2026-08-06ollama2549100.0forge
hf.co/LiquidAI/LFM2.5-2.6B-GGUF:Q4_K_Mollama2525691.4forge
qwen3-coder-kilo2ollama2325665.3forge
qwen3-coder:30b-a3b-q4_K_Mollama2325665.1forge
qwen3-coder:30bollama2325664.8forge
bifrost-coder-toolmasterollama25625664.8forge
qwen3-coder-kilo2:latestollama2325664.6forge
bifrost-coder-toolmaster:latestollama25625664.0forge
bifrost-t2-qwen3 retired 2026-08-06ollama47201263.1forge
phi4-mini:latest retired 2026-08-06ollama1821261.3forge
bifrost-nemotron-toolmaster:latest retired 2026-08-06ollama3325661.0forge
bifrost-forge-t1ollama10258.0forge
Nemotron-3-Nano-30B-A3B (UD-Q4_K_XL)ollama3225656.5forge
hf.co/unsloth/Nemotron-3-Nano-30B-A3B-GGUF:UD-Q4_K_XL retired 2026-08-06ollama3225656.0forge
gemma3:4bollama2525655.7forge
frontis-ma1-35bollama2525654.2forge
gemma4:e4bollama3130052.6forge
bifrost-orch-carnice:latest retired 2026-08-06ollama2525652.2forge
frontis-ma1-35b:latestollama2525652.0forge
hf.co/samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B-GGUF:Q4_K_M retired 2026-08-06ollama2525651.9forge
bifrost-kat-longollama2525651.8forge
qwen3.6-35b-a3b:Q4_K_Mollama2525651.7forge
bifrost-t2-gemma4ollama17725649.9forge
bifrost-t2-gemma4-16k:latestollama17825647.6forge
gemma4:26bollama3125646.8forge
bifrost-t2-gemma4:latestollama17825646.2forge
bifrost-panel-gpt-oss-20b-16k:latestollama8225644.7forge
qwen2.5-coder:7bollama4425240.1forge
bifrost-forge-t1:latestollama4225639.8forge
qwen3:8bollama2525637.3forge
gpt-oss:120b retired 2026-08-05ollama8225635.1forge
laguna-xs.2-8k:latestollama6525633.5forge
laguna-xs.2:latestollama6525633.5forge
gpt-oss-igor-65k:latestollama8225632.7forge
orieg/gemma3-tools:12b-ft retired 2026-08-06ollama3615322.5forge
bifrost-t2-qwen3:latest retired 2026-08-06ollama16825621.7forge
Llama-4-Scout-17B-16E (UD-IQ1_M)ollama2525619.8forge
Qwen3-VL-235B-A22B (UD-TQ1_0)lemonade2325617.0forge
bifrost-coder-kilo2:latestollama28325614.4forge
bifrost-panel-mistral-16k:latestollama37325614.4forge
devstral:latestollama124025614.4forge
bifrost-coder-kilo2ollama28325614.4forge
qwen3.8-27b:Q4_K_Mollama6725611.2forge
qwen2.5-coder:32bollama4425610.6forge
bifrost-t2p5-r1ollama369615.0forge
AMD Ryzen AI Max+ 395 XDNA2 NPU GPU XDNA2 NPU — 0W GPU draw · OS Ubuntu 24.04 · ROCm FLM NPU
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
llama3.2:1bflm13449.0forge-npu
gpt-oss:20b retired 2026-08-05flm822569.1forge-npu
AMD Ryzen AI Max+ 395 (Radeon 8060S) [llama-server T2.5] GPU Radeon 8060S 96GB unified · OS Ubuntu 24.04 · ROCm 7.2 gfx1151 (llamacpp-rocm)
MODELBACKENDPROMPTOUTPUTTOK/SHARDWARE
llama3.3:70bllama_server502565.0forge-t25
llama3.3:70b-Q4_K_Mllama_server1185.0forge-t25
Llama-3.3-70B-Instruct-Q4_K_M.ggufllama_server502565.0forge-t25