# 2× RTX 3090 (used) 48 GB

> Layer split adds capacity, not bandwidth, for a single stream (brief §7.3).

Canonical: https://thelocalbench.com/hardware/2x-rtx-3090-48g-used · Data as of 2026-10-12 · The Local Bench (thelocalbench.com), data as of 2026-10-12, CC BY 4.0

Flags: [verified] checked against primary source · [sourced] cited · [estimate] formula · [sample] placeholder

## Specifications

| Field | Value | Flag | Source / note |
|---|---|---|---|
| memory_gb | 48 | sourced | https://www.nvidia.com/en-us/geforce/graphics-cards/30-series/rtx-3090-3090ti/ |
| bandwidth_gbs | 936 | sourced | https://en.wikipedia.org/wiki/GeForce_RTX_30_series |
| fp16_tflops | 71 | sample | Sample FP16 dense compute; pending vendor-sheet citation. |
| load_watts | 780 | sample | Sample wall power under load. |
| price_usd | 2400 | estimate | https://www.getpcparts.com/market-prices/gpu-graphics-cards/rtx-3090 |

## Models that run (default quant, 8k)

| Model | Quant | Memory GB | Verdict | Decode tok/s |
|---|---|---|---|---|
| [Llama 3.1 8B Instruct](/models/llama-3.1-8b.md) | Q4_K_M | 6.6 | fit | 93.7 [estimate] |
| [Qwen3 8B](/models/qwen3-8b.md) | Q4_K_M | 6.8 | fit | 90.0 [estimate] |
| [Qwen3 14B](/models/qwen3-14b.md) | Q4_K_M | 10.9 | fit | 54.3 [estimate] |
| [gpt-oss-20b](/models/gpt-oss-20b.md) | MXFP4 | 12.9 | fit | 245.3 [estimate] |
| [Mistral Small 3.2 24B](/models/mistral-small-3.2-24b.md) | Q4_K_M | 16.2 | fit | 35.8 [estimate] |
| [Gemma 3 27B IT](/models/gemma-3-27b.md) | Q4_K_M | 18.2 | fit | 31.8 [estimate] |
| [Qwen3 30B-A3B](/models/qwen3-30b-a3b.md) | Q4_K_M | 19.9 | fit | 199.8 [estimate] |
| [Qwen3 32B](/models/qwen3-32b.md) | Q4_K_M | 22.5 | fit | 25.6 [estimate] |
| [Llama 3.3 70B Instruct](/models/llama-3.3-70b.md) | Q4_K_M | 45.8 | tight | 12.4 [estimate] |
| [gpt-oss-120b](/models/gpt-oss-120b.md) | MXFP4 | 64.3 | offload | 36.1 [estimate] |