Qwen3.6 27B

Qwen/Qwen3.6-27B

27BDenseText generationImage → textText inputImage input

Qwen · 2 recorded configurations

Measured setup

Hardware

1× RTX 3090 · GPU-resident
2× RTX 3090 · GPU-residentalso Runtime

Runtime and tool

live llama-server
llama-benchalso Hardware

Quantisation

Q4_K_M

MTP draft depth

MTP off

Every option opens a recorded setup. Where the corpus recorded nothing at this page's other settings, the option names the fields it switches with it. Allocation and runtime detail stay in the technical record below.

PP · left axisTG · right axis

View exact measurements

Exact context depth and measured fresh prefill, bulk prefix, and decode rates for Qwen3.6 27B
Context depth (tokens)	Fresh prefill PP (tok/s)	TG (tok/s)
512	1,228.67	39.14
2,048	1,172.31	39.11
4,096	1,159.45	39.08
8,192	1,090.04	39.05
16,384	1,049.01	38.98
32,768	966.87	38.85
65,536	821.75	38.69

Technical record and provenance

Run details

Source run ID: rtx3090x1-qwen3.6-27b-q4km-2026-07
Hardware: 1× RTX 3090
Runtime: llamaCpp
Weight placement: gpu-resident
KV-cache precision: Q8_0
Prompt tokens: 512
Generated tokens: 128
Speculative decoding: None (standard decoding)
Notes: Single RTX 3090, llama.cpp, Q4_K_M, Q8_0 KV cache. Build, driver, power limit, and repetitions not recorded in the article.
Source article: /local-ai/rtx-3090-for-local-ai-inference/

Compare measured entries