Measured Database — The Numbers, and What Did Not Work

This page contains advertising (affiliate links). See our Privacy Policy for details.

This page collects the numbers we actually measured, together with the setups that did not work. It is tables only, so you can compare the figures without reading the articles. Each row links to the article the number came from.

Measured numbers

Numbers measured on this blog, pulled out of the articles and put into one table. Each row links back to the article that produced it.

The same GPU is treated as a different entry when the link type differs (direct slot / OCuLink / Thunderbolt). Rows with an empty GPU field were measured per machine, not per GPU. Empty cells mean not measured – they are never filled with estimates.

RowMeasuredMachineGPULinkBackendModelContextPrefill [tok/s]Decode [tok/s]TTFT [s]Load [s]VRAM [GB]Power [W]nStatArticleRaw dataNote
00012026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkanphi4-mini1024858.980.410.173.73medianArticle (JA)b580_full_suite.jsonl
00022026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkannemotron-3-nano:4b10381424.493.75.688.63medianArticle (JA)b580_full_suite.jsonl
00032026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:8b10311090.26014149.63medianArticle (JA)b580_full_suite.jsonl
00042026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkanhf.co/deepreinforce-ai/Ornith-1.0-9B-GGUF:Q4_K_M1021617.647.591.7135.13medianArticle (JA)b580_full_suite.jsonl
00052026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkangemma4-12b-fixed103615929.8271333medianArticle (JA)b580_full_suite.jsonl
00062026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1031385.79.129.261.93medianArticle (JA)b580_full_suite.jsonl
00072026-07-20Desktop PCIntel Arc B580 12GB直挿しVulkannemotron-3-nano:30b10384213.743.744.53medianArticle (JA)b580_full_suite.jsonl
00082026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkanphi4-mini10242380.479.85.381.73medianArticle (JA)b580_full_suite.jsonl
00092026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkannemotron-3-nano:4b10381650.895.55.685.23medianArticle (JA)b580_full_suite.jsonl
00102026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:8b10311192.960.111.5148.13medianArticle (JA)b580_full_suite.jsonl
00112026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkanhf.co/deepreinforce-ai/Ornith-1.0-9B-GGUF:Q4_K_M10211163.448108.6146.83medianArticle (JA)b580_full_suite.jsonl
00122026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkangemma4-12b-fixed1036396.929.917.2132.93medianArticle (JA)b580_full_suite.jsonl
00132026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1031388.79.117.261.93medianArticle (JA)b580_full_suite.jsonl
00142026-07-23Desktop PCIntel Arc B580 12GB直挿しVulkannemotron-3-nano:30b103844.114.141.145.43medianArticle (JA)b580_full_suite.jsonl
00152026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b2048363medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00162026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b819228.23medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00172026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1638412.33medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00182026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b327689.13medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00192026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b655367.93medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00202026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b13107283medianArticle (JA)b580_kvcache_quant.jsonlKV cache=f16 / flash_attention=off
00212026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b204836.13medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00222026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b819228.33medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00232026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1638412.43medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00242026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b327689.23medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00252026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b655368.13medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00262026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1310727.83medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q8_0 / flash_attention=on
00272026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b204836.23medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00282026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b8192283medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00292026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1638412.43medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00302026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b327689.13medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00312026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b655368.23medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00322026-07-29Desktop PCIntel Arc B580 12GB直挿しVulkanqwen3:14b1310728.23medianArticle (JA)b580_kvcache_quant.jsonlKV cache=q4_0 / flash_attention=on
00332026-07-07GMKtec EVO-X2phi4-mini:latest1610.859.81.820.4medianno article (raw data only)speed_3machines.csv
00342026-07-07GMKtec EVO-X2qwen3:8b1237.4383.711.5medianno article (raw data only)speed_3machines.csv
00352026-07-07GMKtec EVO-X2qwen3:14b746.822.74.216.3medianno article (raw data only)speed_3machines.csv
00362026-07-07GMKtec EVO-X2qwen3.6:27b269.912.17.734.7medianno article (raw data only)speed_3machines.csv
00372026-07-07GMKtec EVO-X2gemma4:31b162.510.19.123medianno article (raw data only)speed_3machines.csv
00382026-07-07GMKtec EVO-X2qwen3.6:35b-a3b984.555.39.529.5medianno article (raw data only)speed_3machines.csv
00392026-07-07GMKtec EVO-X2llama3.3:70b163.64.919.285.6medianno article (raw data only)speed_3machines.csv
00402026-07-07GMKtec EVO-X2gpt-oss:120b1218.733.2304.365.2medianno article (raw data only)speed_3machines.csv
00412026-07-07GMKtec EVO-X2MichelRosselli/GLM-4.5-Air:Q4_K_Mmedianno article (raw data only)speed_3machines.csv
00422026-07-07GMKtec EVO-X2qwen3-235b-q2:latestmedianno article (raw data only)speed_3machines.csv
00432026-07-07GMKtec EVO-X2minimax-m2.7:latestmedianno article (raw data only)speed_3machines.csv
00442026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:latest1806.9112.412.63.3medianno article (raw data only)speed_3machines.csv
00452026-07-07Desktop PCRTX 3090 24GB直挿しgemma4-12b-fixed:latest1067.466.29.78medianno article (raw data only)speed_3machines.csv
00462026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:26b1341.580.32317.4medianno article (raw data only)speed_3machines.csv
00472026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:26b-a4b-it-qat1764.7110.530.515medianno article (raw data only)speed_3machines.csv
00482026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:26b-a4b-it-q8_01247.670.229.623medianno article (raw data only)speed_3machines.csv
00492026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:31b426.824.830.520.2medianno article (raw data only)speed_3machines.csv
00502026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:31b-it-qat620.83726.319.2medianno article (raw data only)speed_3machines.csv
00512026-07-07Desktop PCRTX 3090 24GB直挿しgemma4:31b-it-q8_0140841.422.8medianno article (raw data only)speed_3machines.csv
00522026-07-07Desktop PCRTX 3090 24GB直挿しqwen3.6:27b590.338.618.616.6medianno article (raw data only)speed_3machines.csv
00532026-07-07Desktop PCRTX 3090 24GB直挿しglm-4.7-flash:Q4_K_M2265.6110.128.419.1medianno article (raw data only)speed_3machines.csv
00542026-07-07Desktop PCRTX 3090 24GB直挿しgpt-oss:120b556.217.389.223medianno article (raw data only)speed_3machines.csv
00552026-07-07Apple Mac miniqwen3:8b623.119.45.15.7medianno article (raw data only)speed_3machines.csv
00562026-07-07Apple Mac miniqwen3:14b359.710.97.19.3medianno article (raw data only)speed_3machines.csv
00572026-07-07Apple Mac minigemma4:26b-a4b-it-qat394.932.519.414.9medianno article (raw data only)speed_3machines.csv
00582026-07-07Apple Mac miniqwen3.6:27b59.85.419.316.5medianno article (raw data only)speed_3machines.csv
00592026-07-10Desktop PCqwen3:8b1061127.53.393.25.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00602026-07-10Desktop PCqwen3:8b21089.9132.70.250.25.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00612026-07-10Desktop PCqwen3:14b904.476.63.773.69.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00622026-07-10Desktop PCqwen3:14b12850.278.60.260.29.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00632026-07-10Desktop PCqwen3.6:27b56039.15.865.617.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00642026-07-10Desktop PCqwen3.6:27b2471.639.10.530.517.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00652026-07-10Desktop PCgemma4:31b-it-q8_0269.58.832.5932.133.8medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00662026-07-10Desktop PCgemma4:31b-it-q8_0590.28.80.940.733.8medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00672026-07-10Desktop PCllama3.3:70b127.43.513.3612.142.5medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00682026-07-10Desktop PCllama3.3:70b544.63.50.590.342.5medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00692026-07-10Desktop PCgpt-oss:120b30.612.595.2788.265.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00702026-07-10Desktop PCgpt-oss:120b3764.217.50.610.665.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00712026-07-10Desktop PCqwen3-235b-q2:latest6.33.5131.51107.485.7medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00722026-07-10Desktop PCqwen3-235b-q2:latest908.860.410.285.7medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00732026-07-10Apple Mac miniqwen3:8b3094.319.70.150.15.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00742026-07-10Apple Mac miniqwen3:8b186.719.71.8215.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00752026-07-10Apple Mac miniqwen3:14b1782.211.30.190.19.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00762026-07-10Apple Mac miniqwen3:14b100.111.42.821.29.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00772026-07-10Apple Mac minigemma4:26b-a4b-it-qat1580.833.50.350.315.6medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00782026-07-10Apple Mac minigemma4:26b-a4b-it-qat234.233.83.312.715.6medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00792026-07-10Apple Mac miniqwen3.6:27b250.85.80.780.217.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00802026-07-10Apple Mac miniqwen3.6:27b435.814.411.217.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00812026-07-10GMKtec EVO-X2qwen3:8b847.839.71.61.45.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00822026-07-10GMKtec EVO-X2qwen3:8b5699.339.20.150.15.2medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00832026-07-10GMKtec EVO-X2qwen3:14b516.123.42.241.99.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00842026-07-10GMKtec EVO-X2qwen3:14b3534.723.20.210.29.3medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00852026-07-10GMKtec EVO-X2qwen3.6:27b214.212.24.293.617.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00862026-07-10GMKtec EVO-X2qwen3.6:27b1060.4120.380.217.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00872026-07-10GMKtec EVO-X2llama3.3:70b105.45.218.0916.642.5medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00882026-07-10GMKtec EVO-X2llama3.3:70b774.85.20.370.242.5medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00892026-07-10GMKtec EVO-X2gpt-oss:120b246.436.722.5421.765.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00902026-07-10GMKtec EVO-X2gpt-oss:120b6855.434.30.290.365.4medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00912026-07-10GMKtec EVO-X2qwen3-235b-q2:latest66.419.629.5627.385.7medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=cold
00922026-07-10GMKtec EVO-X2qwen3-235b-q2:latest2762.919.20.190.185.7medianArticle (JA) / Article (EN)loadtime_3machines.csvstart=warm
00932026-07-11GMKtec EVO-X2RTX 5060 Ti 16GBOCuLinkphi4-mini1332.5medianArticle (JA)gpu_decode_compare.csv
00942026-07-11Desktop PCRTX 3090 24GB直挿しphi4-mini1732.5medianArticle (JA)gpu_decode_compare.csv
00952026-07-11Desktop PCRTX 3060 12GB直挿しphi4-mini972.5medianArticle (JA)gpu_decode_compare.csv
00962026-07-11GMKtec EVO-X2RTX 5060 Ti 16GBOCuLinkqwen3:8b785.2medianArticle (JA)gpu_decode_compare.csv
00972026-07-11Desktop PCRTX 3090 24GB直挿しqwen3:8b1285.2medianArticle (JA)gpu_decode_compare.csv
00982026-07-11Desktop PCRTX 3060 12GB直挿しqwen3:8b615.2medianArticle (JA)gpu_decode_compare.csv
00992026-07-11GMKtec EVO-X2RTX 5060 Ti 16GBOCuLinkOrnith-1.0-9B695.6medianArticle (JA)gpu_decode_compare.csv
01002026-07-11Desktop PCRTX 3090 24GB直挿しOrnith-1.0-9B975.6medianArticle (JA)gpu_decode_compare.csv
01012026-07-11Desktop PCRTX 3060 12GB直挿しOrnith-1.0-9B495.6medianArticle (JA)gpu_decode_compare.csv
01022026-07-11GMKtec EVO-X2RTX 5060 Ti 16GBOCuLinkqwen3:14b459.3medianArticle (JA)gpu_decode_compare.csv
01032026-07-11Desktop PCRTX 3090 24GB直挿しqwen3:14b779.3medianArticle (JA)gpu_decode_compare.csv
01042026-07-11Desktop PCRTX 3060 12GB直挿しqwen3:14b359.3medianArticle (JA)gpu_decode_compare.csv
01052026-07-11GMKtec EVO-X2RTX 5060 Ti 16GBOCuLinkqwen3.6:27b2417.4medianArticle (JA)gpu_decode_compare.csv
01062026-07-11Desktop PCRTX 3090 24GB直挿しqwen3.6:27b3917.4medianArticle (JA)gpu_decode_compare.csv
01072026-06-26GMKtec EVO-X2Radeon 8060S (内蔵)内蔵gpt-oss:120b1651.132.963.63medianArticle (JA)evox2-speed-20260626.csv
01082026-06-26GMKtec EVO-X2Radeon 8060S (内蔵)内蔵qwen3.6:35b-a3b1557.457.610.23medianArticle (JA)evox2-speed-20260626.csv
01092026-06-26GMKtec EVO-X2Radeon 8060S (内蔵)内蔵gemma4:31b2509.919.43medianArticle (JA)evox2-speed-20260626.csv
01102026-06-26GMKtec EVO-X2Radeon 8060S (内蔵)内蔵qwen3.6:27b419.911.97.73medianArticle (JA)evox2-speed-20260626.csv

The numeric data on this page is reusable under CC BY 4.0. Please credit "Kimono Oyaji's Lab" and the URL of this page.

Built: 2026-08-30

What did not work

Combinations that failed are kept as they are. Knowing that a given connection does not work is more useful before you buy than after.

This is not a record of things that worked. It lists only the combinations we bought, connected and failed to run.

The same GPU is treated as a different entry when the link type differs. The "Raw log" column points at the measurement log. Where that column says no dedicated log exists, the row was reconstructed from working notes.

RowMeasuredMachineGPULinkWhat was triedWhere it failedErrorRecovered?Known causeArticleRaw log
00012026-07-18GMKtec EVO-X2RTX 5060 Ti 16GBThunderbolt/USB4 (AG03)Run CUDA compute (load a model with ollama)Compute (detection and full 16311MiB VRAM were fine)SSH応答消失・ping不達(ホストごとフリーズ)No – required a physical reboot. But changing the OS worked: on Windows the same machine over the same link held 14,162MiB and generated (internal GPU plus two external cards)The same card runs fine over OCuLink (78-133 tok/s, no hang). Not a bad card or driver – specific to this machine's USB4/TB path combined with NVIDIA compute DMAJapanese articleEnglish articleaeb-results/evox2_tb_5060ti.md / aeb-results/bench_win_vs_linux_20260731.jsonl
00022026-07-19GMKtec EVO-X2Intel Arc B580 12GBThunderbolt/USB4 (AG03)Boot and bind the driverDriver probe (PCI enumeration and the full 16G VRAM BAR succeeded)Unable to change power state from D3cold to D0, device inaccessible / Failed to reset GuC state (-EPROTO) / probe failed with error -71No – remove/rescan/manual bind did not recover itPCIe config reads back as all-ones through the TB tunnel, so the device is unreachable; xe then mistakes it for SR-IOV VF mode and the GuC reset fails. Note OCuLink could not even enumerate it, so TB got furtherJapanese articleEnglish articleaeb-results/evox2_tb_b580.md
00032026-07-19GMKtec EVO-X2Intel Arc B580 12GBOCuLink (AG01)Connect and enumerateEnumeration – it never appeared in lspci(デバイスが列挙されない)NoThe link cannot provide the large BAR (ReBAR equivalent) that the B580 requiresJapanese articleEnglish articleaeb-results/evox2_tb_b580.md
00042026-07-21GMKtec EVO-X2RTX 3060 12GBThunderbolt/USB4 (AG03)Initialise the GPUGPU init (enumeration, PCIe 4.0 x4 and driver bind all succeeded)NVRM: osIovaMap: failed to map allocation (status = 0x59) → RmInitAdapter failed! (0x22:0x59:894) / nvidia-smi: No devices were foundNo – but the host stayed up, unlike the 5060 Ti case. Changing the OS worked: the same card over the same link ran at 99.76 tok/s on Windows, 90.4% of OCuLink on LinuxMapping into the I/O virtual address space fails. Dropping from Blackwell to Ampere did not help over the TB pathJapanese articleEnglish articleaeb-results/evox2_tb_3060_ampere.md / aeb-results/bench_win_vs_linux_20260731.jsonl
00052026-07-18Apple Mac mini M4RTX 5060 Ti 16GBThunderbolt (TinyGPU / tinygrad 0.13.0)Run a matmul through tinygradGPU hardware init (TB link, driver extension and NVDevice creation all succeeded)AssertionError: Must be table pt=0x0 … pt.entry(pte_idx)=0xffffffffffffffffNoAn unresolved upstream tinygrad bug (issue #14338, closed but unfixed). GSP firmware 570.144 does not know the USB4 bus type, the VRAM training microcontroller fails, and the page table reads back as all-ones. Specific to GB206 – the RTX 5090 is reported workingJapanese articleEnglish articleaeb-results/mac_egpu_tinygpu.md
00062026-07-20Apple Mac mini M4RTX 3060 12GBThunderbolt (TinyGPU / tinygrad 0.13.0)Retry the same thing with an Ampere cardGPU hardware init (enumeration, PCIe4 x4 and device probe succeeded)(5060 Ti と完全に同じシグネチャ)AssertionError: Must be table pt=0x0 … 0xffffffffffffffffNoA record of our own prediction being wrong. On 07-18 we wrote that Ampere would likely work; it failed at exactly the same point in exactly the same wayJapanese articleEnglish articleaeb-results/mac_egpu_3060_ampere.md
00072026-08-29GMKtec EVO-X2Radeon 8060S(内蔵・gfx1151)内蔵Run it on ROCm 10 (torch 2.10.0+rocm7.0)At run timeSegmentation fault / /opt/amdgpu/share/libdrm/amdgpu.ids が存在しないNo – two workarounds were tried and neither helped. Our recommendation is to drop itNot determined. On ROCm 6.4 the same machine returned is_available()==True but failed at run time with HIP error: invalid device functionno article (raw data only)専用の一次記録なし(snapshot.md 2026-08-30 に記載)
00082026-08-24GMKtec EVO-X2Radeon RX 9060 XTOCuLinkAttach it as an external GPUDetection(認識されない・OCuLink が Gen1 に落ちる)Yes – removing the pci=nocrs kernel parameter brought the 9060 XT up and moved OCuLink from Gen1 to Gen4The real cause was the pci=nocrs kernel parameter left over from the B580 experiments. We first misdiagnosed it as amdgpu.gttsize, which turned out to be unrelatedJapanese articleEnglish article専用の一次記録なし(memory / snapshot.md に記載)
00092026-07-31GMKtec EVO-X2RTX 3060 12GBThunderbolt/USB4 (AG03)Move the IOMMU group to identity (pass-through) at run time as a workaroundApplying the setting, with both the GPU and its audio function unbound from their driversEPERM (errno 1) Operation not permitted / 書き込みは通るがグループは DMA のままNo – but the original state was restored and verified, drivers reboundEPERM is neither EBUSY (in use) nor EINVAL (structural limit). The kernel deliberately forbids taking a device behind an external link out of the translation domainno article (raw data only)aeb-results/egpu_tb_retry_20260731.jsonl
00102026-07-31GMKtec EVO-X2RTX 3060 12GBThunderbolt/USB4 (AG03)Turn the IOMMU off entirely (reboot with amd_iommu=off) and attach the card againAuthorising the device – before enumeration; the GPU never appeared認可を書いた直後に ssh 切断・ping 不達(ホストごと応答停止)No – required a physical power cycle. The setting was rolled back to return to the safe-failure stateA record of our reasoning being inverted. The IOMMU was not blocking the eGPU, it was containing it: with the IOMMU on, the card failed safely at 0x59; with it off, the host froze at the authorisation step. Removing the guard is not a path to making it work on this machineno article (raw data only)aeb-results/egpu_tb_retry_20260731.jsonl
00112026-08-20GMKtec EVO-X2Radeon 8060S(内蔵・統合メモリ)内蔵Load a 133GB model (Qwen3-235B-A22B Q4_K_M) into 119GB of free unified memoryModel load – it ended after 250 seconds with rc=137radv/amdgpu: Failed to allocate a buffer: size 948211712 bytes / rc=137No – the next step (internal GPU plus the 9060 XT) took the whole host down and a physical power cycle was neededThe obvious wall: a model larger than the free memory does not load. The cost is high, though – no remote recovery. Because each step was flushed to disk, the stopping point survivedno article (raw data only)aeb-results/t27-235b-q4-20260820-2031.csv / aeb-results/evox2_t27_20260820.jsonl
00122026-07-31GMKtec EVO-X2Radeon 8060S(内蔵・統合メモリ)内蔵Run a 108GB model (minimax-m2.7) on the internal GPU aloneModel loadOOM(内蔵のみの上限は約90GB)Yes, in another configuration: on Windows with the internal GPU plus two external cards it generated at 8.03 tok/s. But 78% was handled on the CPU side – it runs, it is not usable speedAdding external GPUs is not only about speed – it also puts models beyond the internal limit within reachJapanese articleEnglish articleaeb-results/bench_win_vs_linux_20260731.jsonl
00132026-07-29Desktop PCIntel Arc B580 12GBPCIe スロット直挿しMeasure with the context stretched to 32,768 tokens (f16 KV cache)Context creation – the model itself had loadedfailed to create context with modelNo – dropping the KV cache to q8_0 still failed at 65,536A model fitting does not mean its context fits. There was no room left in 12GB for the KV cacheno article (raw data only)aeb-results/b580_kvcache_llamacpp.jsonl
00142026-07-27Desktop PCIntel Arc B580 12GBPCIe スロット直挿しLoad a 19.70GiB model (Ornith-1.0-35B Q4_K_M) on this card aloneModel loadfailed to load(12GiB に収まらず)Yes in another configuration: split across layers together with the 3090 it ran, and the answers matched the 3090 alone exactly (8/8 capability, 10/10 coding). Speed was 34.4% lower than the 3090 aloneA capacity wall. This is where we separated the two effects: pooling costs speed but not correctnessJapanese articleEnglish articleaeb-results/mixed_gpu_3090_b580.jsonl
00152026-07-27Desktop PCRTX 3090 24GBPCIe スロット直挿しBenchmark a 39.59GiB model (llama3.3:70b Q4_K_M, 80 layers) with the default settingsModel loadOOM(24GiB に載る上限は 46層。48層で落ちる)Yes, with a different invocation: name the number of layers explicitly and it runs. Pooled with the B580 (36GiB) the limit rose to 69 layers and generation went 1.91 to 3.33 tok/s (+74%)The benchmark tool defaults to putting every layer on the GPU. This is a limit of how it was called, not of the machineJapanese articleEnglish articleaeb-results/mixed_gpu_3090_b580.jsonl
00162026-07-27Desktop PC(GPU以前の問題)Read the gemma4 models already on disk as standalone model filesReading the file不完全なファイル(31b: expected 1189 got 833 / 26b-a4b-q8_0: expected 1014 got 658)Worked around by switching models (llama3.3:70b). Our 24-36GiB candidates had been skewed towards gemma4The distribution format cannot be used directly as a standalone model file. Nothing to do with the card or the machineno article (raw data only)aeb-results/mixed_gpu_3090_b580.jsonl
00172026-08-17GMKtec EVO-X23種すべて(RX 9060 XT/RTX 5060 Ti/内蔵 Radeon 8060S)Thunderbolt / OCuLink / 内蔵Load qwen3.6:27b, gemma4:31b and qwen3.6:35b-a3bModel loadload_failed_build_format_nonsupport_all_gpu(MoE 版は …(MoE))No – the same result on all three GPUsNot the link and not the card: the build in use did not support that model format. When every GPU fails identically, suspect the softwareno article (raw data only)aeb-results/9060_b580_suite_20260817.jsonl
00182026-08-17GMKtec EVO-X2RX 9060 XT 16GB / RTX 5060 Ti 16GBThunderbolt / OCuLinkLoad a 17.2GB model (qwen3-coder:30b) and a 70B model on an external GPU aloneModel loadcapacity_wall_external_gpu_only(16GB に収まらない)No, not on an external card alone – the same model fits in the machine's unified memory17.2GB does not fit on a 16GB card. Adding an external GPU does not by itself let bigger models run – what matters is whether it fits on the card you addedJapanese articleEnglish articleaeb-results/9060_b580_suite_20260817.jsonl
00192026-07-15Desktop PCRTX 3090 24GBPCIe スロット直挿しUse VRAM as a disk (vramfs, OpenCL plus FUSE)Allocating the area and reading and writing to it20GB 要求に対し実確保は約2.9GB(単一割当上限)/負荷をかけると std::bad_alloc で異常終了No – a 16GB swap area could not be created, so the measurement itself never happenedThere is a cap on the size of a single allocation. In this combination, a VRAM-backed disk layer is not usableno article (raw data only)aeb-results/vram_as_ram_ubuntu.jsonl
00202026-07-02Desktop PCRTX 3090 24GB(+RAM 62GB+SSD)PCIe スロット直挿しForce a 202GB model (GLM-5.2 745B at roughly 1.5-bit) to runStart-up warm-up – five hours without a single token(エラーは出ない。終わらないだけ)Yes – with –no-warmup it loaded in 41.2 seconds and answered correctly at 0.21 tok/sWe first concluded this was the limit at which generation becomes unreachable. That was wrong: the default warm-up was touching all 202GB and never finished. The real limit was speed, not whether it startsJapanese articleEnglish articledocs/kimono/muriyari-notes.md
00212026-07GMKtec EVO-X2Radeon 8060S(内蔵・統合メモリ)内蔵Speed up the same 202GB model by keeping more layers resident on the GPUAt run time – it dies immediately once too much is pinnedOOM(-ncmoe を 42 以下に下げた条件)Yes, within a safe range: -ncmoe 50 held at 0.62-0.69 tok/s, and 45 still workedOn a unified-memory machine, more layers on the GPU stops helping past a point. The exact date was not recorded in the primary note (it is after 2026-07-03 in the same file)Japanese articleEnglish articledocs/kimono/muriyari-notes.md

This table is reusable under CC BY 4.0. Please credit "Kimono Oyaji's Lab" and the URL of this page.