Performance / Evidence / Progression

Find the workload.
Read the result.

An inference number only makes sense beside its model, hardware and execution settings. Start with a matched study, or explore every measured configuration below.

98retained serving runs · November 2–3, 2026
16 + 2serving configurations + compatibility checks
2 GPUsV100 and Titan Xp · distinct environments
New / GPU operator evaluation

Warp sharing: tested, with live schedules preserved

Expert reuse, lane-zero reductions and attention broadcasts across both V100s. Read the matched controls, regressions, exact-output checks and retained exclusions.

Read the qualification ↗
Live evaluation / Rust and Kairo

VNNI tiles: correctness verified, serving gain unresolved

Eight repetitions per model and input length before and after activation. Read the full result, including variation, unchanged outputs and excluded startup-policy attempts.

Read the live evaluation ↗
Featured study / Rust / V100

Where does expXa stand against PXA4?

The latest matched test put long-prompt request medians at 24.27 seconds for expXa and 24.38 seconds for PXA4. Their observed ranges overlap. Open the study for short-prompt results, individual runs and the settings that make this comparison meaningful.

Read the engine comparison ↗

Configuration explorer

This is a record browser, not an overall leaderboard. Historical phases, hardware and offload configurations differ. Compare engines within a matched study before interpreting differences as an optimization gain.

All 32 measured configuration/length combinations shown.

Medians; latency ranges show the minimum and maximum observed request seconds.
Configuration / study phaseInputPrefill tok/sDecode tok/sRequest sRange sRuns
V100 · expXa0982 · parallel preparation512203.9737.286.005.77–6.073
V100 · expXa0982 · parallel preparation4,096201.5332.9624.2724.16–27.103
V100 · expXa0982 · old-preparation ablation512190.3438.166.005.99–6.053
V100 · expXa0982 · old-preparation ablation4,096189.3830.9325.8325.53–25.893
V100 · PXA4 · tuning control512180.8231.236.955.91–7.453
V100 · PXA4 · tuning control4,096202.0030.4124.3824.01–26.763
V100 · expXa a078 · before/after reference512187.4337.756.136.00–6.252
V100 · expXa a078 · before/after reference4,096179.3432.4626.8126.17–27.442
V100 · expXa a078 · Rust CPU port512191.9935.606.346.01–6.904
V100 · expXa a078 · Rust CPU port4,096186.9233.1825.8225.68–25.894
V100 · PXA4 · Nov 3 matched control512209.5437.625.845.77–6.464
V100 · PXA4 · Nov 3 matched control4,096202.7933.6524.0123.66–26.264
V100 · current live, refreshed512123.2432.948.107.71–8.523
V100 · current live, refreshed4,096125.6131.1136.5636.51–39.683
V100 · current engine clone512108.5733.138.958.53–13.573
V100 · current engine clone4,096128.1330.1036.7734.53–40.923
V100 · PXA4, same settings512206.8537.425.855.76–7.833
V100 · PXA4, same settings4,096199.5729.3025.1623.59–27.933
V100 · expXa, same settings51279.8531.9410.429.05–12.163
V100 · expXa, same settings4,09690.7329.2149.4241.64–49.833
V100 · original live measurement512135.8936.067.347.19–7.383
V100 · original live measurement4,096135.5432.6634.1033.96–34.263
Current settings · Titan51211.209.4359.6158.74–60.063
Current settings · Titan4,09611.298.46378.47376.86–380.063
expXa · max tested offload · 19 CPU banks51251.5823.9815.3015.20–15.353
expXa · max tested offload · 19 CPU banks4,09651.2322.2585.6585.61–86.253
PXA4 · max tested offload · 19 CPU banks51271.0025.4512.2412.23–12.403
PXA4 · max tested offload · 19 CPU banks4,09670.7522.7563.5163.46–63.533
expXa · initial placement · 20 CPU banks51249.0924.2515.7115.52–15.893
expXa · initial placement · 20 CPU banks4,09649.2622.4188.8788.83–89.243
PXA4 · initial placement · 20 CPU banks51267.9223.3113.0312.89–13.433
PXA4 · initial placement · 20 CPU banks4,09667.5621.5966.4666.31–80.333

The experiments that did not produce a score

PXA Overdrive

The requested switch did not activate an Overdrive recipe for the original Rust weights. Its probe is retained as an activation check, not a speed result.

Strata

The native loader required PLE tensors absent from this model. No replacement weights were substituted to manufacture a comparison.

Kairo’s Q6_K work is a separate track

Kairo runs a Qwen 35B-A3B Q6_K profile with tuned attention and native multi-token prediction. The retained checks cover text output, vision, caching, cancellation and long-context retrieval. They do not measure the same CPU-heavy workload as Rust, and the available before/after records are not a matched PXA4 ranking.

Read the scope of the Kairo checks →

Keep the evidence within reach

Download the complete machine-readable record or the original evidence bundle. Follow dated publications to see what changed without losing the earlier results.