Matched engine study / November 3, 2026

Close at 4K.
The details matter.

The latest Rust comparison finds nearly identical long-prompt request medians for expXa and PXA4. Shorter prompts tell a different story—but three repetitions on shared hardware do not establish an engine-wide winner.

24.27 sexpXa · 4,096-token request median
24.38 sPXA4 · same test conditions
128forced output tokens per request

What the measurements say

At 512 input tokens, expXa’s median complete request took 6.00 seconds versus PXA4’s 6.95 seconds. At 4,096 tokens, both engines processed the prompt at approximately 202 tokens per second. The long-request ranges overlap, and expXa’s slowest recorded long request was slower than PXA4’s slowest. Use the ranges alongside the medians.

Three repetitions per engine and prompt length. Rates are medians of native timing fields.
EngineInput tokensPrefill tok/sDecode tok/sRequest sRequest range s
expXa 0982512203.9737.286.005.77–6.07
PXA4 control512180.8231.236.955.91–7.45
expXa 09824,096201.5332.9624.2724.16–27.10
PXA4 control4,096202.0030.4124.3824.01–26.76

What made this a matched comparison?

Fixed workload

Huihui Qwen3-30B-A3B Instruct-2507 abliterated, Q4_K_M. The same original weights, token fixtures, 8,192-token context, Q8 KV cache and native streaming client were used. Each request forced 128 output tokens.

Fixed placement and CPU limits

V100 GPU0, 40 CPU expert banks, 8 generation threads and 20 batch threads. CPU quota was 19.2 cores. Roughly 21% of model weight buffers were on GPU; that percentage does not describe the share of computation.

The primary tuning arms used three repeats with engine order rotated. Small correctness canaries preceded scoring, but there was no full-shape warmup. Idle/resource checks reduced interference without proving its absence on a shared host.

How the implementation progressed

These are successive experiments, not one continuous controlled test. Each phase has its own contemporaneous control; differences between dates cannot all be assigned to code changes.

  1. November 2 — initial V100 comparison. expXa 208e21d took a 49.42-second median at 4K input; PXA4 took 25.16 seconds. Prefill was the main gap.
  2. November 3 — CPU expert port. The a078 phase brought expXa to 25.82 seconds against its PXA4 control’s 24.01 seconds. A gap remained.
  3. November 3 — parallel preparation. The 0982 phase reached 24.27 seconds against 24.38 seconds for its PXA4 control. In the same-binary preparation ablation, expXa’s old path measured 25.83 seconds.

The ablation is the more focused test of activation preparation: weights and binary stay fixed while the preparation mode changes. It supports a roughly 6% median reduction in this long-input workload, rather than a blanket performance claim.

Every run behind the headline

Inspect the 12 matched expXa/PXA4 measurements
EngineInputRepeatPrefill tok/sDecode tok/sRequest s
expXa 09825121199.39437.2816.003
expXa 09825122203.97436.0176.067
expXa 09825123207.85538.7035.772
PXA4 control5121180.82231.0656.954
PXA4 control5122152.68831.2327.454
PXA4 control5123199.26338.3305.911
expXa 098240961201.52932.49424.271
expXa 098240962202.04132.95724.163
expXa 098240963175.57934.05027.095
PXA4 control40961182.11030.10326.759
PXA4 control40962202.00134.31324.014
PXA4 control40963203.13530.40624.382

Native rates measure prompt processing and generation separately. Request time includes the complete measured request, so it is not simply a throughput score. Forced output and repeated synthetic structure also limit how these results transfer to ordinary conversation.

Where Kairo’s Q6_K profile fits

Kairo uses a different model and execution profile: Qwen3.6 35B-A3B Q6_K, 4×8 attention, depth-1 multi-token prediction, and a configured 262,144-token context. Rust’s CPU preparation change was scoped to its own geometry.

During the tuning checks, all 28 captured Kairo responses and token/MTP counts matched their pre-change counterparts. Both chat-formatted 65K retrieval variants passed. One raw-completion variant returned immediate EOS before and after the change; that failure remains part of the record.

An initial code timing sample was slower; focused follow-up measurements did not show a persistent slowdown. These are bounded continuity and regression checks, not a matched expXa-versus-PXA4 Q6_K benchmark or a general quality evaluation.

Recheck the conclusion

The original measurement records and evidence bundle are available directly from expxa.com. They include previous phases, configuration identities, sanity checks, ranges, and compatibility outcomes.