configuration,mode,total_concurrency_per_gpu,concurrency_per_instance,measurement_date_utc,trials,successful_requests_across_two_gpus,prefix_cache_read_pct,tps_per_gpu,ttft_p50_ms,ttft_p99_ms,tpot_p50_ms,tpot_p99_ms,e2e_p50_ms,e2e_p99_ms KAI + GPU Fractioning pair,Graph,2,1,2026-11-02,1,160,0.0,134.372453910582,148.034495,180.9903959475,14.340144319607841,14.365377851588235,3806.09245225,3817.063877685 KAI + GPU Fractioning pair,Graph,4,2,2026-11-02,1,160,0.0,255.64307475539545,194.160524875,202.72713983749998,14.940308319607842,15.057565919376602,4004.146232125,4032.0227328425 KAI + GPU Fractioning pair,Graph,8,4,2026-11-02,1,160,0.0,438.59367289874854,318.86982224999997,427.73932932249994,17.07807956617647,17.484346186100623,4677.864524125,4757.1329760275 KAI + GPU Fractioning pair,Graph,16,8,2026-11-02,1,320,0.0,718.284817207592,495.384006375,1003.2167138399998,20.441646770588235,21.317044711215686,5706.191914125,6224.251337534999 KAI + GPU Fractioning pair,Graph,32,16,2026-11-02,1,640,0.622568093385214,1022.5361844261165,499.223201625,1948.0674675224996,29.424738955392154,30.37742706809804,8033.82685175,9438.881753607498 KAI + GPU Fractioning pair,Eager,2,1,2026-11-02,1,160,0.0,50.335702176518275,144.15359124999998,179.974633235,39.29253927009804,40.678780492127444,10165.655189874999,10523.617613692499 KAI + GPU Fractioning pair,Eager,4,2,2026-11-02,1,160,0.0,99.65799129178788,211.40712724999997,245.89351260499998,39.45720294656863,40.43568874642157,10271.845555875,10509.31954565 KAI + GPU Fractioning pair,Eager,8,4,2026-11-02,1,160,0.0,189.53533525809218,318.623669875,595.7873236749999,41.09497467696078,42.67411392579172,10815.140440625,11201.842603289999 KAI + GPU Fractioning pair,Eager,16,8,2026-11-02,1,320,0.0,361.1146749091745,404.22685187499997,1211.4900737049998,42.85030863088235,44.39550149423529,11342.885454875,12200.252079884998 KAI + GPU Fractioning pair,Eager,32,16,2026-11-02,1,640,0.622568093385214,636.6624132270836,565.949805,2243.7634093524994,48.20997052107843,50.09814874709804,12845.269702374999,14666.363481007498 Native single,Graph,2,2,2026-11-02,1,80,99.61089494163424,225.50383707401892,43.24018275,45.15151181499999,8.713244456862746,8.734108962450978,2265.0998194999997,2271.40651033 Native single,Graph,4,4,2026-11-02,1,80,99.61089494163424,426.82277550548184,43.321254499999995,45.96644634,9.217003897058824,9.248775775117647,2393.34610625,2402.7456773699996 Native single,Graph,8,8,2026-11-02,1,160,49.80544747081712,693.6695875047765,131.207395,665.7555781799998,10.312004860784313,11.947913402450979,2825.986036,3503.318142214999 Native single,Graph,16,16,2026-11-02,1,320,40.46692607003891,1038.0969514588514,346.556063,1225.9745643099996,15.335750446078432,16.546799490294116,4348.741975499999,5213.706887455 Native single,Graph,32,32,2026-11-02,1,640,0.311284046692607,1117.8769970463823,396.91460275,2684.17264101,27.1155035,27.803993814843135,7319.22490725,9586.572529215 Native single,Eager,2,2,2026-11-02,1,80,99.61089494163424,51.255523442603064,85.15963024999999,130.97787226999998,39.00940164901961,39.51914695870588,10041.631173,10164.717955594999 Native single,Eager,4,4,2026-11-02,1,80,99.61089494163424,103.09948943770033,118.18242124999999,130.579153,38.44344440196079,39.1005617270196,9906.261467249999,10058.516416134999 Native single,Eager,8,8,2026-11-02,1,160,49.80544747081712,200.28359511481193,178.51790775,730.7068952599998,38.96562313235294,40.39374388682036,10150.785387249998,10794.149951705 Native single,Eager,16,16,2026-11-02,1,320,40.46692607003891,377.4106244180165,304.70941174999996,1381.9860522449997,42.015831989215684,43.37529728305883,11033.896225749999,12335.921754395 Native single,Eager,32,32,2026-11-02,1,640,0.311284046692607,653.4288879668673,397.00560674999997,2754.855737555,47.16038108235294,47.91255803449019,12413.97711475,14777.676502614999 HAMi pair,Graph,2,1,2026-11-02,1,160,0.0,97.61003548907304,205.73069275,212.8186578775,19.749564146568623,19.77739866667647,5241.717933624999,5246.436617179999 HAMi pair,Graph,4,2,2026-11-02,1,160,0.0,186.76353342339297,364.467113,374.25207893999993,20.061250797549018,20.13093033797719,5478.267777625,5486.779139685 HAMi pair,Graph,8,4,2026-11-02,1,160,0.0,335.619325946743,562.334924625,739.0926283624999,21.705631761764707,22.433405565538212,6098.104030625,6213.8001911725 HAMi pair,Graph,16,8,2026-11-02,1,320,0.0,564.8998980525889,646.23345,1370.5716625774999,25.953576411764708,27.006433612637252,7265.229289249999,7963.742733009998 HAMi pair,Graph,32,16,2026-11-02,1,640,0.622568093385214,818.7097889866643,776.5438376249999,2872.453892897499,36.24024023921568,37.69160690811765,10019.4982525,12100.207088154999 HAMi pair,Eager,2,1,2026-11-02,1,160,0.0,48.11192176095613,182.41378487499998,220.58915143499996,41.00602442892157,42.37069518435294,10640.886524875,10987.479334515 HAMi pair,Eager,4,2,2026-11-02,1,160,0.0,94.42463584241064,292.688069875,364.03767677499997,41.266705771568624,42.6739611916364,10816.696857249999,11173.6699119875 HAMi pair,Eager,8,4,2026-11-02,1,160,0.0,182.00534826260616,410.8831705,599.88572166,42.51852737794117,43.895453636909295,11238.925544124999,11584.482516082498 HAMi pair,Eager,16,8,2026-11-02,1,320,0.0,343.66692177779964,525.92048025,1315.5809643624996,44.66632588480392,46.24355855686274,11909.01762725,12675.706388069999 HAMi pair,Eager,32,16,2026-11-02,1,640,0.622568093385214,606.8644144643905,602.78059125,2799.1170614449993,50.08903491568627,52.58371091666666,13372.97890425,15919.2801032975 Native pair,Graph,2,1,2026-11-04,1,160,0.0,97.65615551700213,205.58527637499998,211.72121153249998,19.738913079411763,19.75906799382353,5239.348739749999,5244.215680755 Native pair,Graph,4,2,2026-11-04,1,160,0.0,186.767791498897,365.557645875,373.075605075,20.052003357843134,20.11730353313814,5479.4462735,5484.3116684675 Native pair,Graph,8,4,2026-11-04,1,160,0.0,335.67258959223886,556.571433875,730.3508044675,21.72561627254902,22.44223115654701,6097.84804375,6215.0378242275 Native pair,Graph,16,8,2026-11-04,1,320,0.0,565.4545772483184,648.9390539999999,1378.5353176099998,25.96774114852941,27.05981283035294,7269.429710625,7986.491764687498 Native pair,Graph,32,16,2026-11-04,1,640,0.622568093385214,817.1153744334865,740.6801065,2846.8372526799994,36.444555455392155,37.74053787515686,10045.0400895,12084.077271732498 Native pair,Eager,2,1,2026-11-04,1,160,0.0,51.842526705533125,181.915498875,199.32287055249998,37.99969403382352,39.42296972224509,9873.013928249999,10237.699866262501 Native pair,Eager,4,2,2026-11-04,1,160,0.0,101.98901025789816,287.492746,321.123827,38.255083397058826,39.171311712568624,10043.736065124998,10272.2359395275 Native pair,Eager,8,4,2026-11-04,1,160,0.0,194.52531451740305,460.18580149999997,669.5489300075,39.478987329411765,40.83483904662745,10516.956972375,10819.89456913 Native pair,Eager,16,8,2026-11-04,1,320,0.0,361.61344039592217,575.20493475,1491.8287253674996,42.07236822352941,43.8597724259993,11348.86385075,12279.506196224998 Native pair,Eager,32,16,2026-11-04,1,640,0.622568093385214,630.8382442988809,713.5396607499999,2874.1329894199994,48.09799983333333,50.29466910102941,12927.665213125,15431.160003092498