configuration,mode,total_concurrency_per_gpu,concurrency_per_instance,measurement_date_utc,trials,successful_requests_across_two_gpus,prefix_cache_read_pct,tps_per_gpu,ttft_p50_ms,ttft_p99_ms,tpot_p50_ms,tpot_p99_ms,e2e_p50_ms,e2e_p99_ms,hami_compute_limit_pct KAI + GPU Fractioning pair,Graph,2,1,2026-11-02,1,160,0.0,134.372453910582,148.034495,180.9903959475,14.340144319607841,14.365377851588235,3806.09245225,3817.063877685, KAI + GPU Fractioning pair,Graph,4,2,2026-11-02,1,160,0.0,255.64307475539545,194.160524875,202.72713983749998,14.940308319607842,15.057565919376602,4004.146232125,4032.0227328425, KAI + GPU Fractioning pair,Graph,8,4,2026-11-02,1,160,0.0,438.59367289874854,318.86982224999997,427.73932932249994,17.07807956617647,17.484346186100623,4677.864524125,4757.1329760275, KAI + GPU Fractioning pair,Graph,16,8,2026-11-02,1,320,0.0,718.284817207592,495.384006375,1003.2167138399998,20.441646770588235,21.317044711215686,5706.191914125,6224.251337534999, KAI + GPU Fractioning pair,Graph,32,16,2026-11-02,1,640,0.622568093385214,1022.5361844261165,499.223201625,1948.0674675224996,29.424738955392154,30.37742706809804,8033.82685175,9438.881753607498, KAI + GPU Fractioning pair,Eager,2,1,2026-11-02,1,160,0.0,50.335702176518275,144.15359124999998,179.974633235,39.29253927009804,40.678780492127444,10165.655189874999,10523.617613692499, KAI + GPU Fractioning pair,Eager,4,2,2026-11-02,1,160,0.0,99.65799129178788,211.40712724999997,245.89351260499998,39.45720294656863,40.43568874642157,10271.845555875,10509.31954565, KAI + GPU Fractioning pair,Eager,8,4,2026-11-02,1,160,0.0,189.53533525809218,318.623669875,595.7873236749999,41.09497467696078,42.67411392579172,10815.140440625,11201.842603289999, KAI + GPU Fractioning pair,Eager,16,8,2026-11-02,1,320,0.0,361.1146749091745,404.22685187499997,1211.4900737049998,42.85030863088235,44.39550149423529,11342.885454875,12200.252079884998, KAI + GPU Fractioning pair,Eager,32,16,2026-11-02,1,640,0.622568093385214,636.6624132270836,565.949805,2243.7634093524994,48.20997052107843,50.09814874709804,12845.269702374999,14666.363481007498, Native single,Graph,2,2,2026-11-02,1,80,99.61089494163424,225.50383707401892,43.24018275,45.15151181499999,8.713244456862746,8.734108962450978,2265.0998194999997,2271.40651033, Native single,Graph,4,4,2026-11-02,1,80,99.61089494163424,426.82277550548184,43.321254499999995,45.96644634,9.217003897058824,9.248775775117647,2393.34610625,2402.7456773699996, Native single,Graph,8,8,2026-11-02,1,160,49.80544747081712,693.6695875047765,131.207395,665.7555781799998,10.312004860784313,11.947913402450979,2825.986036,3503.318142214999, Native single,Graph,16,16,2026-11-02,1,320,40.46692607003891,1038.0969514588514,346.556063,1225.9745643099996,15.335750446078432,16.546799490294116,4348.741975499999,5213.706887455, Native single,Graph,32,32,2026-11-02,1,640,0.311284046692607,1117.8769970463823,396.91460275,2684.17264101,27.1155035,27.803993814843135,7319.22490725,9586.572529215, Native single,Eager,2,2,2026-11-02,1,80,99.61089494163424,51.255523442603064,85.15963024999999,130.97787226999998,39.00940164901961,39.51914695870588,10041.631173,10164.717955594999, Native single,Eager,4,4,2026-11-02,1,80,99.61089494163424,103.09948943770033,118.18242124999999,130.579153,38.44344440196079,39.1005617270196,9906.261467249999,10058.516416134999, Native single,Eager,8,8,2026-11-02,1,160,49.80544747081712,200.28359511481193,178.51790775,730.7068952599998,38.96562313235294,40.39374388682036,10150.785387249998,10794.149951705, Native single,Eager,16,16,2026-11-02,1,320,40.46692607003891,377.4106244180165,304.70941174999996,1381.9860522449997,42.015831989215684,43.37529728305883,11033.896225749999,12335.921754395, Native single,Eager,32,32,2026-11-02,1,640,0.311284046692607,653.4288879668673,397.00560674999997,2754.855737555,47.16038108235294,47.91255803449019,12413.97711475,14777.676502614999, HAMi pair (50%),Graph,2,1,2026-11-05,1,160,0.0,99.79677007571587,198.399731875,203.58157177249998,19.73204362107843,19.756962712156863,5229.881737375,5237.185977692499,50 HAMi pair (50%),Graph,4,2,2026-11-05,1,160,0.0,186.91534129997274,367.340995375,377.5713650875,20.024358554411762,20.090968278896206,5473.2035721249995,5483.242432262499,50 HAMi pair (50%),Graph,8,4,2026-11-05,1,160,0.0,336.52187492370297,543.6634561249999,714.986493505,21.725306344117644,22.408004892614173,6085.724056,6199.443162375,50 HAMi pair (50%),Graph,16,8,2026-11-05,1,320,0.0,561.7336418504541,720.193886875,1468.8824981824996,25.754977949999997,27.0950382630098,7284.219724125,8038.198438369998,50 HAMi pair (50%),Graph,32,16,2026-11-05,1,640,0.622568093385214,817.892434952565,784.9894772499999,2888.204241067499,36.22143496372549,37.69307609960784,10017.562599375,12107.447075459999,50 HAMi pair (50%),Eager,2,1,2026-11-05,1,160,0.0,47.75867321713015,181.19254675,205.14961935,41.30483701666667,42.4230070445,10717.227968125,11000.414031459999,50 HAMi pair (50%),Eager,4,2,2026-11-05,1,160,0.0,93.89091088303623,303.3968165,392.33518683,41.63374407696078,42.67478050437255,10918.80757775,11174.364142075,50 HAMi pair (50%),Eager,8,4,2026-11-05,1,160,0.0,180.49463156024993,426.66518287499997,588.035385155,42.8429482495098,44.523032899109154,11325.49184275,11715.66021932,50 HAMi pair (50%),Eager,16,8,2026-11-05,1,320,0.0,341.2805999715628,594.8343199999999,1361.2660050224997,44.817744782843135,46.36746209642156,12008.862278875,12733.573233042498,50 HAMi pair (50%),Eager,32,16,2026-11-05,1,640,0.622568093385214,602.6839229415582,696.68144,2794.760553099999,50.67567641960784,52.43818726727451,13580.787038125,15788.302922269999,50 Native pair,Graph,2,1,2026-11-04,1,160,0.0,97.65615551700213,205.58527637499998,211.72121153249998,19.738913079411763,19.75906799382353,5239.348739749999,5244.215680755, Native pair,Graph,4,2,2026-11-04,1,160,0.0,186.767791498897,365.557645875,373.075605075,20.052003357843134,20.11730353313814,5479.4462735,5484.3116684675, Native pair,Graph,8,4,2026-11-04,1,160,0.0,335.67258959223886,556.571433875,730.3508044675,21.72561627254902,22.44223115654701,6097.84804375,6215.0378242275, Native pair,Graph,16,8,2026-11-04,1,320,0.0,565.4545772483184,648.9390539999999,1378.5353176099998,25.96774114852941,27.05981283035294,7269.429710625,7986.491764687498, Native pair,Graph,32,16,2026-11-04,1,640,0.622568093385214,817.1153744334865,740.6801065,2846.8372526799994,36.444555455392155,37.74053787515686,10045.0400895,12084.077271732498, Native pair,Eager,2,1,2026-11-04,1,160,0.0,51.842526705533125,181.915498875,199.32287055249998,37.99969403382352,39.42296972224509,9873.013928249999,10237.699866262501, Native pair,Eager,4,2,2026-11-04,1,160,0.0,101.98901025789816,287.492746,321.123827,38.255083397058826,39.171311712568624,10043.736065124998,10272.2359395275, Native pair,Eager,8,4,2026-11-04,1,160,0.0,194.52531451740305,460.18580149999997,669.5489300075,39.478987329411765,40.83483904662745,10516.956972375,10819.89456913, Native pair,Eager,16,8,2026-11-04,1,320,0.0,361.61344039592217,575.20493475,1491.8287253674996,42.07236822352941,43.8597724259993,11348.86385075,12279.506196224998, Native pair,Eager,32,16,2026-11-04,1,640,0.622568093385214,630.8382442988809,713.5396607499999,2874.1329894199994,48.09799983333333,50.29466910102941,12927.665213125,15431.160003092498,