registryVersion: 1.12.0 models: - name: Llama 3.3 70B Instruct displayName: Llama 3.3 70B Instruct modelHubID: llama-3.3-instruct category: Language type: NGC description: Instruction-tuned model for multilingual chat, coding assistance, and synthetic data generation. Delivers strong performance across diverse benchmarks. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.llama.com/llama3_3/use-policy/ - label: License Agreement url: https://www.llama.com/llama3_3/license/ modelVariants: - variantId: Llama 3.3 70B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMS0wOFQwNDo1NDoyMy41MjVaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjICoqTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCBPdmVydmlldyoqXG5cbiMjICoqRGVzY3JpcHRpb246KipcblxuKipMbGFtYS0zLjMtNzBCLUluc3RydWN0KiogaXMgYW4gYXV0by1yZWdyZXNzaXZlIGxhbmd1YWdlIG1vZGVsIHRoYXQgdXNlcyBhbiBvcHRpbWl6ZWQgdHJhbnNmb3JtZXIgYXJjaGl0ZWN0dXJlLiBJdCBpcyBkZXNpZ25lZCBmb3IgdGV4dC1iYXNlZCB0YXNrcyBzdWNoIGFzIG11bHRpbGluZ3VhbCBjaGF0LCBjb2RpbmcgYXNzaXN0YW5jZSwgYW5kIHN5bnRoZXRpYyBkYXRhIGdlbmVyYXRpb24sIGFuZCBpcyBwYXJ0aWN1bGFybHkgb3B0aW1pemVkIGZvciBkaWFsb2d1ZS1iYXNlZCB1c2UgY2FzZXMuIFdpdGggNzAgYmlsbGlvbiBwYXJhbWV0ZXJzLCBpdCBwcm92aWRlcyBzdHJvbmcgcGVyZm9ybWFuY2UgdGhhdCBpcyBjb21wYXJhYmxlIHRvIGxhcmdlciBtb2RlbHMgYnV0IHdpdGggbG93ZXIgaGFyZHdhcmUgcmVxdWlyZW1lbnRzLCBhbmQgaXQgZG9lcyBub3QgcHJvY2VzcyBpbWFnZXMgb3IgYXVkaW8uXG5cblRoaXMgbW9kZWwgaXMgcmVhZHkgZm9yIGNvbW1lcmNpYWwvbm9uLWNvbW1lcmNpYWwgdXNlLlxuXG5UaGlzIHZlcnNpb24gaW50cm9kdWNlcyBzdXBwb3J0IGZvciBHQjIwMCBOVkw3MiwgR0gyMDAgTlZMMiwgQjIwMCBhbmQgTlZGUDQuIENVREEgdXBkYXRlZCB0byB2ZXJzaW9uIDEyLjkuIEZvciBkZXRhaWxlZCBpbmZvcm1hdGlvbiwgcmVmZXIgdG8gUmVsZWFzZSBbTm90ZXMgZm9yIE5WSURJQSBOSU0gZm9yIExMTXMgTExNIDEuMTJdKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25pbS9sYXJnZS1sYW5ndWFnZS1tb2RlbHMvbGF0ZXN0L3JlbGVhc2Utbm90ZXMuaHRtbCkuIFxuXG4jIyAqKlRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uKipcblxuVGhpcyBtb2RlbCBpcyBub3Qgb3duZWQgb3IgZGV2ZWxvcGVkIGJ5IE5WSURJQS4gVGhpcyBtb2RlbCBoYXMgYmVlbiBkZXZlbG9wZWQgYW5kIGJ1aWx0IHRvIGEgdGhpcmQtcGFydHkncyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBXFxbbWV0YS1sbGFtYS9MbGFtYS0zLjMtNzBCLUluc3RydWN0XFxdICBcbihbaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9tZXRhLWxsYW1hL0xsYW1hLTMuMy03MEItSW5zdHJ1Y3RdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjMtNzBCLUluc3RydWN0KSkuIFxuXG4jIyAqKkxpY2Vuc2UvVGVybXMgb2YgVXNlOioqXG5cbioqR09WRVJOSU5HIFRFUk1TOioqIFRoZSBOSU0gY29udGFpbmVyIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIFNvZnR3YXJlIExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtc29mdHdhcmUtbGljZW5zZS1hZ3JlZW1lbnQvKSBhbmQgdGhlIFtQcm9kdWN0LVNwZWNpZmljIFRlcm1zIGZvciBOVklESUEgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzLyk7IGFuZCB0aGUgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtYWktZm91bmRhdGlvbi1tb2RlbHMtY29tbXVuaXR5LWxpY2Vuc2UtYWdyZWVtZW50LykuIFxuXG5cbioqQURESVRJT05BTCBJTkZPUk1BVElPTioqOiBbTGxhbWEgMy4zIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18zL2xpY2Vuc2UvKS4gQnVpbHQgd2l0aCBMbGFtYS5cblxuIyMgKipHZXQgSGVscCoqXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgcHJvdmlkZWQgbW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cy5cblxuIyMgKipEZXBsb3ltZW50IEdlb2dyYXBoeToqKlxuXG5HbG9iYWwgXG5cbiMjICoqVXNlIENhc2U6KipcblxuVGhpcyBtb2RlbCBpcyBpbnRlbmRlZCBmb3IgZGV2ZWxvcGVycywgcmVzZWFyY2hlcnMsIGFuZCBlbnRlcnByaXNlcy4gVGhleSB3b3VsZCBpbnRlZ3JhdGUgaXQgaW50byBhcHBsaWNhdGlvbnMgYW5kIHdvcmtmbG93cyBmb3IgYSB2YXJpZXR5IG9mIGFkdmFuY2VkIHRleHQtYmFzZWQgdGFza3MuXG5cbiogRm9yIENvbnZlcnNhdGlvbmFsIEFJOiBCdWlsZGluZyBzb3BoaXN0aWNhdGVkIGFuZCBuYXR1cmFsLXNvdW5kaW5nIGNoYXRib3RzIGZvciBjdXN0b21lciBzZXJ2aWNlLCBtdWx0aWxpbmd1YWwgdmlydHVhbCBhc3Npc3RhbnRzLCBhbmQgaW50ZXJhY3RpdmUgZGlhbG9ndWUgc3lzdGVtcy4gIFxuKiBGb3IgU29mdHdhcmUgRGV2ZWxvcG1lbnQ6IEVuZ2luZWVycyBtaWdodCB1c2UgdGhlIG1vZGVsIGFzIGEgcG93ZXJmdWwgY29kaW5nIGFzc2lzdGFudCBmb3IgZ2VuZXJhdGluZyBjb2RlLCBkZWJ1Z2dpbmcsIGV4cGxhaW5pbmcgY29tcGxleCBhbGdvcml0aG1zLCBhbmQgd3JpdGluZyBkb2N1bWVudGF0aW9uLiAgXG4qIEZvciBDb250ZW50IENyZWF0aW9uIGFuZCBBbmFseXNpczogQnVzaW5lc3NlcyBhbmQgY29udGVudCBjcmVhdG9ycyBtaWdodCB1c2UgdGhlIG1vZGVsICB0byBkcmFmdCBlbWFpbHMsIGdlbmVyYXRlIG1hcmtldGluZyBjb3B5LCBzdW1tYXJpemUgbG9uZyBkb2N1bWVudHMsIGFuZCBjcmVhdGUgc3ludGhldGljIHRleHQgZGF0YSB0byB0cmFpbiBvdGhlciBtYWNoaW5lIGxlYXJuaW5nIG1vZGVscy5cblxuIyMgKipSZWxlYXNlIERhdGU6KipcblxuQnVpbGQuTnZpZGlhLmNvbSAxMi8xNy8yMDI0IHZpYSAgXG5bbGxhbWEtMy4zLTcwYi1pbnN0cnVjdCBNb2RlbCBieSBNZXRhIHwgTlZJRElBIE5JTV0oaHR0cHM6Ly9idWlsZC5udmlkaWEuY29tL21ldGEvbGxhbWEtM18zLTcwYi1pbnN0cnVjdClcblxuR2l0aHViIDEyLzEzLzIwMjQgdmlhICAgXG5baHR0cHM6Ly9naXRodWIuYmxvZy9jaGFuZ2Vsb2cvMjAyNC0xMi0xMy1sbGFtYS0zLTMtNzBiLWluc3RydWN0LWlzLW5vdy1hdmFpbGFibGUtb24tZ2l0aHViLW1vZGVscy1nYS9dKGh0dHBzOi8vZ2l0aHViLmJsb2cvY2hhbmdlbG9nLzIwMjQtMTItMTMtbGxhbWEtMy0zLTcwYi1pbnN0cnVjdC1pcy1ub3ctYXZhaWxhYmxlLW9uLWdpdGh1Yi1tb2RlbHMtZ2EvKVxuXG5IdWdnaW5nZmFjZSAxMi8wNi8yMDI0IHZpYSAgIFxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjMtNzBCLUluc3RydWN0XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCkgXG5cbioqUmVmZXJlbmNlKHMpOioqIFxuXG5baHR0cHM6Ly9odWdnaW5nZmFjZS5jby9tZXRhLWxsYW1hL0xsYW1hLTMuMy03MEItSW5zdHJ1Y3RdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjMtNzBCLUluc3RydWN0KVxuXG4jIyAqKk1vZGVsIEFyY2hpdGVjdHVyZToqKiBcblxuQXJjaGl0ZWN0dXJlIFR5cGU6IFRyYW5zZm9ybWVyICBcbk5ldHdvcmsgQXJjaGl0ZWN0dXJlOiBMbGFtYS0zLjMtNzBCXG5cblRoaXMgbW9kZWwgd2FzIGRldmVsb3BlZCBiYXNlZCBvbiBNZXRhLUxsYW1hLTMuMy03MEIgIFxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjMtNzBCLUluc3RydWN0XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCkuXG5cbk51bWJlciBvZiBtb2RlbCBwYXJhbWV0ZXJzOiA3LjA2KjEwXjEwXG5cbiMjICoqSW5wdXQ6KipcblxuSW5wdXQgVHlwZShzKTogVGV4dCBcblxuSW5wdXQgRm9ybWF0KHMpOiBTdHJpbmcgXG5cbklucHV0IFBhcmFtZXRlcnM6IE9uZS1EaW1lbnNpb25hbCAoMUQpXG5cbk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBJbnB1dDogVGhlIG1vZGVsIHByb2Nlc3NlcyBpbnB1dCBhcyB0b2tlbnMuIFRoZSBtYXhpbXVtIGNvbnRleHQgbGVuZ3RoIGlzIDgsMTkyIHRva2Vucy4gSW5wdXQgdGV4dCBzdHJpbmdzIG11c3QgYmUgcHJlLXByb2Nlc3NlZCBieSB0aGUgbW9kZWwncyBzcGVjaWZpYyBUaWt0b2tlbiB0b2tlbml6ZXIgYmVmb3JlIGJlaW5nIGZlZCBpbnRvIHRoZSBtb2RlbC5cblxuIyMgKipPdXRwdXQ6KipcblxuT3V0cHV0IFR5cGUocyk6IFRleHQgXG5cbk91dHB1dCBGb3JtYXQocyk6IFN0cmluZ1xuXG5PdXRwdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDogVGhlIG1vZGVsIGdlbmVyYXRlcyB0ZXh0IGFzIGEgc2VxdWVuY2Ugb2YgdG9rZW5zLiBUaGUgbGVuZ3RoIG9mIHRoZSBnZW5lcmF0ZWQgb3V0cHV0IGNhbiBiZSBjb250cm9sbGVkIGJ5IGluZmVyZW5jZSBwYXJhbWV0ZXJzLiBUaGUgcmF3IHRva2VuIG91dHB1dCByZXF1aXJlcyBwb3N0LXByb2Nlc3NpbmcgKGRlLXRva2VuaXphdGlvbikgdG8gYmUgY29udmVydGVkIGludG8gYSBodW1hbi1yZWFkYWJsZSBzdHJpbmcuXG5cbk91ciBBSSBtb2RlbHMgYXJlIGRlc2lnbmVkIGFuZC9vciBvcHRpbWl6ZWQgdG8gcnVuIG9uIE5WSURJQSBHUFUtYWNjZWxlcmF0ZWQgc3lzdGVtcy4gQnkgbGV2ZXJhZ2luZyBOVklESUEncyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuXG5cbiMjICoqU29mdHdhcmUgSW50ZWdyYXRpb246KipcblxuUnVudGltZSBFbmdpbmU6IHZMTE0sIFRlbnNvclJUXG5cblN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OlxuXG5OVklESUEgQW1wZXJlICBcbk5WSURJQSBCbGFja3dlbGwgIFxuTlZJRElBIEhvcHBlciAgXG5OVklESUEgTG92ZWxhY2UgXG5cblByZWZlcnJlZCBPcGVyYXRpbmcgU3lzdGVtKHMpOlxuXG5MaW51eCAgIFxuV2luZG93c1xuXG5UaGUgaW50ZWdyYXRpb24gb2YgZm91bmRhdGlvbiBhbmQgZmluZS10dW5lZCBtb2RlbHMgaW50byBBSSBzeXN0ZW1zIHJlcXVpcmVzIGFkZGl0aW9uYWwgdGVzdGluZyB1c2luZyB1c2UtY2FzZS1zcGVjaWZpYyBkYXRhIHRvIGVuc3VyZSBzYWZlIGFuZCBlZmZlY3RpdmUgZGVwbG95bWVudC4gRm9sbG93aW5nIHRoZSBWLW1vZGVsIG1ldGhvZG9sb2d5LCBpdGVyYXRpdmUgdGVzdGluZyBhbmQgdmFsaWRhdGlvbiBhdCBib3RoIHVuaXQgYW5kIHN5c3RlbSBsZXZlbHMgYXJlIGVzc2VudGlhbCB0byBtaXRpZ2F0ZSByaXNrcywgbWVldCB0ZWNobmljYWwgYW5kIGZ1bmN0aW9uYWwgcmVxdWlyZW1lbnRzLCBhbmQgZW5zdXJlIGNvbXBsaWFuY2Ugd2l0aCBzYWZldHkgYW5kIGV0aGljYWwgc3RhbmRhcmRzIGJlZm9yZSBkZXBsb3ltZW50LlxuXG4jIyAqKk1vZGVsIFZlcnNpb24ocyk6KipcblxuTGxhbWEtMy4zLTcwQi1JbnN0cnVjdFxuXG4jIyAqKlVzYWdlKipcblxuIyMjICoqVXNlIHdpdGggdHJhbnNmb3JtZXJzKipcblxuU3RhcnRpbmcgd2l0aCB0cmFuc2Zvcm1lcnMgXFw+PSA0LjQ1LjAgb253YXJkLCB5b3UgY2FuIHJ1biBjb252ZXJzYXRpb25hbCBpbmZlcmVuY2UgdXNpbmcgdGhlIFRyYW5zZm9ybWVycyBwaXBlbGluZSBhYnN0cmFjdGlvbiBvciBieSBsZXZlcmFnaW5nIHRoZSBBdXRvIGNsYXNzZXMgd2l0aCB0aGUgZ2VuZXJhdGUoKSBmdW5jdGlvbi5cblxuTWFrZSBzdXJlIHRvIHVwZGF0ZSB5b3VyIHRyYW5zZm9ybWVycyBpbnN0YWxsYXRpb24gdmlhIHBpcCBpbnN0YWxsIFxcLS11cGdyYWRlIHRyYW5zZm9ybWVycy5cblxuU2VlIHRoZSBzbmlwcGV0IGJlbG93IGZvciB1c2FnZSB3aXRoIFRyYW5zZm9ybWVyczpcblxuYGBgXG5pbXBvcnQgdHJhbnNmb3JtZXJzXG5pbXBvcnQgdG9yY2hcblxubW9kZWxfaWQgPSBcIm1ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdFwiXG5cbnBpcGVsaW5lID0gdHJhbnNmb3JtZXJzLnBpcGVsaW5lKFxuICAgIFwidGV4dC1nZW5lcmF0aW9uXCIsXG4gICAgbW9kZWw9bW9kZWxfaWQsXG4gICAgbW9kZWxfa3dhcmdzPXtcInRvcmNoX2R0eXBlXCI6IHRvcmNoLmJmbG9hdDE2fSxcbiAgICBkZXZpY2VfbWFwPVwiYXV0b1wiLFxuKVxuXG5tZXNzYWdlcyA9IFtcbiAgICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIllvdSBhcmUgYSBwaXJhdGUgY2hhdGJvdCB3aG8gYWx3YXlzIHJlc3BvbmRzIGluIHBpcmF0ZSBzcGVhayFcIn0sXG4gICAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiV2hvIGFyZSB5b3U/XCJ9LFxuXVxuXG5vdXRwdXRzID0gcGlwZWxpbmUoXG4gICAgbWVzc2FnZXMsXG4gICAgbWF4X25ld190b2tlbnM9MjU2LFxuKVxucHJpbnQob3V0cHV0c1swXVtcImdlbmVyYXRlZF90ZXh0XCJdWy0xXSlcbmBgYFxuXG4jIyMgKipUb29sIHVzZSB3aXRoIHRyYW5zZm9ybWVycyoqXG5cbkxMYU1BLTMuMyBzdXBwb3J0cyBtdWx0aXBsZSB0b29sIHVzZSBmb3JtYXRzLiBZb3UgY2FuIHNlZSBhIGZ1bGwgZ3VpZGUgdG8gcHJvbXB0IGZvcm1hdHRpbmcgW2hlcmVdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vZG9jcy9tb2RlbC1jYXJkcy1hbmQtcHJvbXB0LWZvcm1hdHMvbGxhbWEzXzEvKS5cblxuVG9vbCB1c2UgaXMgYWxzbyBzdXBwb3J0ZWQgdGhyb3VnaCBbY2hhdCB0ZW1wbGF0ZXNdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZG9jcy90cmFuc2Zvcm1lcnMvbWFpbi9jaGF0X3RlbXBsYXRpbmcjYWR2YW5jZWQtdG9vbC11c2UtLWZ1bmN0aW9uLWNhbGxpbmcpIGluIFRyYW5zZm9ybWVycy4gSGVyZSBpcyBhIHF1aWNrIGV4YW1wbGUgc2hvd2luZyBhIHNpbmdsZSBzaW1wbGUgdG9vbDpcblxuYGBgXG4jIEZpcnN0LCBkZWZpbmUgYSB0b29sXG5kZWYgZ2V0X2N1cnJlbnRfdGVtcGVyYXR1cmUobG9jYXRpb246IHN0cikgLT4gZmxvYXQ6XG4gICAgXCJcIlwiXG4gICAgR2V0IHRoZSBjdXJyZW50IHRlbXBlcmF0dXJlIGF0IGEgbG9jYXRpb24uXG4gICAgXG4gICAgQXJnczpcbiAgICAgICAgbG9jYXRpb246IFRoZSBsb2NhdGlvbiB0byBnZXQgdGhlIHRlbXBlcmF0dXJlIGZvciwgaW4gdGhlIGZvcm1hdCBcIkNpdHksIENvdW50cnlcIlxuICAgIFJldHVybnM6XG4gICAgICAgIFRoZSBjdXJyZW50IHRlbXBlcmF0dXJlIGF0IHRoZSBzcGVjaWZpZWQgbG9jYXRpb24gaW4gdGhlIHNwZWNpZmllZCB1bml0cywgYXMgYSBmbG9hdC5cbiAgICBcIlwiXCJcbiAgICByZXR1cm4gMjIuICAjIEEgcmVhbCBmdW5jdGlvbiBzaG91bGQgcHJvYmFibHkgYWN0dWFsbHkgZ2V0IHRoZSB0ZW1wZXJhdHVyZSFcblxuIyBOZXh0LCBjcmVhdGUgYSBjaGF0IGFuZCBhcHBseSB0aGUgY2hhdCB0ZW1wbGF0ZVxubWVzc2FnZXMgPSBbXG4gIHtcInJvbGVcIjogXCJzeXN0ZW1cIiwgXCJjb250ZW50XCI6IFwiWW91IGFyZSBhIGJvdCB0aGF0IHJlc3BvbmRzIHRvIHdlYXRoZXIgcXVlcmllcy5cIn0sXG4gIHtcInJvbGVcIjogXCJ1c2VyXCIsIFwiY29udGVudFwiOiBcIkhleSwgd2hhdCdzIHRoZSB0ZW1wZXJhdHVyZSBpbiBQYXJpcyByaWdodCBub3c/XCJ9XG5dXG5cbmlucHV0cyA9IHRva2VuaXplci5hcHBseV9jaGF0X3RlbXBsYXRlKG1lc3NhZ2VzLCB0b29scz1bZ2V0X2N1cnJlbnRfdGVtcGVyYXR1cmVdLCBhZGRfZ2VuZXJhdGlvbl9wcm9tcHQ9VHJ1ZSlcbmBgYFxuXG5Zb3UgY2FuIHRoZW4gZ2VuZXJhdGUgdGV4dCBmcm9tIHRoaXMgaW5wdXQgYXMgbm9ybWFsLiBJZiB0aGUgbW9kZWwgZ2VuZXJhdGVzIGEgdG9vbCBjYWxsLCB5b3Ugc2hvdWxkIGFkZCBpdCB0byB0aGUgY2hhdCBsaWtlIHNvOlxuXG5gYGBcbnRvb2xfY2FsbCA9IHtcIm5hbWVcIjogXCJnZXRfY3VycmVudF90ZW1wZXJhdHVyZVwiLCBcImFyZ3VtZW50c1wiOiB7XCJsb2NhdGlvblwiOiBcIlBhcmlzLCBGcmFuY2VcIn19XG5tZXNzYWdlcy5hcHBlbmQoe1wicm9sZVwiOiBcImFzc2lzdGFudFwiLCBcInRvb2xfY2FsbHNcIjogW3tcInR5cGVcIjogXCJmdW5jdGlvblwiLCBcImZ1bmN0aW9uXCI6IHRvb2xfY2FsbH1dfSlcbmBgYFxuXG5hbmQgdGhlbiBjYWxsIHRoZSB0b29sIGFuZCBhcHBlbmQgdGhlIHJlc3VsdCwgd2l0aCB0aGUgdG9vbCByb2xlLCBsaWtlIHNvOlxuXG5gYGBcbm1lc3NhZ2VzLmFwcGVuZCh7XCJyb2xlXCI6IFwidG9vbFwiLCBcIm5hbWVcIjogXCJnZXRfY3VycmVudF90ZW1wZXJhdHVyZVwiLCBcImNvbnRlbnRcIjogXCIyMi4wXCJ9KVxuYGBgXG5cbkFmdGVyIHRoYXQsIHlvdSBjYW4gZ2VuZXJhdGUoKSBhZ2FpbiB0byBsZXQgdGhlIG1vZGVsIHVzZSB0aGUgdG9vbCByZXN1bHQgaW4gdGhlIGNoYXQuIE5vdGUgdGhhdCB0aGlzIHdhcyBhIHZlcnkgYnJpZWYgaW50cm9kdWN0aW9uIHRvIHRvb2wgY2FsbGluZyBcXC0gZm9yIG1vcmUgaW5mb3JtYXRpb24sIHNlZSB0aGUgW0xMYU1BIHByb21wdCBmb3JtYXQgZG9jc10oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9kb2NzL21vZGVsLWNhcmRzLWFuZC1wcm9tcHQtZm9ybWF0cy9sbGFtYTNfMS8pIGFuZCB0aGUgVHJhbnNmb3JtZXJzIFt0b29sIHVzZSBkb2N1bWVudGF0aW9uXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RvY3MvdHJhbnNmb3JtZXJzL21haW4vY2hhdF90ZW1wbGF0aW5nI2FkdmFuY2VkLXRvb2wtdXNlLS1mdW5jdGlvbi1jYWxsaW5nKS5cblxuIyMjICoqVXNlIHdpdGggYml0c2FuZGJ5dGVzKipcblxuVGhlIG1vZGVsIGNoZWNrcG9pbnRzIGNhbiBiZSB1c2VkIGluIDgtYml0IGFuZCA0LWJpdCBmb3IgZnVydGhlciBtZW1vcnkgb3B0aW1pc2F0aW9ucyB1c2luZyBiaXRzYW5kYnl0ZXMgYW5kIHRyYW5zZm9ybWVyc1xuXG5TZWUgdGhlIHNuaXBwZXQgYmVsb3cgZm9yIHVzYWdlOlxuXG5gYGBcbmltcG9ydCB0b3JjaFxuZnJvbSB0cmFuc2Zvcm1lcnMgaW1wb3J0IEF1dG9Nb2RlbEZvckNhdXNhbExNLCBBdXRvVG9rZW5pemVyXG5cbm1vZGVsX2lkID0gXCJtZXRhLWxsYW1hL0xsYW1hLTMuMy03MEItSW5zdHJ1Y3RcIlxucXVhbnRpemF0aW9uX2NvbmZpZyA9IEJpdHNBbmRCeXRlc0NvbmZpZyhsb2FkX2luXzhiaXQ9VHJ1ZSlcblxucXVhbnRpemVkX21vZGVsID0gQXV0b01vZGVsRm9yQ2F1c2FsTE0uZnJvbV9wcmV0cmFpbmVkKFxuICAgIG1vZGVsX2lkLCBkZXZpY2VfbWFwPVwiYXV0b1wiLCB0b3JjaF9kdHlwZT10b3JjaC5iZmxvYXQxNiwgcXVhbnRpemF0aW9uX2NvbmZpZz1xdWFudGl6YXRpb25fY29uZmlnKVxuXG50b2tlbml6ZXIgPSBBdXRvVG9rZW5pemVyLmZyb21fcHJldHJhaW5lZChtb2RlbF9pZClcbmlucHV0X3RleHQgPSBcIldoYXQgYXJlIHdlIGhhdmluZyBmb3IgZGlubmVyP1wiXG5pbnB1dF9pZHMgPSB0b2tlbml6ZXIoaW5wdXRfdGV4dCwgcmV0dXJuX3RlbnNvcnM9XCJwdFwiKS50byhcImN1ZGFcIilcblxub3V0cHV0ID0gcXVhbnRpemVkX21vZGVsLmdlbmVyYXRlKCoqaW5wdXRfaWRzLCBtYXhfbmV3X3Rva2Vucz0xMClcblxucHJpbnQodG9rZW5pemVyLmRlY29kZShvdXRwdXRbMF0sIHNraXBfc3BlY2lhbF90b2tlbnM9VHJ1ZSkpXG5gYGBcblxuVG8gbG9hZCBpbiA0LWJpdCBzaW1wbHkgcGFzcyBsb2FkXFxfaW5cXF80Yml0PVRydWVcblxuIyMjICoqVXNlIHdpdGggbGxhbWEqKlxuXG5QbGVhc2UsIGZvbGxvdyB0aGUgaW5zdHJ1Y3Rpb25zIGluIHRoZSBbcmVwb3NpdG9yeV0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvbGxhbWEpLlxuXG5UbyBkb3dubG9hZCBPcmlnaW5hbCBjaGVja3BvaW50cywgc2VlIHRoZSBleGFtcGxlIGNvbW1hbmQgYmVsb3cgbGV2ZXJhZ2luZyBodWdnaW5nZmFjZS1jbGk6XG5cbmBgYFxuaHVnZ2luZ2ZhY2UtY2xpIGRvd25sb2FkIG1ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCAtLWluY2x1ZGUgXCJvcmlnaW5hbC8qXCIgLS1sb2NhbC1kaXIgTGxhbWEtMy4zLTcwQi1JbnN0cnVjdFxuYGBgXG5cbiMjICoqVHJhaW5pbmcsIFRlc3RpbmcsIGFuZCBFdmFsdWF0aW9uIERhdGFzZXRzOioqXG5cbiMjIyAqKlRyYWluaW5nIERhdGFzZXQqKlxuXG4qKkRhdGEgTW9kYWxpdHk6KiogVGV4dCBcblxuXG4qKkxpbms6KiogVW5kaXNjbG9zZWRcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kOioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpYywgQXV0b21hdGVkXG5cbioqTGFiZWxpbmcgTWV0aG9kOioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpY1xuXG4qKlByb3BlcnRpZXM6KiogXG5cblRoZSBwcmUtdHJhaW5pbmcgZGF0YXNldCBjb250YWlucyBvdmVyIDE1IHRyaWxsaW9uICgxNVQpIHRva2VucyBmcm9tIGEgZGl2ZXJzZSBtaXggb2YgcHVibGljbHkgYXZhaWxhYmxlIG9ubGluZSBzb3VyY2VzLiBUaGUgZmluZS10dW5pbmcgZGF0YXNldCBjb25zaXN0cyBvZiBwcm9tcHRzIGFuZCBwcmVmZXJlbmNlLXJhbmtlZCByZXNwb25zZXMgZGVzaWduZWQgdG8gaW1wcm92ZSBoZWxwZnVsbmVzcyBhbmQgc2FmZXR5LlxuXG4jIyMgKipUZXN0aW5nIERhdGFzZXQqKlxuXG4qKkxpbms6KiogVW5kaXNjbG9zZWRcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kOioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpYywgQXV0b21hdGVkXG5cbioqTGFiZWxpbmcgTWV0aG9kOioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKlByb3BlcnRpZXM6KiogXG5cblRoZSBwdWJsaWMgZGF0YXNldHMgY292ZXIgYSB3aWRlIHJhbmdlIG9mIHRhc2tzIGluY2x1ZGluZyBtYXNzaXZlIG11bHRpdGFzayBsYW5ndWFnZSB1bmRlcnN0YW5kaW5nIChNTUxVKSwgcHJvYmxlbS1zb2x2aW5nIChHU004SyksIGFuZCBjb2RlIGdlbmVyYXRpb24gKEh1bWFuRXZhbCkuIE1ldGEncyBpbnRlcm5hbCBldmFsdWF0aW9uIHNldCBjb250YWlucyBvdmVyIDIsMDAwIHByb21wdHMgZGVzaWduZWQgdG8gdGVzdCBmb3Igc2FmZXR5IGFuZCBoZWxwZnVsbmVzcyBhY3Jvc3MgdmFyaW91cyBwb3RlbnRpYWxseSByaXNreSBjYXRlZ29yaWVzLiBcblxuIyMjICoqRXZhbHVhdGlvbiBEYXRhc2V0KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWRcblxuKipQcm9wZXJ0aWVzOioqIFxuXG5UaGUgcHVibGljIGRhdGFzZXRzIGFyZSBpbmR1c3RyeS1zdGFuZGFyZCBiZW5jaG1hcmtzIGRlc2lnbmVkIHRvIGV2YWx1YXRlIGRpdmVyc2UgY2FwYWJpbGl0aWVzIGxpa2UgZ2VuZXJhbCBrbm93bGVkZ2UsIHJlYXNvbmluZywgY29kaW5nLCBhbmQgbWF0aC4gRm9yIGV4YW1wbGUsIE1NTFUgdGVzdHMgbXVsdGl0YXNrIGtub3dsZWRnZSwgSHVtYW5FdmFsIHRlc3RzIGNvZGUgZ2VuZXJhdGlvbiwgYW5kIEdTTThLIHRlc3RzIGdyYWRlLXNjaG9vbCBtYXRoIHdvcmQgcHJvYmxlbXMuIE1ldGEncyBwcml2YXRlIGV2YWx1YXRpb24gc2V0IGNvbnRhaW5zIG92ZXIgMiwwMDAgcHJvbXB0cyBmb3IgYXNzZXNzaW5nIHNhZmV0eSBhbmQgaGVscGZ1bG5lc3MuXG5cbioqRGV0YWlsZWQgUGVyZm9ybWFuY2U6KipcblxufCBDYXRlZ29yeSB8IEJlbmNobWFyayB8IFxcIyBTaG90cyB8IE1ldHJpYyB8IExsYW1hIDMuMSA4QiBJbnN0cnVjdCB8IExsYW1hIDMuMSA3MEIgSW5zdHJ1Y3QgfCBMbGFtYS0zLjMgNzBCIEluc3RydWN0IHwgTGxhbWEgMy4xIDQwNUIgSW5zdHJ1Y3QgfFxufCAtLS0tLSB8IC0tLS0tIHwgLS0tLS0gfCAtLS0tLSB8IC0tLS0tIHwgLS0tLS0gfCAtLS0tLSB8IC0tLS0tIHxcbnwgIHwgTU1MVSAoQ29UKSB8IDAgfCBtYWNyb1xcX2F2Zy9hY2MgfCA3My4wIHwgODYuMCB8IDg2LjAgfCA4OC42IHxcbnwgIHwgTU1MVSBQcm8gKENvVCkgfCA1IHwgbWFjcm9cXF9hdmcvYWNjIHwgNDguMyB8IDY2LjQgfCA2OC45IHwgNzMuMyB8XG58IFN0ZWVyYWJpbGl0eSB8IElGRXZhbCB8ICB8ICB8IDgwLjQgfCA4Ny41IHwgOTIuMSB8IDg4LjYgfFxufCBSZWFzb25pbmcgfCBHUFFBIERpYW1vbmQgKENvVCkgfCAwIHwgYWNjIHwgMzEuOCB8IDQ4LjAgfCA1MC41IHwgNDkuMCB8XG58IENvZGUgfCBIdW1hbkV2YWwgfCAwIHwgcGFzc0AxIHwgNzIuNiB8IDgwLjUgfCA4OC40IHwgODkuMCB8XG58ICB8IE1CUFAgRXZhbFBsdXMgKGJhc2UpIHwgMCB8IHBhc3NAMSB8IDcyLjggfCA4Ni4wIHwgODcuNiB8IDg4LjYgfFxufCBNYXRoIHwgTUFUSCAoQ29UKSB8IDAgfCBzeW1weVxcX2ludGVyc2VjdGlvblxcX3Njb3JlIHwgNTEuOSB8IDY4LjAgfCA3Ny4wIHwgNzMuOCB8XG58IFRvb2wgVXNlIHwgQkZDTCB2MiB8IDAgfCBvdmVyYWxsXFxfYXN0XFxfc3VtbWFyeS9tYWNyb1xcX2F2Zy92YWxpZCB8IDY1LjQgfCA3Ny41IHwgNzcuMyB8IDgxLjEgfFxufCBNdWx0aWxpbmd1YWwgfCBNR1NNIHwgMCB8IGVtIHwgNjguOSB8IDg2LjkgfCA5MS4xIHwgOTEuNiB8XG5cbiMjICoqVGVjaG5pY2FsIExpbWl0YXRpb25zKiogXG5cblRlc3RpbmcgY29uZHVjdGVkIHRvIGRhdGUgaGFzIG5vdCBjb3ZlcmVkLCBub3IgY291bGQgaXQgY292ZXIsIGFsbCBzY2VuYXJpb3MuIEZvciB0aGVzZSByZWFzb25zLCBhcyB3aXRoIGFsbCBMTE1zLCB0aGUgbW9kZWwncyBwb3RlbnRpYWwgb3V0cHV0cyBjYW5ub3QgYmUgcHJlZGljdGVkIGluIGFkdmFuY2UsIGFuZCB0aGUgbW9kZWwgbWF5IGluIHNvbWUgaW5zdGFuY2VzIHByb2R1Y2UgaW5hY2N1cmF0ZSwgYmlhc2VkIG9yIG90aGVyIG9iamVjdGlvbmFibGUgcmVzcG9uc2VzIHRvIHVzZXIgcHJvbXB0cy4gVGhlcmVmb3JlLCBiZWZvcmUgZGVwbG95aW5nIHRoaXMgbW9kZWwgaW4gYW55IGFwcGxpY2F0aW9ucywgZGV2ZWxvcGVycyBzaG91bGQgcGVyZm9ybSBzYWZldHkgdGVzdGluZyBhbmQgdHVuaW5nIHRhaWxvcmVkIHRvIHRoZWlyIHNwZWNpZmljIGFwcGxpY2F0aW9ucy4gUGxlYXNlIHJlZmVyIHRvIGF2YWlsYWJsZSByZXNvdXJjZXMgaW5jbHVkaW5nIHRoZSBbUmVzcG9uc2libGUgVXNlIEd1aWRlXShodHRwczovL2xsYW1hLm1ldGEuY29tL3Jlc3BvbnNpYmxlLXVzZS1ndWlkZSksIFtUcnVzdCBhbmQgU2FmZXR5XShodHRwczovL2xsYW1hLm1ldGEuY29tL3RydXN0LWFuZC1zYWZldHkvKSBzb2x1dGlvbnMsIGFuZCBvdGhlciBbcmVzb3VyY2VzXShodHRwczovL2xsYW1hLm1ldGEuY29tL2RvY3MvZ2V0LXN0YXJ0ZWQvKSB0byBsZWFybiBtb3JlIGFib3V0IHJlc3BvbnNpYmxlIGRldmVsb3BtZW50LiBcblxuIyMgKipJbmZlcmVuY2U6KipcblxuKipBY2NlbGVyYXRpb24gRW5naW5lOioqIHZMTE0sIFRlbnNvclJUIFxuXG4qKlRlc3QgSGFyZHdhcmU6KiogXG4gICBcbiogQjIwMCBTWE0gICBcbiogSDIwMCBTWE0gIFxuKiBIMTAwIFNYTSAgXG4qIEExMDAgU1hNIDgwR0IgIFxuKiBBMTAwIFNYTSA0MEdCICBcbiogTDQwUyBQQ0llICBcbiogQTEwRyAgXG4qIEgxMDAgTlZMICBcbiogSDIwMCBOVkwgIFxuKiBHSDIwMCA5NkdCICAgIFxuKiBHQjIwMCBOVkw3MlxuKiBHSDIwMCBOVkwyXG4qIFJUWCA1MDkwICBcbiogUlRYIDQwOTAgIFxuKiBSVFggNjAwMCBBZGFcblxuIyMgKipFdGhpY2FsIENvbnNpZGVyYXRpb25zOioqXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLiBQbGVhc2UgcmVwb3J0IHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLlxuXG5Zb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBwcm92aWRlZCBtb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1MMjZVLUlGSU4iLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJydHg2MDAwLWJsYWNrd2VsbC1zdng0LXRocm91Z2hwdXQtYmYxNi1qZGlqZDMycXJxIiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxNDgyNzk2OTYxMTAsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvbGxhbWEtM18zLTcwYi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIk4vQSIsCiAgICAibmFtZSI6ICJsbGFtYS0zLjMtNzBiLWluc3RydWN0IiwKICAgICJvcmdOYW1lIjogIm5pbSIsCiAgICAicHJlY2lzaW9uIjogIk4vQSIsCiAgICAicHJpdmFjeSI6ICIiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk1ldGEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJUaGUgTWV0YSBMbGFtYSAzLjMgbXVsdGlsaW5ndWFsIGxhcmdlIGxhbmd1YWdlIG1vZGVsIChMTE0pIGlzIGEgcHJldHJhaW5lZCBhbmQgaW5zdHJ1Y3Rpb24gdHVuZWQgZ2VuZXJhdGl2ZSBtb2RlbCBpbiA3MEIgKHRleHQgaW4vdGV4dCBvdXQpLiIsCiAgICAidGVhbU5hbWUiOiAibWV0YSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0yOFQyMDozNzo0Ni4yNDFaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/meta/containers/llama-3.3-70b-instruct optimizationProfiles: - profileId: nim/meta/llama-3.3-70b-instruct:h200x1-throughput-fp8-r-6bjqwx5a framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200x1 FP8 Throughput ngcMetadata: 02f132ac03fb2ab51b82d88abce83b64feb565c93ad1d54f3b2ab04b7c86b21f: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 70c427b55c83a3c54340d828ce94b546ad566be2ec930f0bd760a00927b4b180 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x1-throughput-nvfp4-1bf1rojpxw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x1 NVFP4 Throughput ngcMetadata: 09fcf7a392fe17c95e87d390742222a4a904b540f79f7b3b3d414bf3a092660b: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 33af5b8bea236de1a255b3108bcbb55e0dad3135b676d809d8ce339956cf67d4 number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:a100x2-throughput-bf16-5hyfmddv4a framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A100x2 BF16 Throughput ngcMetadata: 12c295e09aa3a3bac95522db7c0af51e27d6a4283b0402298c98691fc121a8ae: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 517f622a203fd1bdf58c0ba179d9be37fa1917c1f49e0a5aa85c7f5d3b8731b3 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 135GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x2-throughput-bf16-neynbhcsra framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x2 BF16 Throughput ngcMetadata: 12f9ae91afef2d29f5ef4c312f0922ac8ed5aa877c8c49416b0dfaf9dcb902e0: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: fda9c04c123bfcdfae4f8f81847d3aee5eb51698a39dd5905d6581d780b90209 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x4-latency-bf16-h4d-jgziqw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x4 BF16 Latency ngcMetadata: 135406168c0a2540196ed6f8003e35f8326cda374c6beb6f92b8b6f4883fbf0d: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 76e7be2bffcb7a930d207aa6f616ba863f1884672c64680ec0fca11bfc88304b number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 4 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:a10gx8-latency-bf16-of3qbtqvsg framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A10Gx8 BF16 Latency ngcMetadata: 168f348ad80045c0a730210c796a66ccf83768df25543f8b0567c1e186be9ad6: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 00a7b1bb5360bc13540061f29a07344a7aa2feefc46f7f7ff355131ba9d4690d number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 150GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200_NVLx2 BF16 Throughput ngcMetadata: 195071914f36a70a2b4306853667c37e6dd145c4ed787d099a0be9e75d84c58d: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 651dca39d0943930cc8b7bc0b5cd116294a25601c9f43deab2e362e3c96fde11 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__2 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A100_SXM4_40GBx8 BF16 Throughput ngcMetadata: 230323019f91e55e7e5ef0f472984bfe38672edc42d5d8f301887842e303e866: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 165e61398618addb727e82b8809cea1215b044020a8568597a31d7bee23b05e8 number_of_gpus: '8' pp: '1' precision: bf16 profile: throughput tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__3 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100_NVLx2 BF16 Throughput ngcMetadata: 252cb13923588a782037650b182dcc87562a58a6a1dc48a31519f9964dee57bd: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: adda34b085d63494164d063e4a82677e59bcde4543da432d4a550a84185434e0 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x2-latency-fp8-n6ww5ulixq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x2 FP8 Latency ngcMetadata: 2d46c8f638e9000b9892b517219356e3b980aabd33f027e7c858386688febd52: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 00103c1174a5863d30a1429e5aba6b251aa676ec57460280f28c6cb61f117d98 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__4 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_144GBx2 BF16 Throughput ngcMetadata: 30809103f16d80f0f834cfec8d3a48617ac311a1e13150534e01d1c34b0a5db7: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 70078c4e36e97245d7fe026a7cac6258820c5d8df77bf2d10432c6a35007e7e2 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h200x4-latency-bf16-cp-xxbkpta framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200x4 BF16 Latency ngcMetadata: 41bc6ff1de6d3dcfe33b8070b32a89946b55b5770c92c82ffb8bb87b8e3fc9d7: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7c9d81be68e9ba750798e8c48585ebbce4d271d36981e30f09019e011d8e389a number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 4 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 139GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:a100x8-latency-bf16-qfohcfr1iq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A100x8 BF16 Latency ngcMetadata: 443b4edfa5128abcbc85f57ca43e02053730a3fc22929e4b7864422cf5b12d16: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d8669419688b2ce0f64218aeaa11f4840e272e2d1f5d11fc5e0d1b3f53476e2d number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 8 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 147GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__5 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_144GBx2 FP8 Latency ngcMetadata: 44edc112b59ec6736bc9fc172d7219b9999f4398e5b61a7ca692a2053e1f4fc0: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d6f8ec1ae3a5910ae26ff689e3416a0947cf1c1c1bcc7dfc8d3186e490bcb36c number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__6 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_144GBx2 FP8 Throughput ngcMetadata: 4a4dc27109678a256cf4ae5209280f044a6562ade8c2e5bca3025a096a41c551: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e075a3b9652dae46b800108afda2a6f7c0f6301a35a1db3671dc8af30f1fd5a2 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x1-throughput-nvfp4-ujocyfzf6a framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x1 NVFP4 Throughput ngcMetadata: 4bf0e1bc784ba2c8b1ae399bb1042d1546bac30df98d02663d4e1db60744aabc: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: cf417dfa6ac83cc20cfb5404ec0b2eae321d174bc4808d6007df8562ffee63d8 number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:l40sx4-latency-fp8-vl02sw2m-g framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct L40Sx4 FP8 Latency ngcMetadata: 52050fe50397b0b158fafe24a0c1e74efad0d04351274757337c86fc99968dd9: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a9d77447899d9eb9de5254bf262250c7321a6522f30d485abd4072fc1de36dcc number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__7 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_144GBx1 FP8 Throughput ngcMetadata: 5b6330f563a4c3f73c9b02dc126295dd85d954c0623581981d1c6179155d9f7b: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0f31befe5670c8fd4ae2429ceaa76edcfcbcdfb96db0375e2671df999e4038c7 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__8 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_480GBx1 FP8 Latency ngcMetadata: 5e578516ea42fae60c4f314736e8d3e506c497894e059a6af96bd4c2c84edf23: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 68e492b05ff7304cf14489a9a313eb7049ab552fb27b106d1dc61af71a5b7c29 number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:a10gx8-throughput-bf16-rl2yes9ktw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A10Gx8 BF16 Throughput ngcMetadata: 613255b124f05cbf875c142c5ea7c2e3ebb7754a8a5473ad828d2bb07e2eaa88: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c0f0a6abdd6734299ec6f65611fa66490fd46303035100f9c865dd5d3c1dfb19 number_of_gpus: '8' pp: '1' precision: bf16 profile: throughput tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 150GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h200x2-throughput-bf16-lciwvjwxkw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200x2 BF16 Throughput ngcMetadata: 64878d614ca9a859228cd55d140af0865823c2f3524e43c7be53c01c039481b6: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 824477061f9c69bd79fd248a136a273e8d861d092fb853ede5e06e12510d8188 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__9 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx8 BF16 Latency ngcMetadata: 706687e8d19dccfb16a39808c18e54b9e55f7a5d6c2384df2c805453445ee4bb: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 095fa13f893ed4235a19615963e6b18bdb3e599ad5631c493007ae59dfe73f46 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 8 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:a100x4-throughput-bf16-lyvveim8va framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A100x4 BF16 Throughput ngcMetadata: 76e28450af746bb7626af7e5e2db4b57b56f11f5b6632a120eefabba925c2b15: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f14e1bad1a0e78da150aeedfee7919ab3ef21def09825caffef460b93fdde9b7 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 4 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 140GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:l40sx4-throughput-bf16-rhzeshgk8w framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct L40Sx4 BF16 Throughput ngcMetadata: 7cb838de5dad2c42066f0616756d0ad2708939c450b95416d41098e9931470c1: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c419c6ba54c118a6deb6ed9918e9c72e7f151698116c1d3c2bc32042a94d6bbb number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 140GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h100x2-throughput-bf16-m9pz-s1ymq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100x2 BF16 Throughput ngcMetadata: 7ed84ed093e8c5e8d237966262d640c6c2f160a8606df22e869e6f7a5a83cc96: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 5006533ca6b5151e94f18d8e518c68965918f248d0680b23e9fc0e4553e0d9ef number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h100x2-throughput-fp8-wbna-gqhxw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100x2 FP8 Throughput ngcMetadata: 7f4107d806d19c2c2beb2e870bf01217de37a247f27ee168985fc42a9576c641: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0013e870ea929584ec13dad6948450024cdc6c2f03a865f1b050fb08b9f64312 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__10 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct A100_SXM4_40GBx8 BF16 Latency ngcMetadata: 814d03ce098b7de458602c7bce320c3d06fe898759577c849a34193653a70bbb: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7a207406eaa12a8bb549ea578116338e4e204d3b38ed0ffb6a9d9d789f2cd994 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__11 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200_NVLx1 FP8 Throughput ngcMetadata: 829d3e1c28ffd52afed2d35e9374cfc7b605eda5a630bc9b33fbea5500da8fb3: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 34a1cf18c4d7501df008280668fe6df7de1f91ff29daee8d5c80291dd6e51b0e number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x2-latency-nvfp4-prgjwnsudw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x2 NVFP4 Latency ngcMetadata: 8abcb1c5fc3e57d712a311f08f9b33b59b383196b95f7d7f66c758de85d56567: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 807294ccda05820ac7bbb9cf0471df7494e947226acff080c0782bda0c7d4394 number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h200x2-latency-fp8-ozazyo6fjw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200x2 FP8 Latency ngcMetadata: 92e9707e66c742310e9a7a6d38e162b2578375c8fe0844939c499a00116a994e: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 138ef4644a3d6477c3deaf2cd22f548d3396925db62f4752fb73b52b7b8a4a29 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x1-latency-nvfp4-gbqmrrkwrw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x1 NVFP4 Latency ngcMetadata: a1366af9ab8c32f147d10d0fcc2a43d55b20f2c79178b4a291caa5dec55f966c: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 19ca51edfcfaecd4c68b0950ff57be89e59def4ad003dbcfae4352b43d152223 number_of_gpus: '1' pp: '1' precision: nvfp4 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h100x4-latency-fp8-mg52y2fpwq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100x4 FP8 Latency ngcMetadata: a2003c7b2b19b79aefb52cd9daa58fb20f0520dd9759037ff34e67110f384218: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 8a5f27c50cf45f7d1a1e504bcd33820eefa80539b94a68bbf015c3f4f4cb2c3f number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__12 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx4 BF16 Throughput ngcMetadata: a403f6513a44565063a70541681355465810849c0f537c825cd6575c960c2c14: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4896c9f159be7403ca983e4da47959b87841d5fe0034304ab473baf61f3132a1 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x1-latency-fp8-uepcd7pd4a framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x1 FP8 Latency ngcMetadata: a425a0f4eef147092d6d41acbd7c9c3408614205b8135699274b02f2363b707c: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0cedb0518e3995aa41d37920a83b151ad05bdf2a43beedbff21b709cf696e350 number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__13 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_144GBx2 BF16 Latency ngcMetadata: a6f328cf048298b737a05799b74a3f81b4a215f125d71088054c6c32f3446801: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7e9757ebb03d4334fd350490505620d2af6b5329aa8a28df931e0a22e46d55cd number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__14 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx2 FP8 Throughput ngcMetadata: a9f34dd0f8e4fd295b0d04067aa0ecce24aa3707b26305e9ab084d430546975c: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 77ab630b949b0a58ad580a22ea055bc392a30fbf57357d6398814e00775aab8c number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x1-throughput-fp8-ybdaheki0g framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x1 FP8 Throughput ngcMetadata: af09a13bcaa3650952df251a0dfd03dabaf7700a6d00b6f2264b2c9ef757fbb6: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b6dc07bb5bf5be874355bbe6288ca066c605a43c23d6c537ac9d4929c22d2cdd number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__15 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GH200_480GBx1 FP8 Throughput ngcMetadata: c7fc979432a42458118ab456c33302cbde984c5d8a0035e9d2c1d07b5f3dc0d9: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 1dea2d2f10ec64c74ca127f73b52bf5253dfdc91c5cd5da07cb742e166e8a795 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:l40sx4-throughput-fp8-sx6as-ue-a framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct L40Sx4 FP8 Throughput ngcMetadata: cf120c3ecf2025e6a170cb224802ca6a02cbeec3ad74944a69263b3193a64fa2: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b118ae4fb04a6bbcf439004b94edd4815d2c965a0c692c2b98a790580c9c3f7b number_of_gpus: '4' pp: '1' precision: fp8 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__16 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H200_NVLx2 FP8 Latency ngcMetadata: cf5787bfa25e0f21603c8aa6458d2ae062691d0fa81e684dc219082ba39fb1d9: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 552ad035a0898be37be03c9d539efbda5a7d2f214b2c5950e14bb694ad8329a9 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__17 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx2 NVFP4 Throughput ngcMetadata: d650534ce98fea4bfc9924d77c91fbd8dca227321c35557e924297ab6b9008cb: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 19aeb73125023f25e273ed14ccc69b935b2ce5131d4d91d1b78f3e8bdc0366b7 number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:gb200x4-latency-bf16-vuvdg5jkzq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct GB200x4 BF16 Latency ngcMetadata: d7ff5f88620f7fbe0538931af334663b43d15cb2c969e7fc96375ac60108906f: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: be07050242f7ce67689c0d81de40bb1de6967dd251a881bcb784193fb92d8183 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 4 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x2-throughput-bf16-omzr8lu67g framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x2 BF16 Throughput ngcMetadata: e0ac049ec460cc8dfe59feaec6d12ae55807dac2b0bd62396c36679f2674e330: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6d1452af26f860b53df112c90f6b92f22a41156c09dafa2582c2c1194e56a673 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__18 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100_NVLx2 FP8 Throughput ngcMetadata: e518c22e6d4135300fc5c10bd0c4d195c51ac596e8950172e303bcce84794732: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3035d73242fb579040fb3f341adc36a7073f780419e73dd97edb7ce35cb0f550 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:l40sx4-latency-bf16-rasfmhw4uw framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct L40Sx4 BF16 Latency ngcMetadata: e6d1855d3f24e439b904cf1fd47d3e136bec4af9134c039558c61f9ae34593af: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 8747b7e093d3b26e808e8bbebdb50c3ac0a0f82402c58b3430a8760ff96e406e number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__19 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx4 FP8 Latency ngcMetadata: ee0b992fafa65ffe00e8df84f80f9e417a400ec40b60b6769db81498482610d7: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3140e28251686b824ea3fd4d45a86cef01b156d1737ada0b6783b612ac3b6e92 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__20 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100_NVLx4 BF16 Latency ngcMetadata: efcb2762954af78c9b84774917daf706fd8d663df3d54c298a1fb9d2fb86a119: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3d2f50e0423aa98250617f6a0dad719bed6892994a47c60e092ce494d93e9bce number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:b200x1-throughput-fp8-xk4doibibg framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct B200x1 FP8 Throughput ngcMetadata: f215c1f1608a7818f6c465646f8f8cb412a58b39c99e4a15857466fb9a970aef: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6979353282e6f8421f9ffd76c33eb1e675f796fc7ed036c6038b99a21d649f18 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__21 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct RTX6000_BLACKWELL_SVx4 NVFP4 Latency ngcMetadata: f9c5befd972751383a8dfa7b38fb77fd4c69af4e015136f0a194b7db0176ce59: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4f697999cecdc5afc7ff8f588b71a5b7683117aa866f34ab76886db2dbe86dcc number_of_gpus: '4' pp: '1' precision: nvfp4 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:h100x4-throughput-bf16-bpwvcpvnsq framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100x4 BF16 Throughput ngcMetadata: fbec99d055ebc70d1261d9520f1f6f854fb0a84771bdadde30668dca1f081c7d: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2eb1d578e4e069c384bf617e5354889d043a1c72b77f432c07e06ffb1b8be36b number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 139GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.3-70b-instruct:6f6073b423013f6a7d4d9f39144961bfbfbc386b__22 framework: TensorRT-LLM displayName: Llama 3.3 70B Instruct H100_NVLx4 FP8 Latency ngcMetadata: ff1a26a9837e3e3122a70f91d46181b15f22ba8276c47b0d852cabde8a6a5460: model: meta/llama-3.3-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9b6105c7bf6521bd8eb6fa1badcd239636f35c06317166bf78d58a8cc239411f number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM labels: - Llama - Meta - Chat - Text Generation - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Llama 3.3 Nemotron Super 49B displayName: Llama 3.3 Nemotron Super 49B modelHubID: llama-3.3-nemotron-super-49b category: Language type: NGC description: Llama-3.3-Nemotron-Super-49B v1 and v1.5 are language models that can follow instructions, complete requests, and generate creative text formats. The Llama-3.3-Nemotron-Super-49B v1 series of Large Language Models (LLMs) are instruction-tuned versions of the Llama-Nemotron. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Llama 3.3 Nemotron Super 49B V1 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifEZpZWxkOnxSZXNwb25zZTp8XG58Oi0tLTp8Oi0tLTp8XG58UGFydGljaXBhdGlvbiBjb25zaWRlcmF0aW9ucyBmcm9tIGFkdmVyc2VseSBpbXBhY3RlZCBncm91cHMgKHByb3RlY3RlZCBjbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3Rpbmc6fE5vbmV8XG58TWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzOnxOb25lfCIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjUtMDMtMTZUMjI6MjU6MDguNjE5WiIsCiAgICAiZGVzY3JpcHRpb24iOiAiIyBMbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxXG5cblxuIyMgTW9kZWwgT3ZlcnZpZXcgXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEgaXMgYSBsYXJnZSBsYW5ndWFnZSBtb2RlbCAoTExNKSB3aGljaCBpcyBhIGRlcml2YXRpdmUgb2YgTWV0YSBMbGFtYS0zLjMtNzBCLUluc3RydWN0IChBS0EgdGhlIHJlZmVyZW5jZSBtb2RlbCkuIEl0IGlzIGEgcmVhc29uaW5nIG1vZGVsIHRoYXQgaXMgcG9zdCB0cmFpbmVkIGZvciByZWFzb25pbmcsIGh1bWFuIGNoYXQgcHJlZmVyZW5jZXMsIGFuZCB0YXNrcywgc3VjaCBhcyBSQUcgYW5kIHRvb2wgY2FsbGluZy4gVGhlIG1vZGVsIHN1cHBvcnRzIGEgY29udGV4dCBsZW5ndGggb2YgMTI4SyB0b2tlbnMuXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEgaXMgYSBtb2RlbCB3aGljaCBvZmZlcnMgYSBncmVhdCB0cmFkZW9mZiBiZXR3ZWVuIG1vZGVsIGFjY3VyYWN5IGFuZCBlZmZpY2llbmN5LiBFZmZpY2llbmN5ICh0aHJvdWdocHV0KSBkaXJlY3RseSB0cmFuc2xhdGVzIHRvIHNhdmluZ3MuIFVzaW5nIGEgbm92ZWwgTmV1cmFsIEFyY2hpdGVjdHVyZSBTZWFyY2ggKE5BUykgYXBwcm9hY2gsIHdlIGdyZWF0bHkgcmVkdWNlIHRoZSBtb2RlbFx1MjAxOXMgbWVtb3J5IGZvb3RwcmludCwgZW5hYmxpbmcgbGFyZ2VyIHdvcmtsb2FkcywgYXMgd2VsbCBhcyBmaXR0aW5nIHRoZSBtb2RlbCBvbiBhIHNpbmdsZSBHUFUgYXQgaGlnaCB3b3JrbG9hZHMgKEgyMDApLiBUaGlzIE5BUyBhcHByb2FjaCBlbmFibGVzIHRoZSBzZWxlY3Rpb24gb2YgYSBkZXNpcmVkIHBvaW50IGluIHRoZSBhY2N1cmFjeS1lZmZpY2llbmN5IHRyYWRlb2ZmLlxuXG5UaGUgbW9kZWwgdW5kZXJ3ZW50IGEgbXVsdGktcGhhc2UgcG9zdC10cmFpbmluZyBwcm9jZXNzIHRvIGVuaGFuY2UgYm90aCBpdHMgcmVhc29uaW5nIGFuZCBub24tcmVhc29uaW5nIGNhcGFiaWxpdGllcy4gVGhpcyBpbmNsdWRlcyBhIHN1cGVydmlzZWQgZmluZS10dW5pbmcgc3RhZ2UgZm9yIE1hdGgsIENvZGUsIFJlYXNvbmluZywgYW5kIFRvb2wgQ2FsbGluZyBhcyB3ZWxsIGFzIG11bHRpcGxlIHJlaW5mb3JjZW1lbnQgbGVhcm5pbmcgKFJMKSBzdGFnZXMgdXNpbmcgUkVJTkZPUkNFIChSTE9PKSBhbmQgT25saW5lIFJld2FyZC1hd2FyZSBQcmVmZXJlbmNlIE9wdGltaXphdGlvbiAoUlBPKSBhbGdvcml0aG1zIGZvciBib3RoIGNoYXQgYW5kIGluc3RydWN0aW9uLWZvbGxvd2luZy4gVGhlIGZpbmFsIG1vZGVsIGNoZWNrcG9pbnQgaXMgb2J0YWluZWQgYWZ0ZXIgbWVyZ2luZyB0aGUgZmluYWwgU0ZUIGFuZCBPbmxpbmUgUlBPIGNoZWNrcG9pbnRzLiBGb3IgbW9yZSBkZXRhaWxzIG9uIGhvdyB0aGUgbW9kZWwgd2FzIHRyYWluZWQsIHBsZWFzZSBzZWUgW3RoaXMgYmxvZ10oaHR0cHM6Ly9kZXZlbG9wZXIubnZpZGlhLmNvbS9ibG9nL2J1aWxkLWVudGVycHJpc2UtYWktYWdlbnRzLXdpdGgtYWR2YW5jZWQtb3Blbi1udmlkaWEtbGxhbWEtbmVtb3Ryb24tcmVhc29uaW5nLW1vZGVscy8pLlxuXG4hW0FyY2hpdGVjdHVyZSBEaWFncmFtXShodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9sbGFtYS0zXzMtbmVtb3Ryb24tc3VwZXItNDliLXYxL2RpYWdyYW0uanBnKVxuXG5UaGlzIG1vZGVsIGlzIHBhcnQgb2YgdGhlIExsYW1hIE5lbW90cm9uIENvbGxlY3Rpb24uIFlvdSBjYW4gZmluZCB0aGUgb3RoZXIgbW9kZWwocykgaW4gdGhpcyBmYW1pbHkgaGVyZTogXG5bTGxhbWEtM18xLU5lbW90cm9uLU5hbm8tOEItdjFdKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9udmlkaWEvbGxhbWEtM18xLW5lbW90cm9uLW5hbm8tOGItdjEpXG5cblRoaXMgbW9kZWwgaXMgcmVhZHkgZm9yIGNvbW1lcmNpYWwgdXNlLiBcblxuIyMgTGljZW5zZS9UZXJtcyBvZiBVc2VcblxuR09WRVJOSU5HIFRFUk1TOiBZb3VyIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIE9wZW4gTW9kZWwgTGljZW5zZS5dKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1vcGVuLW1vZGVsLWxpY2Vuc2UvKSBBZGRpdGlvbmFsIEluZm9ybWF0aW9uOiBbTGxhbWEgMy4zIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18zL2xpY2Vuc2UvKS4gQnVpbHQgd2l0aCBMbGFtYS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuKipNb2RlbCBEZXZlbG9wZXI6KiogTlZJRElBXG5cbioqTW9kZWwgRGF0ZXM6KiogVHJhaW5lZCBiZXR3ZWVuIE5vdmVtYmVyIDIwMjQgYW5kIEZlYnJ1YXJ5IDIwMjVcblxuKipEYXRhIEZyZXNobmVzczoqKiAgVGhlIHByZXRyYWluaW5nIGRhdGEgaGFzIGEgY3V0b2ZmIG9mIDIwMjMgcGVyIE1ldGEgTGxhbWEgMy4zIDcwQlxuXG4jIyMgVXNlIENhc2U6IDxicj5cbkRldmVsb3BlcnMgZGVzaWduaW5nIEFJIEFnZW50IHN5c3RlbXMsIGNoYXRib3RzLCBSQUcgc3lzdGVtcywgYW5kIG90aGVyIEFJLXBvd2VyZWQgYXBwbGljYXRpb25zLiBBbHNvIHN1aXRhYmxlIGZvciB0eXBpY2FsIGluc3RydWN0aW9uLWZvbGxvd2luZyB0YXNrcy4gPGJyPlxuXG4jIyMgUmVsZWFzZSBEYXRlOiAgPGJyPlxuMy8xOC8yMDI1IDxicj5cblxuIyMgUmVmZXJlbmNlc1xuKiBbMjUwMi4wMDIwM10gW1Jld2FyZC1hd2FyZSBQcmVmZXJlbmNlIE9wdGltaXphdGlvbjogQSBVbmlmaWVkIE1hdGhlbWF0aWNhbCBGcmFtZXdvcmsgZm9yIE1vZGVsIEFsaWdubWVudF0oaHR0cHM6Ly9hcnhpdi5vcmcvYWJzLzI1MDIuMDAyMDMpXG5cbiMjIE1vZGVsIEFyY2hpdGVjdHVyZVxuKipBcmNoaXRlY3R1cmUgVHlwZToqKiBEZW5zZSBkZWNvZGVyLW9ubHkgVHJhbnNmb3JtZXIgbW9kZWwgIFxuKipOZXR3b3JrIEFyY2hpdGVjdHVyZToqKiBMbGFtYSAzLjMgNzBCIEluc3RydWN0LCBjdXN0b21pemVkIHRocm91Z2ggTmV1cmFsIEFyY2hpdGVjdHVyZSBTZWFyY2ggKE5BUylcblxuVGhlIG1vZGVsIGlzIGEgZGVyaXZhdGl2ZSBvZiBNZXRhXHUyMDE5cyBMbGFtYS0zLjMtNzBCLUluc3RydWN0LCB1c2luZyBOZXVyYWwgQXJjaGl0ZWN0dXJlIFNlYXJjaCAoTkFTKS4gVGhlIE5BUyBhbGdvcml0aG0gcmVzdWx0cyBpbiBub24tc3RhbmRhcmQgYW5kIG5vbi1yZXBldGl0aXZlIGJsb2Nrcy4gVGhpcyBpbmNsdWRlcyB0aGUgZm9sbG93aW5nOiBcblNraXAgYXR0ZW50aW9uOiBJbiBzb21lIGJsb2NrcywgdGhlIGF0dGVudGlvbiBpcyBza2lwcGVkIGVudGlyZWx5LCBvciByZXBsYWNlZCB3aXRoIGEgc2luZ2xlIGxpbmVhciBsYXllci5cblZhcmlhYmxlIEZGTjogVGhlIGV4cGFuc2lvbi9jb21wcmVzc2lvbiByYXRpbyBpbiB0aGUgRkZOIGxheWVyIGlzIGRpZmZlcmVudCBiZXR3ZWVuIGJsb2Nrcy4gXG5cbldlIHV0aWxpemUgYSBibG9jay13aXNlIGRpc3RpbGxhdGlvbiBvZiB0aGUgcmVmZXJlbmNlIG1vZGVsLCB3aGVyZSBmb3IgZWFjaCBibG9jayB3ZSBjcmVhdGUgbXVsdGlwbGUgdmFyaWFudHMgcHJvdmlkaW5nIGRpZmZlcmVudCB0cmFkZW9mZnMgb2YgcXVhbGl0eSB2cy4gY29tcHV0YXRpb25hbCBjb21wbGV4aXR5LCBkaXNjdXNzZWQgaW4gbW9yZSBkZXB0aCBiZWxvdy4gV2UgdGhlbiBzZWFyY2ggb3ZlciB0aGUgYmxvY2tzIHRvIGNyZWF0ZSBhIG1vZGVsIHdoaWNoIG1lZXRzIHRoZSByZXF1aXJlZCB0aHJvdWdocHV0IGFuZCBtZW1vcnkgKG9wdGltaXplZCBmb3IgYSBzaW5nbGUgSDEwMC04MEdCIEdQVSkgd2hpbGUgbWluaW1pemluZyB0aGUgcXVhbGl0eSBkZWdyYWRhdGlvbi4gVGhlIG1vZGVsIHRoZW4gdW5kZXJnb2VzIGtub3dsZWRnZSBkaXN0aWxsYXRpb24gKEtEKSwgd2l0aCBhIGZvY3VzIG9uIEVuZ2xpc2ggc2luZ2xlIGFuZCBtdWx0aS10dXJuIGNoYXQgdXNlLWNhc2VzLiBUaGUgS0Qgc3RlcCBpbmNsdWRlZCA0MCBiaWxsaW9uIHRva2VucyBjb25zaXN0aW5nIG9mIGEgbWl4dHVyZSBvZiAzIGRhdGFzZXRzIC0gRmluZVdlYiwgQnV6ei1WMS4yIGFuZCBEb2xtYS5cblxuIyMgSW50ZW5kZWQgdXNlXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEgaXMgYSBnZW5lcmFsIHB1cnBvc2UgcmVhc29uaW5nIGFuZCBjaGF0IG1vZGVsIGludGVuZGVkIHRvIGJlIHVzZWQgaW4gRW5nbGlzaCBhbmQgY29kaW5nIGxhbmd1YWdlcy4gT3RoZXIgbm9uLUVuZ2xpc2ggbGFuZ3VhZ2VzIChHZXJtYW4sIEZyZW5jaCwgSXRhbGlhbiwgUG9ydHVndWVzZSwgSGluZGksIFNwYW5pc2gsIGFuZCBUaGFpKSBhcmUgYWxzbyBzdXBwb3J0ZWQuIFxuXG4jIyBJbnB1dFxuLSAqKklucHV0IFR5cGU6KiogVGV4dFxuLSAqKklucHV0IEZvcm1hdDoqKiBTdHJpbmdcbi0gKipJbnB1dCBQYXJhbWV0ZXJzOioqIE9uZS1EaW1lbnNpb25hbCAoMUQpXG4tICoqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OioqIENvbnRleHQgbGVuZ3RoIHVwIHRvIDEzMSwwNzIgdG9rZW5zXG5cbiMjIE91dHB1dFxuLSAqKk91dHB1dCBUeXBlOioqIFRleHRcbi0gKipPdXRwdXQgRm9ybWF0OioqIFN0cmluZ1xuLSAqKk91dHB1dCBQYXJhbWV0ZXJzOioqIE9uZS1EaW1lbnNpb25hbCAoMUQpXG4tICoqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDoqKiBDb250ZXh0IGxlbmd0aCB1cCB0byAxMzEsMDcyIHRva2Vuc1xuXG4jIyBNb2RlbCBWZXJzaW9uXG4xLjAgKDMvMTgvMjAyNSlcblxuIyMgU29mdHdhcmUgSW50ZWdyYXRpb25cbi0gKipSdW50aW1lIEVuZ2luZToqKiBUcmFuc2Zvcm1lcnNcbi0gKipSZWNvbW1lbmRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OioqIFxuICAgLSBOVklESUEgSG9wcGVyXG4gICAtIE5WSURJQSBBbXBlcmVcblxuIyMgUXVpY2sgU3RhcnQgYW5kIFVzYWdlIFJlY29tbWVuZGF0aW9uczpcblxuMS4gUmVhc29uaW5nIG1vZGUgKE9OL09GRikgaXMgY29udHJvbGxlZCB2aWEgdGhlIHN5c3RlbSBwcm9tcHQsIHdoaWNoIG11c3QgYmUgc2V0IGFzIHNob3duIGluIHRoZSBleGFtcGxlIGJlbG93LiBBbGwgaW5zdHJ1Y3Rpb25zIHNob3VsZCBiZSBjb250YWluZWQgd2l0aGluIHRoZSB1c2VyIHByb21wdFxuMi4gV2UgcmVjb21tZW5kIHNldHRpbmcgdGVtcGVyYXR1cmUgdG8gYDAuNmAsIGFuZCBUb3AgUCB0byBgMC45NWAgZm9yIFJlYXNvbmluZyBPTiBtb2RlXG4zLiBXZSByZWNvbW1lbmQgdXNpbmcgZ3JlZWR5IGRlY29kaW5nIGZvciBSZWFzb25pbmcgT0ZGIG1vZGVcbjQuIFdlIGhhdmUgcHJvdmlkZWQgYSBsaXN0IG9mIHByb21wdHMgdG8gdXNlIGZvciBldmFsdWF0aW9uIGZvciBlYWNoIGJlbmNobWFyayB3aGVyZSBhIHNwZWNpZmljIHRlbXBsYXRlIGlzIHJlcXVpcmVkXG5cbllvdSBjYW4gdHJ5IHRoaXMgbW9kZWwgb3V0IHRocm91Z2ggdGhlIHByZXZpZXcgQVBJLCB1c2luZyB0aGlzIGxpbms6IFtMbGFtYS0zXzMtTmVtb3Ryb24tU3VwZXItNDlCLXYxXShodHRwczovL2J1aWxkLm52aWRpYS5jb20vbnZpZGlhL2xsYW1hLTNfMy1uZW1vdHJvbi1zdXBlci00OWItdjEpLlxuXG4jIyBJbmZlcmVuY2U6XG4qKkVuZ2luZToqKlxuVHJhbnNmb3JtZXJzICBcbioqVGVzdCBIYXJkd2FyZToqKlxuLSBGUDg6IDF4IE5WSURJQSBIMTAwLTgwR0IgR1BVIChDb21pbmcgU29vbilcbi0gQkYxNjogXG4gICAtIDJ4IE5WSURJQSBIMTAwLTgwR0IgR1BVc1xuICAgLSAyeCBOVklESUEgQTEwMC04MEdCIEdQVXNcbiAgICAgIFxuKipbUHJlZmVycmVkL1N1cHBvcnRlZF0gT3BlcmF0aW5nIFN5c3RlbShzKToqKiBMaW51eCA8YnI+XG5cbiMjIFRyYWluaW5nIERhdGFzZXRzXG5cbkEgbGFyZ2UgdmFyaWV0eSBvZiB0cmFpbmluZyBkYXRhIHdhcyB1c2VkIGZvciB0aGUga25vd2xlZGdlIGRpc3RpbGxhdGlvbiBwaGFzZSBiZWZvcmUgcG9zdC10cmFpbmluZyBwaXBlbGluZSwgMyBvZiB3aGljaCBpbmNsdWRlZDogRmluZVdlYiwgQnV6ei1WMS4yLCBhbmQgRG9sbWEuXG5cblRoZSBkYXRhIGZvciB0aGUgbXVsdGktc3RhZ2UgcG9zdC10cmFpbmluZyBwaGFzZXMgZm9yIGltcHJvdmVtZW50cyBpbiBDb2RlLCBNYXRoLCBhbmQgUmVhc29uaW5nIGlzIGEgY29tcGlsYXRpb24gb2YgU0ZUIGFuZCBSTCBkYXRhIHRoYXQgc3VwcG9ydHMgaW1wcm92ZW1lbnRzIG9mIG1hdGgsIGNvZGUsIGdlbmVyYWwgcmVhc29uaW5nLCBhbmQgaW5zdHJ1Y3Rpb24gZm9sbG93aW5nIGNhcGFiaWxpdGllcyBvZiB0aGUgb3JpZ2luYWwgTGxhbWEgaW5zdHJ1Y3QgbW9kZWwuIFxuXG5JbiBjb25qdW5jdGlvbiB3aXRoIHRoaXMgbW9kZWwgcmVsZWFzZSwgTlZJRElBIGhhcyByZWxlYXNlZCAzME0gc2FtcGxlcyBvZiBwb3N0LXRyYWluaW5nIGRhdGEsIGFzIHB1YmxpYyBhbmQgcGVybWlzc2l2ZS4gW0xsYW1hLU5lbW90cm9uLVBvc3QtVHJhaW5pbmctRGF0YXNldC12MV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9udmlkaWEvTGxhbWEtTmVtb3Ryb24tUG9zdC1UcmFpbmluZy1EYXRhc2V0LXYxKVxuXG5EaXN0cmlidXRpb24gb2YgdGhlIGRvbWFpbnMgaXMgYXMgZm9sbG93czpcblxufCBDYXRlZ29yeSB8IFZhbHVlICAgICB8XG58LS0tLS0tLS0tLXwtLS0tLS0tLS0tLXxcbnwgbWF0aCAgICAgfCAxOSw4NDAsOTcwfFxufCBjb2RlICAgICB8IDksNjEyLDY3NyB8XG58IHNjaWVuY2UgICAgIHwgNzA4LDkyMCAgICB8XG58IGluc3RydWN0aW9uIGZvbGxvd2luZyAgICAgICB8IDU2LDMzOSAgICB8XG58IGNoYXQgICAgIHwgMzksNzkyICAgIHxcbnwgc2FmZXR5ICAgfCAzMSw0MjYgICAgfFxuXG5Qcm9tcHRzIGhhdmUgYmVlbiBzb3VyY2VkIGZyb20gZWl0aGVyIHB1YmxpYyBhbmQgb3BlbiBjb3JwdXMgb3Igc3ludGhldGljYWxseSBnZW5lcmF0ZWQuIFJlc3BvbnNlcyB3ZXJlIHN5bnRoZXRpY2FsbHkgZ2VuZXJhdGVkIGJ5IGEgdmFyaWV0eSBvZiBtb2RlbHMsIHdpdGggc29tZSBwcm9tcHRzIGNvbnRhaW5pbmcgcmVzcG9uc2VzIGZvciBib3RoIHJlYXNvbmluZyBvbiBhbmQgb2ZmIG1vZGVzLCB0byB0cmFpbiB0aGUgbW9kZWwgdG8gZGlzdGluZ3Vpc2ggYmV0d2VlbiB0d28gbW9kZXMuIFxuXG5Nb2RlbHMgdGhhdCB3ZXJlIHVzZWQgaW4gdGhlIGNyZWF0aW9uIG9mIHRoaXMgZGF0YXNldDpcbi0gTGxhbWEtMy4zLTcwQi1JbnN0cnVjdFxuLSBMbGFtYS0zLjEtTmVtb3Ryb24tNzBCLUluc3RydWN0XG4tIExsYW1hLTMuMy1OZW1vdHJvbi03MEItRmVlZGJhY2svRWRpdC9TZWxlY3Rcbi0gTWl4dHJhbC04eDIyQi1JbnN0cnVjdC12MC4xXG4tIERlZXBTZWVrLVIxXG4tIFF3ZW4tMi41LU1hdGgtN0ItSW5zdHJ1Y3Rcbi0gUXdlbi0yLjUtQ29kZXItMzJCLUluc3RydWN0XG4tIFF3ZW4tMi41LTcyQi1JbnN0cnVjdFxuLSBRd2VuLTIuNS0zMkItSW5zdHJ1Y3RcblxuKipEYXRhIENvbGxlY3Rpb24gZm9yIFRyYWluaW5nIERhdGFzZXRzOioqXG5IeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG4qKkRhdGEgTGFiZWxpbmcgZm9yIFRyYWluaW5nIERhdGFzZXRzOioqXG5IeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG4jIyBFdmFsdWF0aW9uIERhdGFzZXRzIFxuXG5XZSB1c2VkIHRoZSBkYXRhc2V0cyBsaXN0ZWQgYmVsb3cgdG8gZXZhbHVhdGUgTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MS4gXG5cbioqRGF0YSBDb2xsZWN0aW9uIGZvciBFdmFsdWF0aW9uIERhdGFzZXRzOioqXG5IeWJyaWQ6IEh1bWFuL1N5bnRoZXRpY1xuXG4qKkRhdGEgTGFiZWxpbmcgZm9yIEV2YWx1YXRpb24gRGF0YXNldHM6Kipcbkh5YnJpZDogSHVtYW4vU3ludGhldGljL0F1dG9tYXRpY1xuXG4jIyBFdmFsdWF0aW9uIFJlc3VsdHNcblRoZXNlIHJlc3VsdHMgY29udGFpbiBib3RoIFJlYXNvbmluZyBPbiwgYW5kIFJlYXNvbmluZyBPZmYuIFdlIHJlY29tbWVuZCB1c2luZyB0ZW1wZXJhdHVyZT1gMC42YCwgdG9wX3A9YDAuOTVgIGZvciBSZWFzb25pbmcgT24gbW9kZSwgYW5kIGdyZWVkeSBkZWNvZGluZyBmb3IgUmVhc29uaW5nIE9mZiBtb2RlLiBBbGwgZXZhbHVhdGlvbnMgYXJlIGRvbmUgd2l0aCAzMmsgc2VxdWVuY2UgbGVuZ3RoLiBXZSBydW4gdGhlIGJlbmNobWFya3MgdXAgdG8gMTYgdGltZXMgYW5kIGF2ZXJhZ2UgdGhlIHNjb3JlcyB0byBiZSBtb3JlIGFjY3VyYXRlLlxuXG4+IE5PVEU6IFdoZXJlIGFwcGxpY2FibGUsIGEgUHJvbXB0IFRlbXBsYXRlIHdpbGwgYmUgcHJvdmlkZWQuIFdoaWxlIGNvbXBsZXRpbmcgYmVuY2htYXJrcywgcGxlYXNlIGVuc3VyZSB0aGF0IHlvdSBhcmUgcGFyc2luZyBmb3IgdGhlIGNvcnJlY3Qgb3V0cHV0IGZvcm1hdCBhcyBwZXIgdGhlIHByb3ZpZGVkIHByb21wdCBpbiBvcmRlciB0byByZXByb2R1Y2UgdGhlIGJlbmNobWFya3Mgc2VlbiBiZWxvdy4gXG5cbiMjIyBBcmVuYS1IYXJkXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTY29yZSB8XG58LS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgODguMyB8IFxuXG5cbiMjIyBNQVRINTAwXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBwYXNzQDEgfFxufC0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLXxcbnwgUmVhc29uaW5nIE9mZiB8IDc0LjAgfCBcbnwgUmVhc29uaW5nIE9uIHwgOTYuNiAgfFxuXG5Vc2VyIFByb21wdCBUZW1wbGF0ZTogXG5gYGBcblwiQmVsb3cgaXMgYSBtYXRoIHF1ZXN0aW9uLiBJIHdhbnQgeW91IHRvIHJlYXNvbiB0aHJvdWdoIHRoZSBzdGVwcyBhbmQgdGhlbiBnaXZlIGEgZmluYWwgYW5zd2VyLiBZb3VyIGZpbmFsIGFuc3dlciBzaG91bGQgYmUgaW4gXFxib3hlZHt9LlxcblF1ZXN0aW9uOiB7cXVlc3Rpb259XCJcbmBgYFxuXG4jIyMgQUlNRTI1XG5cbnwgUmVhc29uaW5nIE1vZGUgfCBwYXNzQDEgfFxufC0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLXxcbnwgUmVhc29uaW5nIE9mZiB8IDEzLjMzIHwgXG58IFJlYXNvbmluZyBPbiB8IDU4LjQgfFxuXG5Vc2VyIFByb21wdCBUZW1wbGF0ZTogXG5gYGBcblwiQmVsb3cgaXMgYSBtYXRoIHF1ZXN0aW9uLiBJIHdhbnQgeW91IHRvIHJlYXNvbiB0aHJvdWdoIHRoZSBzdGVwcyBhbmQgdGhlbiBnaXZlIGEgZmluYWwgYW5zd2VyLiBZb3VyIGZpbmFsIGFuc3dlciBzaG91bGQgYmUgaW4gXFxib3hlZHt9LlxcblF1ZXN0aW9uOiB7cXVlc3Rpb259XCJcbmBgYFxuXG4jIyMgR1BRQVxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCA1MCB8IFxufCBSZWFzb25pbmcgT24gfCA2Ni42NyB8XG5cblVzZXIgUHJvbXB0IFRlbXBsYXRlOiBcbmBgYFxuXCJXaGF0IGlzIHRoZSBjb3JyZWN0IGFuc3dlciB0byB0aGlzIHF1ZXN0aW9uOiB7cXVlc3Rpb259XFxuQ2hvaWNlczpcXG5BLiB7b3B0aW9uX0F9XFxuQi4ge29wdGlvbl9CfVxcbkMuIHtvcHRpb25fQ31cXG5ELiB7b3B0aW9uX0R9XFxuTGV0J3MgdGhpbmsgc3RlcCBieSBzdGVwLCBhbmQgcHV0IHRoZSBmaW5hbCBhbnN3ZXIgKHNob3VsZCBiZSBhIHNpbmdsZSBsZXR0ZXIgQSwgQiwgQywgb3IgRCkgaW50byBhIFxcYm94ZWR7fVwiXG5gYGBcblxuIyMjIElGRXZhbFxuXG58IFJlYXNvbmluZyBNb2RlIHwgU3RyaWN0Okluc3RydWN0aW9uIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCA4OS4yMSB8IFxuXG4jIyMgQkZDTCBWMiBMaXZlXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTY29yZSB8XG58LS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgNzMuNyB8IFxuXG5Vc2VyIFByb21wdCBUZW1wbGF0ZTpcbmBgYFxuWW91IGFyZSBhbiBleHBlcnQgaW4gY29tcG9zaW5nIGZ1bmN0aW9ucy4gWW91IGFyZSBnaXZlbiBhIHF1ZXN0aW9uIGFuZCBhIHNldCBvZiBwb3NzaWJsZSBmdW5jdGlvbnMuIFxuQmFzZWQgb24gdGhlIHF1ZXN0aW9uLCB5b3Ugd2lsbCBuZWVkIHRvIG1ha2Ugb25lIG9yIG1vcmUgZnVuY3Rpb24vdG9vbCBjYWxscyB0byBhY2hpZXZlIHRoZSBwdXJwb3NlLiBcbklmIG5vbmUgb2YgdGhlIGZ1bmN0aW9uIGNhbiBiZSB1c2VkLCBwb2ludCBpdCBvdXQuIElmIHRoZSBnaXZlbiBxdWVzdGlvbiBsYWNrcyB0aGUgcGFyYW1ldGVycyByZXF1aXJlZCBieSB0aGUgZnVuY3Rpb24sXG5hbHNvIHBvaW50IGl0IG91dC4gWW91IHNob3VsZCBvbmx5IHJldHVybiB0aGUgZnVuY3Rpb24gY2FsbCBpbiB0b29scyBjYWxsIHNlY3Rpb25zLlxuXG5JZiB5b3UgZGVjaWRlIHRvIGludm9rZSBhbnkgb2YgdGhlIGZ1bmN0aW9uKHMpLCB5b3UgTVVTVCBwdXQgaXQgaW4gdGhlIGZvcm1hdCBvZiA8VE9PTENBTEw+W2Z1bmNfbmFtZTEocGFyYW1zX25hbWUxPXBhcmFtc192YWx1ZTEsIHBhcmFtc19uYW1lMj1wYXJhbXNfdmFsdWUyLi4uKSwgZnVuY19uYW1lMihwYXJhbXMpXTwvVE9PTENBTEw+XG5cbllvdSBTSE9VTEQgTk9UIGluY2x1ZGUgYW55IG90aGVyIHRleHQgaW4gdGhlIHJlc3BvbnNlLlxuSGVyZSBpcyBhIGxpc3Qgb2YgZnVuY3Rpb25zIGluIEpTT04gZm9ybWF0IHRoYXQgeW91IGNhbiBpbnZva2UuXG5cbjxBVkFJTEFCTEVfVE9PTFM+e2Z1bmN0aW9uc308L0FWQUlMQUJMRV9UT09MUz5cblxue3VzZXJfcHJvbXB0fVxuYGBgXG5cbiMjIyBNQlBQIDAtc2hvdFxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCA4NC45fCBcbnwgUmVhc29uaW5nIE9uIHwgOTEuMyB8XG5cblVzZXIgUHJvbXB0IFRlbXBsYXRlOlxuYGBgYFxuWW91IGFyZSBhbiBleGNlcHRpb25hbGx5IGludGVsbGlnZW50IGNvZGluZyBhc3Npc3RhbnQgdGhhdCBjb25zaXN0ZW50bHkgZGVsaXZlcnMgYWNjdXJhdGUgYW5kIHJlbGlhYmxlIHJlc3BvbnNlcyB0byB1c2VyIGluc3RydWN0aW9ucy5cblxuQEAgSW5zdHJ1Y3Rpb25cbkhlcmUgaXMgdGhlIGdpdmVuIHByb2JsZW0gYW5kIHRlc3QgZXhhbXBsZXM6XG57cHJvbXB0fVxuUGxlYXNlIHVzZSB0aGUgcHl0aG9uIHByb2dyYW1taW5nIGxhbmd1YWdlIHRvIHNvbHZlIHRoaXMgcHJvYmxlbS5cblBsZWFzZSBtYWtlIHN1cmUgdGhhdCB5b3VyIGNvZGUgaW5jbHVkZXMgdGhlIGZ1bmN0aW9ucyBmcm9tIHRoZSB0ZXN0IHNhbXBsZXMgYW5kIHRoYXQgdGhlIGlucHV0IGFuZCBvdXRwdXQgZm9ybWF0cyBvZiB0aGVzZSBmdW5jdGlvbnMgbWF0Y2ggdGhlIHRlc3Qgc2FtcGxlcy5cblBsZWFzZSByZXR1cm4gYWxsIGNvbXBsZXRlZCBjb2RlcyBpbiBvbmUgY29kZSBibG9jay5cblRoaXMgY29kZSBibG9jayBzaG91bGQgYmUgaW4gdGhlIGZvbGxvd2luZyBmb3JtYXQ6XG5gYGBweXRob25cbiMgWW91ciBjb2RlcyBoZXJlXG5gYGBcbmBgYGBcblxuIyMjIE1ULUJlbmNoXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTY29yZSB8XG58LS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgOS4xNyB8XG5cbiMjIEV0aGljYWwgQ29uc2lkZXJhdGlvbnM6XG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gXG5cbkZvciBtb3JlIGRldGFpbGVkIGluZm9ybWF0aW9uIG9uIGV0aGljYWwgY29uc2lkZXJhdGlvbnMgZm9yIHRoaXMgbW9kZWwsIHBsZWFzZSBzZWUgdGhlIE1vZGVsIENhcmQrKyBFeHBsYWluYWJpbGl0eSwgQmlhcywgU2FmZXR5ICYgU2VjdXJpdHksIGFuZCBQcml2YWN5IFN1YmNhcmRzLCB3aGljaCB5b3UgY2FuIGZpbmQgYnkgY2xpY2tpbmcgdGhlIFtNb2RlbENhcmQrKyB0YWJdKGh0dHBzOi8vY2F0YWxvZy5uZ2MubnZpZGlhLmNvbS9vcmdzL25pbS90ZWFtcy9udmlkaWEvbW9kZWxzL2xsYW1hLTMuMy1uZW1vdHJvbi1zdXBlci00OWItdjEvYmlhcykgYWJvdmUsIG5leHQgdG8gT3ZlcnZpZXcuXG5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuIiwKICAgICJkaXNwbGF5TmFtZSI6ICJMbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxIiwKICAgICJleHBsYWluYWJpbGl0eSI6ICJ8RmllbGQ6fFJlc3BvbnNlOnxcbnw6LS0tOnw6LS0tOnxcbnxJbnRlbmRlZCBBcHBsaWNhdGlvbihzKSAmIERvbWFpbihzKTp8IFRleHQgZ2VuZXJhdGlvbiwgc3VtbWFyaXphdGlvbiwgcXVlc3Rpb24gYW5zd2VyaW5nLiBGb2N1c2VkIG9uIHVzZXJzIGFuZCBjdXN0b21lcnMgd2hvIHdhbnQgdG8gZ2V0IGdvb2QgYWNjdXJhY3ktZWZmaWNpZW5jeSAocHJpY2UpIHRyYWRlb2ZmLlxufE1vZGVsIFR5cGU6fFRleHQtdG8tdGV4dCB0cmFuc2Zvcm1lcnxcbnxJbnRlbmRlZCBVc2Vyczp8VGhpcyBtb2RlbCBpcyBpbnRlbmRlZCBmb3IgZGV2ZWxvcGVycywgcmVzZWFyY2hlcnMsIGFuZCBjdXN0b21lcnMgYnVpbGRpbmcvdXRpbGl6aW5nIExMTXMsIHdoaWxlIGJhbGFuY2luZyBhY2N1cmFjeSBhbmQgZWZmaWNpZW5jeXxcbnxPdXRwdXQ6fFRleHQgU3RyaW5nKHMpfFxufERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6fEdlbmVyYXRlcyB0ZXh0IGJ5IHByZWRpY3RpbmcgdGhlIG5leHQgd29yZCBvciB0b2tlbiBiYXNlZCBvbiB0aGUgY29udGV4dCBwcm92aWRlZCBpbiB0aGUgaW5wdXQgc2VxdWVuY2UgdXNpbmcgbXVsdGlwbGUgc2VsZi1hdHRlbnRpb24gbGF5ZXJzfFxufFRlY2huaWNhbCBMaW1pdGF0aW9uczpUaGUgTW9kZWwgbWF5IGdlbmVyYXRlIGFuc3dlcnMgdGhhdCBhcmUgaW5hY2N1cmF0ZSwgb21pdCBrZXkgaW5mb3JtYXRpb24sIG9yIGluY2x1ZGUgaXJyZWxldmFudCBvciByZWR1bmRhbnQgdGV4dC4gfFxufFZlcmlmaWVkIHRvIGhhdmUgbWV0IHByZXNjcmliZWQgcXVhbGl0eSBzdGFuZGFyZHM/fFllc3xcbnxQZXJmb3JtYW5jZSBNZXRyaWNzOnxBY2N1cmFjeSwgVGhyb3VnaHB1dCwgYW5kIHVzZXItc2lkZSB0aHJvdWdocHV0fFxufFBvdGVudGlhbCBLbm93biBSaXNrczp8VGhlIG1vZGVsIHdhcyB0cmFpbmVkIG9uIGRhdGEgdGhhdCBjb250YWlucyB0b3hpYyBsYW5ndWFnZSBhbmQgc29jaWV0YWwgYmlhc2VzIG9yaWdpbmFsbHkgY3Jhd2xlZCBmcm9tIHRoZSBpbnRlcm5ldC4gVGhlcmVmb3JlLCB0aGUgbW9kZWwgbWF5IGFtcGxpZnkgdGhvc2UgYmlhc2VzIGFuZCByZXR1cm4gdG94aWMgcmVzcG9uc2VzIGVzcGVjaWFsbHkgd2hlbiBwcm9tcHRlZCB3aXRoIHRveGljIHByb21wdHMuIFRoZSBtb2RlbCBtYXkgZ2VuZXJhdGUgYW5zd2VycyB0aGF0IG1heSBiZSBpbmFjY3VyYXRlLCBvbWl0IGtleSBpbmZvcm1hdGlvbiwgb3IgaW5jbHVkZSBpcnJlbGV2YW50IG9yIHJlZHVuZGFudCB0ZXh0IHByb2R1Y2luZyBzb2NpYWxseSB1bmFjY2VwdGFibGUgb3IgdW5kZXNpcmFibGUgdGV4dCwgZXZlbiBpZiB0aGUgcHJvbXB0IGl0c2VsZiBkb2VzIG5vdCBpbmNsdWRlIGFueXRoaW5nIGV4cGxpY2l0bHkgb2ZmZW5zaXZlLnxcbnxFbmQgVXNlciBMaWNlbnNlIEFncmVlbWVudDp8IFlvdXIgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgT3BlbiBNb2RlbCBMaWNlbnNlLl0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLW9wZW4tbW9kZWwtbGljZW5zZS8pIEFkZGl0aW9uYWwgSW5mb3JtYXRpb246IFtMbGFtYSAzLjMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5sbGFtYS5jb20vbGxhbWEzXzMvbGljZW5zZS8pLiBCdWlsdCB3aXRoIExsYW1hLiIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtQjJQNy1BNk5DIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiaGYtMWEyY2I4MC1uaW0tMDYxMy10b29sLXVzZS12MiIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogOTk3NTIzNjM3MDUsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvbGxhbWEtM18zLW5lbW90cm9uLTQ5Yi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIlNhdmVkTW9kZWwiLAogICAgIm5hbWUiOiAibGxhbWEtMy4zLW5lbW90cm9uLXN1cGVyLTQ5Yi12MSIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJPVEhFUiIsCiAgICAicHJpdmFjeSI6ICJ8RmllbGQ6fFJlc3BvbnNlOnxcbnw6LS0tOnw6LS0tOnxcbnxHZW5lcmF0YWJsZSBvciBSZXZlcnNlIGVuZ2luZWVyYWJsZSBwZXJzb25hbGx5LWlkZW50aWZpYWJsZSBpbmZvcm1hdGlvbj98Tm9uZXxcbnxXYXMgY29uc2VudCBvYnRhaW5lZCBmb3IgYW55IHBlcnNvbmFsIGRhdGEgdXNlZD98Tm9uZSBLbm93bnxcbnxQZXJzb25hbCBkYXRhIHVzZWQgdG8gY3JlYXRlIHRoaXMgbW9kZWw/fE5vbmUgS25vd258XG58SG93IG9mdGVuIGlzIGRhdGFzZXQgcmV2aWV3ZWQ/fEJlZm9yZSBSZWxlYXNlfFxufElzIHRoZXJlIHByb3ZlbmFuY2UgZm9yIGFsbCBkYXRhc2V0cyB1c2VkIGluIHRyYWluaW5nP3xZZXN8XG58RG9lcyBkYXRhIGxhYmVsaW5nIChhbm5vdGF0aW9uLCBtZXRhZGF0YSkgY29tcGx5IHdpdGggcHJpdmFjeSBsYXdzP3xOb3QgQXBwbGljYWJsZXxcbnxJcyBkYXRhIGNvbXBsaWFudCB3aXRoIGRhdGEgc3ViamVjdCByZXF1ZXN0cyBmb3IgZGF0YSBjb3JyZWN0aW9uIG9yIHJlbW92YWwsIGlmIHN1Y2ggYSByZXF1ZXN0IHdhcyBtYWRlP3xOb3QgQXBwbGljYWJsZXxcbnxBcHBsaWNhYmxlIE5WSURJQSBQcml2YWN5IFBvbGljeXxodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2Fib3V0LW52aWRpYS9wcml2YWN5LXBvbGljeS98IiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJOVklESUEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogInxGaWVsZDp8UmVzcG9uc2U6fFxufDotLS06fDotLS06fFxufE1vZGVsIEFwcGxpY2F0aW9uKHMpOnxDaGF0LCBJbnN0cnVjdGlvbiBGb2xsb3dpbmcsIENoYXRib3QgRGV2ZWxvcG1lbnQsIENvZGUgR2VuZXJhdGlvbiwgUmVhc29uaW5nfFxufERlc2NyaWJlIGxpZmUgY3JpdGljYWwgYXBwbGljYXRpb24gKGlmIHByZXNlbnQpOnxOb25lIEtub3dufFxufFVzZSBDYXNlIFJlc3RyaWN0aW9uczp8IEFiaWRlIGJ5IHRoZSBbTlZJRElBIE9wZW4gTW9kZWwgTGljZW5zZS5dKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1vcGVuLW1vZGVsLWxpY2Vuc2UvKSBBZGRpdGlvbmFsIEluZm9ybWF0aW9uOiBbTGxhbWEgMy4zIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18zL2xpY2Vuc2UvKS4gQnVpbHQgd2l0aCBMbGFtYS58XG58TW9kZWwgYW5kIERhdGFzZXQgUmVzdHJpY3Rpb25zOnxUaGUgUHJpbmNpcGxlIG9mIGxlYXN0IHByaXZpbGVnZSAoUG9MUCkgaXMgYXBwbGllZCBsaW1pdGluZyBhY2Nlc3MgZm9yIGRhdGFzZXQgZ2VuZXJhdGlvbi4gIFJlc3RyaWN0aW9ucyBlbmZvcmNlIGRhdGFzZXQgYWNjZXNzIGR1cmluZyB0cmFpbmluZywgYW5kIGRhdGFzZXQgbGljZW5zZSBjb25zdHJhaW50cyBhZGhlcmVkIHRvLiBNb2RlbCBjaGVja3BvaW50cyBhcmUgbWFkZSBhdmFpbGFibGUgb24gSHVnZ2luZyBGYWNlIGFuZCBOR0MsIGFuZCBtYXkgYmVjb21lIGF2YWlsYWJsZSBvbiBjbG91ZCBwcm92aWRlcnMnIG1vZGVsIGNhdGFsb2cufCIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJMbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxIGlzIGEgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgKExMTSkgd2hpY2ggaXMgYSBkZXJpdmF0aXZlIG9mIE1ldGFcdTIwMTlzIExsYW1hLTMuMy03MEItSW5zdHJ1Y3QgKEFLQSB0aGUgcmVmZXJlbmNlIG1vZGVsKS4iLAogICAgInRlYW1OYW1lIjogIm52aWRpYSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0wNy0xNlQxNjo1ODozNC44NDNaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama-3.3-nemotron-super-49b-v1 optimizationProfiles: - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:a100x2-throughput-bf16-ozhgcnodhw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 A100x2 BF16 Throughput ngcMetadata: 0db3b5e8468c9debf30bcf41cbfea084adc59000885efd6fdcb3bbb902651bd6: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h100x2-throughput-bf16-aie7yrqp4q framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100x2 BF16 Throughput ngcMetadata: 1617d074ce252f66e96d5f0e331fa5c6cc0a0330519e56b5c66c60eb7d7bf4f9: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:b200x2-throughput-fp8-hq3hflct5a framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 B200x2 FP8 Throughput ngcMetadata: 26bd84b107a99415b474267bec4cbcf932fbb28e45d7fb4e4db2971506825888: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100_NVLx4 BF16 Latency ngcMetadata: 28552abdb2c491d46065d52ca1dc1265b99ba95a5bf8daaee4c5de12511a3b4f: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h200x1-throughput-bf16-2mmw837ykw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H200x1 BF16 Throughput ngcMetadata: 434e8d336fa23cbe151748d32b71e196d69f20d319ee8b59852a1ca31a48d311: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 94GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:b200x2-latency-fp8-1m3h4ytjug framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 B200x2 FP8 Latency ngcMetadata: 4950d30811e1e426e97cda69e6c03a8a4819db8aa4abf34722ced4542a1f6b52: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__2 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100_NVLx1 FP8 Throughput ngcMetadata: 5811750e70b7e9f340f4d670c72fcbd5282e254aeb31f62fd4f937cfb9361007: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h200x2-latency-bf16-19zfbhbq3g framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H200x2 BF16 Latency ngcMetadata: 6832a9395f54086162fd7b1c6cfaae17c7d1e535a60e2b7675504c9fc7b57689: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__3 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 A100_SXM4_40GBx4 BF16 Throughput ngcMetadata: 6c29727e6e3d48a900c348c1fab181dc40bc926be07b06ca5b8eae42a6bc9901: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 4 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h100x2-latency-fp8-3wbe0ygpmg framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100x2 FP8 Latency ngcMetadata: 6c3f01dd2b2a56e3e83f70522e4195d3f2add70b28680082204bbb9d6150eb04: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h100x4-latency-bf16-9sreahcbuq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100x4 BF16 Latency ngcMetadata: 73f41fabbb60beb5b05ab21c8dcce5c277d99bcabec31abf46a0194d0dd18d04: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h100x1-throughput-fp8-mhpv-tjmtq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100x1 FP8 Throughput ngcMetadata: 7b508014e846234db3cabe5c9f38568b4ee96694b60600a0b71c621dc70cacf3: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__4 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 A100_SXM4_40GBx8 BF16 Latency ngcMetadata: 8a446393aaeb0065ee584748c7c03522389921a11ff2bd8cb5800e06a8644eb0: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__5 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100_NVLx2 FP8 Latency ngcMetadata: a00ce1e782317cd19ed192dcb0ce26ab8b0c1da8928c33de8893897888ff7580: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:b200x1-throughput-bf16-e8quw21o2g framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 B200x1 BF16 Throughput ngcMetadata: a4c63a91bccf635b570ddb6d14eeb6e7d0acb2389712892b08d21fad2ceaee38: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__6 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H100_NVLx2 BF16 Throughput ngcMetadata: acd73fcee9d91ada305118080138fb3ca4d255adee3312acda38c4487daae476: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:l40sx4-latency-fp8-dm0yeik1qq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 L40Sx4 FP8 Latency ngcMetadata: bdd0d3cd53fad1130259beea81ab5711fb98f2f1a020b5b26c3c82fd7d43c5af: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 50GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h200x2-throughput-fp8-pn0bsx2fww framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H200x2 FP8 Throughput ngcMetadata: c91a755246cb08dd9aa6905bc40b7db552071d141a850be5a791b06eb4fb2ef8: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:a100x4-latency-bf16-htlclkizog framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 A100x4 BF16 Latency ngcMetadata: d73b7cf2f719d720329fc65fc255ae901bc3beebdc59be9815ede1a07948c1f7: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 4 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:h200x2-latency-fp8-v0ho-fvz0g framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 H200x2 FP8 Latency ngcMetadata: e4f217a5fb016b570e34b8a8eb06051ccfef9534ba43da973bb7f678242eaa5f: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:b200x2-latency-bf16-moifcs7ehq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 B200x2 BF16 Latency ngcMetadata: f44768c625db71a327cf17e750d5e1a8e60171a8d8ef6b4c1c4b57fe74c9bf46: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__7 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 Generic NVIDIA GPUx8 BF16 ngcMetadata: 1d7b604f835f74791e6bfd843047fc00a5aef0f72954ca48ce963811fb6f3f09: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '8' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 8 - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__8 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 Generic NVIDIA GPUx2 BF16 ngcMetadata: 375dc0ff86133c2a423fbe9ef46d8fdf12d6403b3caa3b8e70d7851a89fc90dd: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '2' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 2 - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1:hf-1a2cb80-nim-0613-tool-use-v2__9 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1 Generic NVIDIA GPUx4 BF16 ngcMetadata: 54946b08b79ecf9e7f2d5c000234bf2cce19c8fee21b243c1a084b03897e8c95: model: nvidia/llama-3.3-nemotron-super-49b-v1 release: 1.10.1 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '4' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 4 - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - variantId: Llama 3.3 Nemotron Super 49B V1.5 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIyMjICoqQmlhcyoqXG5cbnxGaWVsZDp8UmVzcG9uc2U6fFxufDotLS06fDotLS06fFxufFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIChwcm90ZWN0ZWQgY2xhc3NlcykgaW4gbW9kZWwgZGVzaWduIGFuZCB0ZXN0aW5nOnxOb25lfFxufE1lYXN1cmVzIHRha2VuIHRvIG1pdGlnYXRlIGFnYWluc3QgdW53YW50ZWQgYmlhczp8Tm9uZXwiLAogICAgImNhbkd1ZXN0RG93bmxvYWQiOiBmYWxzZSwKICAgICJjcmVhdGVkRGF0ZSI6ICIyMDI1LTA5LTE2VDIwOjE5OjI0LjYxOFoiLAogICAgImRlc2NyaXB0aW9uIjogIiMjICoqTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MS41IE92ZXJ2aWV3KipcblxuIyMgKipEZXNjcmlwdGlvbjoqKlxuXG4qKkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEuNSoqIGlzIGEgc2lnbmlmaWNhbnRseSB1cGdyYWRlZCB2ZXJzaW9uIG9mIExsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEgYW5kIGlzIGEgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgKExMTSkgd2hpY2ggaXMgYSBkZXJpdmF0aXZlIG9mIE1ldGEgTGxhbWEtMy4zLTcwQi1JbnN0cnVjdCAoQUtBIHRoZSByZWZlcmVuY2UgbW9kZWwpLiBJdCBpcyBhIHJlYXNvbmluZyBtb2RlbCB0aGF0IGlzIHBvc3QgdHJhaW5lZCBmb3IgcmVhc29uaW5nLCBodW1hbiBjaGF0IHByZWZlcmVuY2VzLCBhbmQgYWdlbnRpYyB0YXNrcywgc3VjaCBhcyBSZXRyaWV2YWwtQXVnbWVudGVkIEdlbmVyYXRpb24gKFJBRykgYW5kIHRvb2wgY2FsbGluZy4gVGhlIG1vZGVsIHN1cHBvcnRzIGEgY29udGV4dCBsZW5ndGggb2YgMTI4SyB0b2tlbnMuXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEuNSBpcyBhIG1vZGVsIHdoaWNoIG9mZmVycyBhIGdyZWF0IHRyYWRlb2ZmIGJldHdlZW4gbW9kZWwgYWNjdXJhY3kgYW5kIGVmZmljaWVuY3kuIEVmZmljaWVuY3kgKHRocm91Z2hwdXQpIGRpcmVjdGx5IHRyYW5zbGF0ZXMgdG8gc2F2aW5ncy4gVXNpbmcgYSBub3ZlbCBOZXVyYWwgQXJjaGl0ZWN0dXJlIFNlYXJjaCAoTkFTKSBhcHByb2FjaCwgd2UgZ3JlYXRseSByZWR1Y2UgdGhlIG1vZGVsXHUyMDE5cyBtZW1vcnkgZm9vdHByaW50LCBlbmFibGluZyBsYXJnZXIgd29ya2xvYWRzLCBhcyB3ZWxsIGFzIGZpdHRpbmcgdGhlIG1vZGVsIG9uIGEgc2luZ2xlIEdQVSBhdCBoaWdoIHdvcmtsb2FkcyAoSDIwMCkuIFRoaXMgTkFTIGFwcHJvYWNoIGVuYWJsZXMgdGhlIHNlbGVjdGlvbiBvZiBhIGRlc2lyZWQgcG9pbnQgaW4gdGhlIGFjY3VyYWN5LWVmZmljaWVuY3kgdHJhZGVvZmYuIEZvciBtb3JlIGluZm9ybWF0aW9uIG9uIHRoZSBOQVMgYXBwcm9hY2gsIHBsZWFzZSByZWZlciB0byBbdGhpcyBwYXBlcl0oaHR0cHM6Ly9hcnhpdi5vcmcvYWJzLzI0MTEuMTkxNDYpLlxuXG5UaGUgbW9kZWwgdW5kZXJ3ZW50IGEgbXVsdGktcGhhc2UgcG9zdC10cmFpbmluZyBwcm9jZXNzIHRvIGVuaGFuY2UgYm90aCBpdHMgcmVhc29uaW5nIGFuZCBub24tcmVhc29uaW5nIGNhcGFiaWxpdGllcy4gVGhpcyBpbmNsdWRlcyBhIHN1cGVydmlzZWQgZmluZS10dW5pbmcgc3RhZ2UgZm9yIE1hdGgsIENvZGUsIFNjaWVuY2UsIGFuZCBUb29sIENhbGxpbmcuIEFkZGl0aW9uYWxseSwgdGhlIG1vZGVsIHdlbnQgdGhyb3VnaCBtdWx0aXBsZSBzdGFnZXMgb2YgUmVpbmZvcmNlbWVudCBMZWFybmluZyAoUkwpIGluY2x1ZGluZyBSZXdhcmQtYXdhcmUgUHJlZmVyZW5jZSBPcHRpbWl6YXRpb24gKFJQTykgZm9yIGNoYXQsIFJlaW5mb3JjZW1lbnQgTGVhcm5pbmcgd2l0aCBWZXJpZmlhYmxlIFJld2FyZHMgKFJMVlIpIGZvciByZWFzb25pbmcsIGFuZCBpdGVyYXRpdmUgRGlyZWN0IFByZWZlcmVuY2UgT3B0aW1pemF0aW9uIChEUE8pIGZvciBUb29sIENhbGxpbmcgY2FwYWJpbGl0eSBlbmhhbmNlbWVudHMuIFRoZSBmaW5hbCBjaGVja3BvaW50IHdhcyBhY2hpZXZlZCBhZnRlciBtZXJnaW5nIHNldmVyYWwgUkwgYW5kIERQTyBjaGVja3BvaW50cy5cblxuVGhpcyBtb2RlbCBpcyBwYXJ0IG9mIHRoZSBMbGFtYSBOZW1vdHJvbiBDb2xsZWN0aW9uLiBZb3UgY2FuIGZpbmQgdGhlIG90aGVyIG1vZGVsKHMpIGluIHRoaXMgZmFtaWx5IGhlcmU6XG5cbiogW0xsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLTRCLXYxLjFdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbnZpZGlhL0xsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLTRCLXYxLjEpICBcbiogW0xsYW1hLTMuMS1OZW1vdHJvbi1VbHRyYS0yNTNCLXYxXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL252aWRpYS9MbGFtYS0zXzEtTmVtb3Ryb24tVWx0cmEtMjUzQi12MSlcblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UuXG5cbiMjICoqTGljZW5zZS9UZXJtcyBvZiBVc2UqKlxuXG4qKkdPVkVSTklORyBURVJNUzoqKiBUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LykgYW5kIHRoZSBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cy8pOyBhbmQgdGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIE9wZW4gTW9kZWwgTGljZW5zZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLW9wZW4tbW9kZWwtbGljZW5zZS8pLlxuXG4qKkFkZGl0aW9uYWwgSW5mb3JtYXRpb246KiogW0xsYW1hIDMuMyBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMy9saWNlbnNlLykuIEJ1aWx0IHdpdGggTGxhbWEuXG5cbiMjKipHZXQgSGVscCoqXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgcHJvdmlkZWQgbW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cy4qKlxuXG4jIyAqKkRlcGxveW1lbnQgR2VvZ3JhcGh5OioqXG5cbkdsb2JhbFxuXG4jIyAqKlVzZSBDYXNlOioqXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEuNSBpcyBhIGdlbmVyYWwgcHVycG9zZSByZWFzb25pbmcgYW5kIGNoYXQgbW9kZWwgaW50ZW5kZWQgdG8gYmUgdXNlZCBpbiBFbmdsaXNoIGFuZCBjb2RpbmcgbGFuZ3VhZ2VzLiBPdGhlciBub24tRW5nbGlzaCBsYW5ndWFnZXMgKEdlcm1hbiwgRnJlbmNoLCBJdGFsaWFuLCBQb3J0dWd1ZXNlLCBIaW5kaSwgU3BhbmlzaCwgYW5kIFRoYWkpIGFyZSBhbHNvIHN1cHBvcnRlZC4gRGV2ZWxvcGVycyBkZXNpZ25pbmcgQUkgQWdlbnQgc3lzdGVtcywgY2hhdGJvdHMsIFJBRyBzeXN0ZW1zLCBhbmQgb3RoZXIgQUktcG93ZXJlZCBhcHBsaWNhdGlvbnMuIEFsc28gc3VpdGFibGUgZm9yIHR5cGljYWwgaW5zdHJ1Y3Rpb24tZm9sbG93aW5nIHRhc2tzLlxuXG4jIyAqKlJlbGVhc2UgRGF0ZToqKlxuXG4qIEh1Z2dpbmcgRmFjZSA3LzI1LzIwMjUgdmlhIFtMbGFtYS0zXFxfMy1OZW1vdHJvbi1TdXBlci00OUItdjFcXF81XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL252aWRpYS9MbGFtYS0zXzMtTmVtb3Ryb24tU3VwZXItNDlCLXYxXzUpICBcbiogQnVpbGQuTlZJRElBLmNvbSA3LzI1LzIwMjUgW0xsYW1hLTNcXF8zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MVxcXzVdKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9udmlkaWEvbGxhbWEtM18zLW5lbW90cm9uLXN1cGVyLTQ5Yi12MV81KVxuXG4jIyAqKlJlZmVyZW5jZXMqKlxuXG4qIFtcXFsyNTA1LjAwOTQ5XFxdIExsYW1hLU5lbW90cm9uOiBFZmZpY2llbnQgUmVhc29uaW5nIE1vZGVsc10oaHR0cHM6Ly9hcnhpdi5vcmcvYWJzLzI1MDUuMDA5NDkpICBcbiogW1xcWzI1MDIuMDAyMDNcXF0gUmV3YXJkLWF3YXJlIFByZWZlcmVuY2UgT3B0aW1pemF0aW9uOiBBIFVuaWZpZWQgTWF0aGVtYXRpY2FsIEZyYW1ld29yayBmb3IgTW9kZWwgQWxpZ25tZW50XShodHRwczovL2FyeGl2Lm9yZy9hYnMvMjUwMi4wMDIwMykgIFxuKiBbXFxbMjQxMS4xOTE0NlxcXVB1enpsZTogRGlzdGlsbGF0aW9uLUJhc2VkIE5BUyBmb3IgSW5mZXJlbmNlLU9wdGltaXplZCBMTE1zXShodHRwczovL2FyeGl2Lm9yZy9hYnMvMjQxMS4xOTE0NilcblxuIyMgKipNb2RlbCBBcmNoaXRlY3R1cmUqKlxuXG4qKkFyY2hpdGVjdHVyZSBUeXBlOioqIERlbnNlIGRlY29kZXItb25seSBUcmFuc2Zvcm1lciBtb2RlbFxuXG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIExsYW1hIDMuMyA3MEIgSW5zdHJ1Y3QsIGN1c3RvbWl6ZWQgdGhyb3VnaCBOZXVyYWwgQXJjaGl0ZWN0dXJlIFNlYXJjaCAoTkFTKVxuXG5UaGUgbW9kZWwgaXMgYSBkZXJpdmF0aXZlIG9mIE1ldGFcdTIwMTlzIExsYW1hLTMuMy03MEItSW5zdHJ1Y3QsIHVzaW5nIE5ldXJhbCBBcmNoaXRlY3R1cmUgU2VhcmNoIChOQVMpLiBUaGUgTkFTIGFsZ29yaXRobSByZXN1bHRzIGluIG5vbi1zdGFuZGFyZCBhbmQgbm9uLXJlcGV0aXRpdmUgYmxvY2tzLiBUaGlzIGluY2x1ZGVzIHRoZSBmb2xsb3dpbmc6XG5cblNraXAgYXR0ZW50aW9uOiBJbiBzb21lIGJsb2NrcywgdGhlIGF0dGVudGlvbiBpcyBza2lwcGVkIGVudGlyZWx5LCBvciByZXBsYWNlZCB3aXRoIGEgc2luZ2xlIGxpbmVhciBsYXllci4gVmFyaWFibGUgRkZOOiBUaGUgZXhwYW5zaW9uL2NvbXByZXNzaW9uIHJhdGlvIGluIHRoZSBGRk4gbGF5ZXIgaXMgZGlmZmVyZW50IGJldHdlZW4gYmxvY2tzLlxuXG5XZSB1dGlsaXplIGEgYmxvY2std2lzZSBkaXN0aWxsYXRpb24gb2YgdGhlIHJlZmVyZW5jZSBtb2RlbCwgd2hlcmUgZm9yIGVhY2ggYmxvY2sgd2UgY3JlYXRlIG11bHRpcGxlIHZhcmlhbnRzIHByb3ZpZGluZyBkaWZmZXJlbnQgdHJhZGVvZmZzIG9mIHF1YWxpdHkgdnMuIGNvbXB1dGF0aW9uYWwgY29tcGxleGl0eSwgZGlzY3Vzc2VkIGluIG1vcmUgZGVwdGggYmVsb3cuIFdlIHRoZW4gc2VhcmNoIG92ZXIgdGhlIGJsb2NrcyB0byBjcmVhdGUgYSBtb2RlbCB3aGljaCBtZWV0cyB0aGUgcmVxdWlyZWQgdGhyb3VnaHB1dCBhbmQgbWVtb3J5IChvcHRpbWl6ZWQgZm9yIGEgc2luZ2xlIEgxMDAtODBHQiBHUFUpIHdoaWxlIG1pbmltaXppbmcgdGhlIHF1YWxpdHkgZGVncmFkYXRpb24uIFRoZSBtb2RlbCB0aGVuIHVuZGVyZ29lcyBrbm93bGVkZ2UgZGlzdGlsbGF0aW9uIChLRCksIHdpdGggYSBmb2N1cyBvbiBFbmdsaXNoIHNpbmdsZSBhbmQgbXVsdGktdHVybiBjaGF0IHVzZSBjYXNlcy4gVGhlIEtEIHN0ZXAgaW5jbHVkZWQgNDAgYmlsbGlvbiB0b2tlbnMgY29uc2lzdGluZyBvZiBhIG1peHR1cmUgb2YgMyBkYXRhc2V0cyBcXC0gRmluZVdlYiwgQnV6ei1WMS4yLCBhbmQgRG9sbWEuXG5cbioqSW50ZW5kZWQgVXNlKiogIFxuTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MS41IGlzIGEgZ2VuZXJhbCBwdXJwb3NlIHJlYXNvbmluZyBhbmQgY2hhdCBtb2RlbCBpbnRlbmRlZCB0byBiZSB1c2VkIGluIEVuZ2xpc2ggYW5kIGNvZGluZyBsYW5ndWFnZXMuIE90aGVyIG5vbi1FbmdsaXNoIGxhbmd1YWdlcyAoR2VybWFuLCBGcmVuY2gsIEl0YWxpYW4sIFBvcnR1Z3Vlc2UsIEhpbmRpLCBTcGFuaXNoLCBhbmQgVGhhaSkgYXJlIGFsc28gc3VwcG9ydGVkLlxuXG4jIyAqKklucHV0KipcblxuKiAqKklucHV0IFR5cGUocyk6KiogVGV4dCAgXG4qICoqSW5wdXQgRm9ybWF0OioqIFN0cmluZyAgXG4qICoqSW5wdXQgUGFyYW1ldGVyczoqKiBPbmUtRGltZW5zaW9uYWwgKDFEKSAgXG4qICoqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OioqIENvbnRleHQgbGVuZ3RoIHVwIHRvIDEzMSwwNzIgdG9rZW5zXG5cbiMjICoqT3V0cHV0KipcblxuKiAqKk91dHB1dCBUeXBlKHMpOioqIFRleHQgIFxuKiAqKk91dHB1dCBGb3JtYXQ6KiogU3RyaW5nICBcbiogKipPdXRwdXQgUGFyYW1ldGVyczoqKiBPbmUtRGltZW5zaW9uYWwgKDFEKSAgXG4qICoqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDoqKiBDb250ZXh0IGxlbmd0aCB1cCB0byAxMzEsMDcyIHRva2Vuc1xuXG5PdXIgQUkgbW9kZWxzIGFyZSBkZXNpZ25lZCBhbmQvb3Igb3B0aW1pemVkIHRvIHJ1biBvbiBOVklESUEgR1BVLWFjY2VsZXJhdGVkIHN5c3RlbXMuIEJ5IGxldmVyYWdpbmcgTlZJRElBXHUyMDE5cyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuXG5cbiMjICoqU29mdHdhcmUgSW50ZWdyYXRpb246KipcblxuKiAqKlJ1bnRpbWUgRW5naW5lOioqIHZMTE0sIFRlbnNvclJUICBcbiogKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eToqKiAgXG4gICogTlZJRElBIEFtcGVyZSAgXG4gICogTlZJRElBIEhvcHBlciAgXG4qICoqUHJlZmVycmVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6KiogTGludXhcblxuVGhlIGludGVncmF0aW9uIG9mIGZvdW5kYXRpb24gYW5kIGZpbmUtdHVuZWQgbW9kZWxzIGludG8gQUkgc3lzdGVtcyByZXF1aXJlcyBhZGRpdGlvbmFsIHRlc3RpbmcgdXNpbmcgdXNlLWNhc2Utc3BlY2lmaWMgZGF0YSB0byBlbnN1cmUgc2FmZSBhbmQgZWZmZWN0aXZlIGRlcGxveW1lbnQuIEZvbGxvd2luZyB0aGUgVi1tb2RlbCBtZXRob2RvbG9neSwgaXRlcmF0aXZlIHRlc3RpbmcgYW5kIHZhbGlkYXRpb24gYXQgYm90aCB1bml0IGFuZCBzeXN0ZW0gbGV2ZWxzIGFyZSBlc3NlbnRpYWwgdG8gbWl0aWdhdGUgcmlza3MsIG1lZXQgdGVjaG5pY2FsIGFuZCBmdW5jdGlvbmFsIHJlcXVpcmVtZW50cywgYW5kIGVuc3VyZSBjb21wbGlhbmNlIHdpdGggc2FmZXR5IGFuZCBldGhpY2FsIHN0YW5kYXJkcyBiZWZvcmUgZGVwbG95bWVudC5cblxuIyMgKipNb2RlbCBWZXJzaW9uOioqXG5cbkxsYW1hLTMuMy1OZW1vdHJvbi1TdXBlci00OUItdjEuNS0xLjEyLjAgPGJyPlxuTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MS41LTEuMTMuMSA8YnI+XG5MbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxLjUtMS4xNC4wIDxicj5cblxuIyMgKipRdWljayBTdGFydCBhbmQgVXNhZ2UgUmVjb21tZW5kYXRpb25zOioqXG5cbiogQnkgZGVmYXVsdCAoZW1wdHkgc3lzdGVtIHByb21wdCksIHRoZSBtb2RlbCB3aWxsIHJlc3BvbmQgaW4gcmVhc29uaW5nIE9OIG1vZGUuIFNldHRpbmcgL25vXFxfdGhpbmsgaW4gdGhlIHN5c3RlbSBwcm9tcHQgd2lsbCBlbmFibGUgcmVhc29uaW5nIE9GRiBtb2RlLiAgXG4qIFdlIHJlY29tbWVuZCBzZXR0aW5nIHRlbXBlcmF0dXJlIHRvIDAuNiBhbmQgVG9wIFAgdG8gMC45NSBmb3IgUmVhc29uaW5nIE9OIG1vZGUuICBcbiogV2UgcmVjb21tZW5kIHVzaW5nIGdyZWVkeSBkZWNvZGluZyBmb3IgUmVhc29uaW5nIE9GRiBtb2RlLlxuXG5Zb3UgY2FuIHRyeSB0aGlzIG1vZGVsIG91dCB0aHJvdWdoIHRoZSBwcmV2aWV3IEFQSSwgdXNpbmcgdGhpcyBsaW5rOiBbTGxhbWEtM1xcXzMtTmVtb3Ryb24tU3VwZXItNDlCLXYxXFxfNV0oaHR0cHM6Ly9idWlsZC5udmlkaWEuY29tL252aWRpYS9sbGFtYS0zXzMtbmVtb3Ryb24tc3VwZXItNDliLXYxXzUpLlxuXG4qKlVzZSBJdCB3aXRoIHZMTE0qKlxuXG5waXAgaW5zdGFsbCB2bGxtPT0wLjkuMlxuXG5BbiBleGFtcGxlIG9uIGhvdyB0byBzZXJ2ZSB3aXRoIHZMTE06XG5cbmBgYFxuJCBweXRob24zIC1tIHZsbG0uZW50cnlwb2ludHMub3BlbmFpLmFwaV9zZXJ2ZXIgXFxcbiAgLS1tb2RlbCBcIm52aWRpYS9MbGFtYS0zXzMtTmVtb3Ryb24tU3VwZXItNDlCLXYxXzVcIiBcXFxuICAtLXRydXN0LXJlbW90ZS1jb2RlIFxcXG4gIC0tc2VlZD0xIFxcXG4gIC0taG9zdD1cIjAuMC4wLjBcIiBcXFxuICAtLXBvcnQ9NTAwMCBcXFxuICAtLXNlcnZlZC1tb2RlbC1uYW1lIFwiTGxhbWEtM18zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MV81XCIgXFxcbiAgLS10ZW5zb3ItcGFyYWxsZWwtc2l6ZT04IFxcXG4gIC0tbWF4LW1vZGVsLWxlbj02NTUzNiBcXFxuICAtLWdwdS1tZW1vcnktdXRpbGl6YXRpb24gMC45NSBcXFxuICAtLWVuZm9yY2UtZWFnZXJcbmBgYFxuXG4qKlJ1bm5pbmcgYSB2TExNIFNlcnZlciB3aXRoIFRvb2wtY2FsbCBTdXBwb3J0KipcblxuVG8gZW5hYmxlIHRvb2wgY2FsbGluZyB1c2FnZSB3aXRoIHRoaXMgbW9kZWwsIHdlIHByb3ZpZGUgYSB0b29sIHBhcnNlciBpbiB0aGUgcmVwb3NpdG9yeS4gSGVyZSBpcyBhbiBleGFtcGxlIG9uIGhvdyB0byB1c2UgaXQ6XG5cbmBgYFxuJCBnaXQgY2xvbmUgaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9udmlkaWEvTGxhbWEtM18zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MV81XG5cbiQgY29uZGEgY3JlYXRlIC1uIHZsbG0gcHl0aG9uPTMuMTIgLXlcbiQgY29uZGEgYWN0aXZhdGUgdmxsbVxuJCBwaXAgaW5zdGFsbCB2bGxtPT0wLjkuMlxuXG4kIHB5dGhvbjMgLW0gdmxsbS5lbnRyeXBvaW50cy5vcGVuYWkuYXBpX3NlcnZlciBcXFxuICAtLW1vZGVsIExsYW1hLTNfMy1OZW1vdHJvbi1TdXBlci00OUItdjFfNSBcXFxuICAtLXRydXN0LXJlbW90ZS1jb2RlIFxcXG4gIC0tc2VlZD0xIFxcXG4gIC0taG9zdD1cIjAuMC4wLjBcIiBcXFxuICAtLXBvcnQ9NTAwMCBcXFxuICAtLXNlcnZlZC1tb2RlbC1uYW1lIFwiTGxhbWEtM18zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MV81XCIgXFxcbiAgLS10ZW5zb3ItcGFyYWxsZWwtc2l6ZT04IFxcXG4gIC0tbWF4LW1vZGVsLWxlbj02NTUzNiBcXFxuICAtLWdwdS1tZW1vcnktdXRpbGl6YXRpb24gMC45NSBcXFxuICAtLWVuZm9yY2UtZWFnZXIgXFxcbiAgLS1lbmFibGUtYXV0by10b29sLWNob2ljZSBcXFxuICAtLXRvb2wtcGFyc2VyLXBsdWdpbiBcIkxsYW1hLTNfMy1OZW1vdHJvbi1TdXBlci00OUItdjFfNS9sbGFtYV9uZW1vdHJvbl90b29sY2FsbF9wYXJzZXJfbm9fc3RyZWFtaW5nLnB5XCIgXFxcbiAgLS10b29sLWNhbGwtcGFyc2VyIFwibGxhbWFfbmVtb3Ryb25fanNvblwiXG5gYGBcblxuQWZ0ZXIgbGF1bmNoaW5nIGEgdkxMTSBzZXJ2ZXIsIHlvdSBjYW4gY2FsbCB0aGUgc2VydmVyIHdpdGggdG9vbC1jYWxsIHN1cHBvcnQgdXNpbmcgYSBQeXRob24gc2NyaXB0IGxpa2UgYmVsb3cuXG5cbmBgYHB5XG5mcm9tIG9wZW5haSBpbXBvcnQgT3BlbkFJXG5jbGllbnQgPSBPcGVuQUkoXG4gICAgYmFzZV91cmw9XCJodHRwOi8vMC4wLjAuMDo1MDAwL3YxXCIsXG4gICAgYXBpX2tleT1cImR1bW15XCIsXG4pXG5jb21wbGV0aW9uID0gY2xpZW50LmNoYXQuY29tcGxldGlvbnMuY3JlYXRlKFxuICAgIG1vZGVsPVwiTGxhbWEtM18zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MV81XCIsXG4gICAgbWVzc2FnZXM9W1xuICAgICAgICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIlwifSxcbiAgICAgICAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiTXkgYmlsbCBpcyAkMTAwLiBXaGF0IHdpbGwgYmUgdGhlIGFtb3VudCBmb3IgMTglIHRpcD9cIn1cbiAgICBdLFxuICAgIHRvb2xzPVtcbiAgICAgICAge1xuICAgICAgICAgICAgXCJ0eXBlXCI6IFwiZnVuY3Rpb25cIixcbiAgICAgICAgICAgIFwiZnVuY3Rpb25cIjoge1xuICAgICAgICAgICAgICAgIFwibmFtZVwiOiBcImNhbGN1bGF0ZV90aXBcIixcbiAgICAgICAgICAgICAgICBcInBhcmFtZXRlcnNcIjoge1xuICAgICAgICAgICAgICAgICAgICBcInR5cGVcIjogXCJvYmplY3RcIixcbiAgICAgICAgICAgICAgICAgICAgXCJwcm9wZXJ0aWVzXCI6IHtcbiAgICAgICAgICAgICAgICAgICAgICAgIFwiYmlsbF90b3RhbFwiOiB7XG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJ0eXBlXCI6IFwiaW50ZWdlclwiLFxuICAgICAgICAgICAgICAgICAgICAgICAgICAgIFwiZGVzY3JpcHRpb25cIjogXCJUaGUgdG90YWwgYW1vdW50IG9mIHRoZSBiaWxsXCJcbiAgICAgICAgICAgICAgICAgICAgICAgIH0sXG4gICAgICAgICAgICAgICAgICAgICAgICBcInRpcF9wZXJjZW50YWdlXCI6IHtcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcInR5cGVcIjogXCJpbnRlZ2VyXCIsXG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJkZXNjcmlwdGlvblwiOiBcIlRoZSBwZXJjZW50YWdlIG9mIHRpcCB0byBiZSBhcHBsaWVkXCJcbiAgICAgICAgICAgICAgICAgICAgICAgIH1cbiAgICAgICAgICAgICAgICAgICAgfSxcbiAgICAgICAgICAgICAgICAgICAgXCJyZXF1aXJlZFwiOiBbXCJiaWxsX3RvdGFsXCIsIFwidGlwX3BlcmNlbnRhZ2VcIl1cbiAgICAgICAgICAgICAgICB9XG4gICAgICAgICAgICB9XG4gICAgICAgIH0sXG4gICAgICAgIHtcbiAgICAgICAgICAgIFwidHlwZVwiOiBcImZ1bmN0aW9uXCIsXG4gICAgICAgICAgICBcImZ1bmN0aW9uXCI6IHtcbiAgICAgICAgICAgICAgICBcIm5hbWVcIjogXCJjb252ZXJ0X2N1cnJlbmN5XCIsXG4gICAgICAgICAgICAgICAgXCJwYXJhbWV0ZXJzXCI6IHtcbiAgICAgICAgICAgICAgICAgICAgXCJ0eXBlXCI6IFwib2JqZWN0XCIsXG4gICAgICAgICAgICAgICAgICAgIFwicHJvcGVydGllc1wiOiB7XG4gICAgICAgICAgICAgICAgICAgICAgICBcImFtb3VudFwiOiB7XG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJ0eXBlXCI6IFwiaW50ZWdlclwiLFxuICAgICAgICAgICAgICAgICAgICAgICAgICAgIFwiZGVzY3JpcHRpb25cIjogXCJUaGUgYW1vdW50IHRvIGJlIGNvbnZlcnRlZFwiXG4gICAgICAgICAgICAgICAgICAgICAgICB9LFxuICAgICAgICAgICAgICAgICAgICAgICAgXCJmcm9tX2N1cnJlbmN5XCI6IHtcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcInR5cGVcIjogXCJzdHJpbmdcIixcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcImRlc2NyaXB0aW9uXCI6IFwiVGhlIGN1cnJlbmN5IGNvZGUgdG8gY29udmVydCBmcm9tXCJcbiAgICAgICAgICAgICAgICAgICAgICAgIH0sXG4gICAgICAgICAgICAgICAgICAgICAgICBcInRvX2N1cnJlbmN5XCI6IHtcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcInR5cGVcIjogXCJzdHJpbmdcIixcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcImRlc2NyaXB0aW9uXCI6IFwiVGhlIGN1cnJlbmN5IGNvZGUgdG8gY29udmVydCB0b1wiXG4gICAgICAgICAgICAgICAgICAgICAgICB9XG4gICAgICAgICAgICAgICAgICAgIH0sXG4gICAgICAgICAgICAgICAgICAgIFwicmVxdWlyZWRcIjogW1wiZnJvbV9jdXJyZW5jeVwiLCBcImFtb3VudFwiLCBcInRvX2N1cnJlbmN5XCJdXG4gICAgICAgICAgICAgICAgfVxuICAgICAgICAgICAgfVxuICAgICAgICB9XG4gICAgXSxcbiAgICB0ZW1wZXJhdHVyZT0wLjYsXG4gICAgdG9wX3A9MC45NSxcbiAgICBtYXhfdG9rZW5zPTMyNzY4LFxuICAgIHN0cmVhbT1GYWxzZVxuKVxucHJpbnQoY29tcGxldGlvbi5jaG9pY2VzWzBdLm1lc3NhZ2UuY29udGVudClcbicnJ1xuPHRoaW5rPlxuT2theSwgbGV0J3Mgc2VlLiBUaGUgdXNlciBoYXMgYSBiaWxsIG9mICQxMDAgYW5kIHdhbnRzIHRvIGtub3cgdGhlIGFtb3VudCBmb3IgYW4gMTglIHRpcC4gSG1tLCBJIG5lZWQgdG8gY2FsY3VsYXRlIHRoZSB0aXAgYmFzZWQgb24gdGhlIGJpbGwgdG90YWwgYW5kIHRoZSBwZXJjZW50YWdlLiBUaGUgdG9vbHMgcHJvdmlkZWQgaW5jbHVkZSBjYWxjdWxhdGVfdGlwLCB3aGljaCB0YWtlcyBiaWxsX3RvdGFsIGFuZCB0aXBfcGVyY2VudGFnZSBhcyBwYXJhbWV0ZXJzLiBTbyB0aGUgYmlsbF90b3RhbCBoZXJlIGlzIDEwMCwgYW5kIHRoZSB0aXBfcGVyY2VudGFnZSBpcyAxOC4gSSBzaG91bGQgY2FsbCB0aGUgY2FsY3VsYXRlX3RpcCBmdW5jdGlvbiB3aXRoIHRoZXNlIHZhbHVlcy4gV2FpdCwgZG8gSSBuZWVkIHRvIGNoZWNrIGlmIHRoZSBwYXJhbWV0ZXJzIGFyZSBpbnRlZ2Vycz8gVGhlIGJpbGwgaXMgJDEwMCwgd2hpY2ggaXMgYW4gaW50ZWdlciwgYW5kIDE4JSBpcyBhbHNvIGFuIGludGVnZXIuIFNvIHRoYXQgZml0cyB0aGUgZnVuY3Rpb24ncyByZXF1aXJlbWVudHMuIEkgZG9uJ3QgbmVlZCB0byBjb252ZXJ0IGFueSBjdXJyZW5jeSBoZXJlIGJlY2F1c2UgdGhlIHVzZXIgaXMgYXNraW5nIGFib3V0IGEgdGlwIGluIHRoZSBzYW1lIGN1cnJlbmN5LiBTbyB0aGUgY29ycmVjdCB0b29sIHRvIHVzZSBpcyBjYWxjdWxhdGVfdGlwIHdpdGggdGhvc2UgcGFyYW1ldGVycy5cbjwvdGhpbms+XG4nJydcbnByaW50KGNvbXBsZXRpb24uY2hvaWNlc1swXS5tZXNzYWdlLnRvb2xfY2FsbHMpXG4nJydcbltDaGF0Q29tcGxldGlvbk1lc3NhZ2VUb29sQ2FsbChpZD0nY2hhdGNtcGwtdG9vbC1lMzQxYzY5NTRkMmM0OGMyYTBlOTA3MWM3YmRlZmQ4YicsIGZ1bmN0aW9uPUZ1bmN0aW9uKGFyZ3VtZW50cz0ne1wiYmlsbF90b3RhbFwiOiAxMDAsIFwidGlwX3BlcmNlbnRhZ2VcIjogMTh9JywgbmFtZT0nY2FsY3VsYXRlX3RpcCcpLCB0eXBlPSdmdW5jdGlvbicpXVxuJycnXG5gYGBcblxuIyMgKipUcmFpbmluZywgVGVzdGluZywgYW5kIEV2YWx1YXRpb24gRGF0YXNldHM6KipcblxuIyMjICoqVHJhaW5pbmcgRGF0YXNldDoqKlxuXG5BIGxhcmdlIHZhcmlldHkgb2YgdHJhaW5pbmcgZGF0YSB3YXMgdXNlZCBmb3IgdGhlIGtub3dsZWRnZSBkaXN0aWxsYXRpb24gcGhhc2UgYmVmb3JlIHRoZSBwb3N0LXRyYWluaW5nIHBpcGVsaW5lLCAzIG9mIHdoaWNoIGluY2x1ZGVkOiBGaW5lV2ViLCBCdXp6LVYxLjIsIGFuZCBEb2xtYS5cblxuVGhlIGRhdGEgZm9yIHRoZSBtdWx0aS1zdGFnZSBwb3N0LXRyYWluaW5nIHBoYXNlcyBmb3IgaW1wcm92ZW1lbnRzIGluIENvZGUsIE1hdGgsIGFuZCBSZWFzb25pbmcgaXMgYSBjb21waWxhdGlvbiBvZiBTRlQgYW5kIFJMIGRhdGEgdGhhdCBzdXBwb3J0cyBpbXByb3ZlbWVudHMgb2YgbWF0aCwgY29kZSwgZ2VuZXJhbCByZWFzb25pbmcsIGFuZCBpbnN0cnVjdGlvbiBmb2xsb3dpbmcgY2FwYWJpbGl0aWVzIG9mIHRoZSBvcmlnaW5hbCBMbGFtYSBpbnN0cnVjdCBtb2RlbC5cblxuUHJvbXB0cyBoYXZlIGJlZW4gc291cmNlZCBmcm9tIGVpdGhlciBwdWJsaWMgYW5kIG9wZW4gY29ycHVzIG9yIHN5bnRoZXRpY2FsbHkgZ2VuZXJhdGVkLiBSZXNwb25zZXMgd2VyZSBzeW50aGV0aWNhbGx5IGdlbmVyYXRlZCBieSBhIHZhcmlldHkgb2YgbW9kZWxzLCB3aXRoIHNvbWUgcHJvbXB0cyBjb250YWluaW5nIHJlc3BvbnNlcyBmb3IgYm90aCByZWFzb25pbmcgb24gYW5kIG9mZiBtb2RlcywgdG8gdHJhaW4gdGhlIG1vZGVsIHRvIGRpc3Rpbmd1aXNoIGJldHdlZW4gdHdvIG1vZGVzLlxuXG5OVklESUEgd2lsbCBiZSByZWxlYXNpbmcgdGhlIHBvc3QtdHJhaW5pbmcgZGF0YXNldCBpbiB0aGUgY29taW5nIHdlZWtzLlxuXG4qKkRhdGEgTW9kYWxpdHk6KiogVGV4dCBcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBBdXRvbWF0ZWQsIEh1bWFuLCBTeW50aGV0aWNcblxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG4qKlByb3BlcnRpZXMgKFF1YW50aXR5LCBEYXRhc2V0IERlc2NyaXB0aW9ucywgU2Vuc29yKHMpKToqKiBcblxuUXVhbnRpdHk6IFRoZSBrbm93bGVkZ2UgZGlzdGlsbGF0aW9uIHBoYXNlIHVzZWQgNDAgYmlsbGlvbiB0b2tlbnMuIFRoZSB1bmRlcmx5aW5nIERvbG1hIGRhdGFzZXQgY29udGFpbnMgYXBwcm94aW1hdGVseSAzIHRyaWxsaW9uIHRva2VucywgYW5kIEZpbmVXZWIgY29udGFpbnMgb3ZlciAxNSB0cmlsbGlvbiB0b2tlbnMuXG5cbkRhdGFzZXQgRGVzY3JpcHRpb25zOiBUaGUgdHJhaW5pbmcgZGF0YSBpcyBhIGNvbXBvc2l0ZSBvZiBsYXJnZS1zY2FsZSB3ZWIgdGV4dCwgc3ludGhldGljYWxseSBnZW5lcmF0ZWQgY29udmVyc2F0aW9uYWwgZGF0YSBmb3IgY29kaW5nIGFuZCBpbnN0cnVjdGlvbi1mb2xsb3dpbmcsIGFuZCBhIGRpdmVyc2UgY29ycHVzIG9mIHRleHQgZnJvbSBhY2FkZW1pYywgbGl0ZXJhcnksIGFuZCBlbmN5Y2xvcGVkaWMgc291cmNlcy4gVGhlIG1vZGVsIHN1cHBvcnRzIGEgY29udGV4dCBsZW5ndGggb2YgMTI4LDAwMCB0b2tlbnMuXG5cbiMjIyBcblxuIyMjICoqVGVzdGluZyBEYXRhc2V0OioqXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpY1xuXG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKlByb3BlcnRpZXMgKFF1YW50aXR5LCBEYXRhc2V0IERlc2NyaXB0aW9ucywgU2Vuc29yKHMpKToqKlxuXG5RdWFudGl0eTogVGhlIGJlbmNobWFya3MgY29udGFpbiB0aG91c2FuZHMgb2YgdGVzdCBpdGVtcywgaW5jbHVkaW5nOlxuXG4qIE1NTFU6IFxcfjE1LDkwMCBtdWx0aXBsZS1jaG9pY2UgcXVlc3Rpb25zLiAgXG4qIEdQUUE6IDQ0OCBkaWZmaWN1bHQgbXVsdGlwbGUtY2hvaWNlIHF1ZXN0aW9ucy4gIFxuKiBIdW1hbkV2YWw6IDE2NCBwcm9ncmFtbWluZyBwcm9ibGVtcy4gIFxuKiBHU00tOEs6IFxcfjgsNTAwIGdyYWRlLXNjaG9vbCBtYXRoIHByb2JsZW1zLiAgXG4qIE1BVEg6IDEyLDUwMCBjb21wZXRpdGlvbiBtYXRoIHByb2JsZW1zLiAgXG4qIElGLUV2YWw6IE92ZXIgNDAwIGluc3RydWN0aW9uLWZvbGxvd2luZyBwcm9tcHRzLlxuXG5EYXRhc2V0IERlc2NyaXB0aW9uczogVGhlIGV2YWx1YXRpb24gc3VpdGUgaXMgZGl2ZXJzZSwgY292ZXJpbmcgNTcgYWNhZGVtaWMgYW5kIHByb2Zlc3Npb25hbCBzdWJqZWN0cyAoTU1MVSksIGV4cGVydC1sZXZlbCByZWFzb25pbmcgKEdQUUEpLCBQeXRob24gY29kZSBnZW5lcmF0aW9uIChIdW1hbkV2YWwpLCBtYXRoZW1hdGljYWwgcHJvYmxlbS1zb2x2aW5nIChHU00tOEssIE1BVEgpLCBhbmQgdGhlIGFiaWxpdHkgdG8gZm9sbG93IHByZWNpc2UgaW5zdHJ1Y3Rpb25zIChJRi1FdmFsKS5cblxuIyMjICoqRXZhbHVhdGlvbiBEYXRhc2V0OioqXG5cbldlIHVzZWQgdGhlIGRhdGFzZXRzIGxpc3RlZCBiZWxvdyB0byBldmFsdWF0ZSBMbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxLjUuXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4uIFN5bnRoZXRpY1xuXG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpYywgQXV0b21hdGljXG5cbioqRXZhbHVhdGlvbiBSZXN1bHRzKiogIFxuV2UgZXZhbHVhdGUgdGhlIG1vZGVsIHVzaW5nIHRlbXBlcmF0dXJlPTAuNiwgdG9wXFxfcD0wLjk1LCBhbmQgNjRrIHNlcXVlbmNlIGxlbmd0aC4gV2UgcnVuIHRoZSBiZW5jaG1hcmtzIHVwIHRvIDE2IHRpbWVzIGFuZCBhdmVyYWdlIHRoZSBzY29yZXMgdG8gYmUgbW9yZSBhY2N1cmF0ZS5cblxuIyMjIE1BVEg1MDBcblxufCBSZWFzb25pbmcgTW9kZSB8IHBhc3NAMSAoYXZnLiBvdmVyIDQgcnVucykgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgUmVhc29uaW5nIE9uIHwgOTcuNCB8XG5cbiMjIyBBSU1FIDIwMjRcblxufCBSZWFzb25pbmcgTW9kZSB8IHBhc3NAMSAoYXZnLiBvdmVyIDE2IHJ1bnMpIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFJlYXNvbmluZyBPbiB8IDg3LjUgfFxuXG4jIyMgQUlNRSAyMDI1XG5cbnwgUmVhc29uaW5nIE1vZGUgfCBwYXNzQDEgKGF2Zy4gb3ZlciAxNiBydW5zKSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBSZWFzb25pbmcgT24gfCA4Mi43MSB8XG5cbiMjIyBHUFFBXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBwYXNzQDEgKGF2Zy4gb3ZlciA0IHJ1bnMpIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFJlYXNvbmluZyBPbiB8IDcxLjk3IHxcblxuIyMjIExpdmVDb2RlQmVuY2ggMjQuMTAtMjUuMDJcblxufCBSZWFzb25pbmcgTW9kZSB8IHBhc3NAMSAoYXZnLiBvdmVyIDQgcnVucykgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgUmVhc29uaW5nIE9uIHwgNzMuNTggfFxuXG4jIyMgQkZDTCB2M1xuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIChhdmcuIG92ZXIgMiBydW5zKSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBSZWFzb25pbmcgT24gfCA3MS43NSB8XG5cbiMjIyBJRkV2YWxcblxufCBSZWFzb25pbmcgTW9kZSB8IFN0cmljdDpJbnN0cnVjdGlvbiB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBSZWFzb25pbmcgT24gfCA4OC42MSB8XG5cbiMjIyBBcmVuYUhhcmRcblxufCBSZWFzb25pbmcgTW9kZSB8IHBhc3NAMSAoYXZnLiBvdmVyIDEgcnVucykgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgUmVhc29uaW5nIE9uIHwgOTIuMCB8XG5cbiMjIyBIdW1hbml0eSdzIExhc3QgRXhhbSAoVGV4dC1Pbmx5IFN1YnNldClcblxufCBSZWFzb25pbmcgTW9kZSB8IHBhc3NAMSAoYXZnLiBvdmVyIDEgcnVucykgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgUmVhc29uaW5nIE9uIHwgNy42NCB8XG5cbiMjIyBNTUxVIFBybyAoQ29UKVxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIChhdmcuIG92ZXIgMSBydW5zKSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBSZWFzb25pbmcgT24gfCA3OS41MyB8XG5cbkFsbCBldmFsdWF0aW9ucyB3ZXJlIGRvbmUgdXNpbmcgdGhlIFtOZU1vLVNraWxsc10oaHR0cHM6Ly9naXRodWIuY29tL05WSURJQS9OZU1vLVNraWxscykgcmVwb3NpdG9yeS5cblxuIyMgKipJbmZlcmVuY2U6KipcblxuKipBY2NlbGVyYXRpb24gRW5naW5lOioqXG5cbiogdkxMTSwgVGVuc29yUlRcblxuKipUZXN0IEhhcmR3YXJlOioqXG5cbiogMnggTlZJRElBIEgxMDAtODBHQiAgXG4qIDJ4IE5WSURJQSBBMTAwLTgwR0IgR1BVc1xuKiBCMjAwIFNYTSAgICBcbiogSDIwMCBTWE0gICBcbiogSDEwMCBTWE0gICBcbiogQTEwMCBTWE0gODBHQiAgIFxuKiBBMTAwIFNYTSA0MEdCICAgXG4qIEw0MFMgUENJZSAgIFxuKiBBMTBHICAgXG4qIEgxMDAgTlZMICAgXG4qIEgyMDAgTlZMICAgXG4qIEdIMjAwIDk2R0IgICBcbiogR0IyMDAgXG4qIFJUWCA1MDkwICAgXG4qIFJUWCA0MDkwICAgXG4qIFJUWCA2MDAwIEFkYSBcblxuIyMgKipFdGhpY2FsIENvbnNpZGVyYXRpb25zOioqXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLlxuXG5Gb3IgbW9yZSBkZXRhaWxlZCBpbmZvcm1hdGlvbiBvbiBldGhpY2FsIGNvbnNpZGVyYXRpb25zIGZvciB0aGlzIG1vZGVsLCBwbGVhc2Ugc2VlIHRoZSBNb2RlbCBDYXJkKysgW0JpYXNdKGh0dHA6Ly8uL2JpYXMubWQpLCBbRXhwbGFpbmFiaWxpdHldKGh0dHA6Ly8uL2V4cGxhaW5hYmlsaXR5Lm1kKSwgW1NhZmV0eSAmIFNlY3VyaXR5XShodHRwOi8vLi9zYWZldHkubWQpLCBhbmQgW1ByaXZhY3ldKGh0dHA6Ly8uL3ByaXZhY3kubWQpIFN1YmNhcmRzLlxuXG5QbGVhc2UgcmVwb3J0IG1vZGVsIHF1YWxpdHksIHJpc2ssIHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLlxuXG5Zb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBwcm92aWRlZCBtb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLlxuXG4jIyAqKkNpdGF0aW9uKipcblxuYGBgcHlcbkBtaXNje2JlcmNvdmljaDIwMjVsbGFtYW5lbW90cm9uZWZmaWNpZW50cmVhc29uaW5nbW9kZWxzLFxuICAgICAgdGl0bGU9e0xsYW1hLU5lbW90cm9uOiBFZmZpY2llbnQgUmVhc29uaW5nIE1vZGVsc30sIFxuICAgICAgYXV0aG9yPXtBa2hpYWQgQmVyY292aWNoIGFuZCBJdGF5IExldnkgYW5kIEl6aWsgR29sYW4gYW5kIE1vaGFtbWFkIERhYmJhaCBhbmQgUmFuIEVsLVlhbml2IGFuZCBPbXJpIFB1bnkgYW5kIElkbyBHYWxpbCBhbmQgWmFjaCBNb3NoZSBhbmQgVG9tZXIgUm9uZW4gYW5kIE5hamVlYiBOYWJ3YW5pIGFuZCBJZG8gU2hhaGFmIGFuZCBPcmVuIFRyb3BwIGFuZCBFaHVkIEthcnBhcyBhbmQgUmFuIFppbGJlcnN0ZWluIGFuZCBKaWFxaSBaZW5nIGFuZCBTb3VteWUgU2luZ2hhbCBhbmQgQWxleGFuZGVyIEJ1a2hhcmluIGFuZCBZaWFuIFpoYW5nIGFuZCBUdWdydWwgS29udWsgYW5kIEdlcmFsZCBTaGVuIGFuZCBBbWV5YSBTdW5pbCBNYWhhYmFsZXNod2Fya2FyIGFuZCBCaWxhbCBLYXJ0YWwgYW5kIFlvc2hpIFN1aGFyYSBhbmQgT2xpdmllciBEZWxhbGxlYXUgYW5kIFppamlhIENoZW4gYW5kIFpoaWxpbiBXYW5nIGFuZCBEYXZpZCBNb3NhbGxhbmV6aGFkIGFuZCBBZGkgUmVuZHVjaGludGFsYSBhbmQgSGFpZmVuZyBRaWFuIGFuZCBEaW1hIFJla2VzaCBhbmQgRmVpIEppYSBhbmQgU29tc2h1YnJhIE1hanVtZGFyIGFuZCBWYWhpZCBOb3Jvb3ppIGFuZCBXYXNpIFVkZGluIEFobWFkIGFuZCBTZWFuIE5hcmVudGhpcmFuIGFuZCBBbGVrc2FuZGVyIEZpY2VrIGFuZCBNZWhyemFkIFNhbWFkaSBhbmQgSm9jZWx5biBIdWFuZyBhbmQgU2lkZGhhcnRoYSBKYWluIGFuZCBJZ29yIEdpdG1hbiBhbmQgSXZhbiBNb3Noa292IGFuZCBXZWkgRHUgYW5kIFNodWJoYW0gVG9zaG5pd2FsIGFuZCBHZW9yZ2UgQXJtc3Ryb25nIGFuZCBCcmFuaXNsYXYgS2lzYWNhbmluIGFuZCBNYXR2ZWkgTm92aWtvdiBhbmQgRGFyaWEgR2l0bWFuIGFuZCBFdmVsaW5hIEJha2h0dXJpbmEgYW5kIEphbmUgUG9sYWsgU2Nvd2Nyb2Z0IGFuZCBKb2huIEthbWFsdSBhbmQgRGFuIFN1IGFuZCBLZXpoaSBLb25nIGFuZCBNYXJrdXMgS2xpZWdsIGFuZCBSYWJlZWggS2FyaW1pIGFuZCBZaW5nIExpbiBhbmQgU2FuamVldiBTYXRoZWVzaCBhbmQgSnVwaW5kZXIgUGFybWFyIGFuZCBQcml0YW0gR3VuZGVjaGEgYW5kIEJyYW5kb24gTm9yaWNrIGFuZCBKb3NlcGggSmVubmluZ3MgYW5kIFNocmltYWkgUHJhYmh1bW95ZSBhbmQgU3llZGEgTmFoaWRhIEFrdGVyIGFuZCBNb3N0b2ZhIFBhdHdhcnkgYW5kIEFiaGluYXYgS2hhdHRhciBhbmQgRGVlcGFrIE5hcmF5YW5hbiBhbmQgUm9nZXIgV2FsZWZmZSBhbmQgSmltbXkgWmhhbmcgYW5kIEJvci1ZaWluZyBTdSBhbmQgR3V5dWUgSHVhbmcgYW5kIFRlcnJ5IEtvbmcgYW5kIFBhcnRoIENoYWRoYSBhbmQgU2FoaWwgSmFpbiBhbmQgQ2hyaXN0aW5lIEhhcnZleSBhbmQgRWxhZCBTZWdhbCBhbmQgSmluaW5nIEh1YW5nIGFuZCBTZXJnZXkgS2FzaGlyc2t5IGFuZCBSb2JlcnQgTWNRdWVlbiBhbmQgSXp6eSBQdXR0ZXJtYW4gYW5kIEdlb3JnZSBMYW0gYW5kIEFydW4gVmVua2F0ZXNhbiBhbmQgU2hlcnJ5IFd1IGFuZCBWaW5oIE5ndXllbiBhbmQgTWFub2ogS2lsYXJ1IGFuZCBBbmRyZXcgV2FuZyBhbmQgQW5uYSBXYXJubyBhbmQgQWJoaWxhc2ggU29tYXNhbXVkcmFtYXRoIGFuZCBTYW5kaXAgQmhhc2thciBhbmQgTWFrYSBEb25nIGFuZCBOYXZlIEFzc2FmIGFuZCBTaGFoYXIgTW9yIGFuZCBPbWVyIFVsbG1hbiBBcmdvdiBhbmQgU2NvdCBKdW5raW4gYW5kIE9sZWtzYW5kciBSb21hbmVua28gYW5kIFBlZHJvIExhcnJveSBhbmQgTW9uaWthIEthdGFyaXlhIGFuZCBNYXJjbyBSb3ZpbmVsbGkgYW5kIFZpamkgQmFsYXMgYW5kIE5pY2hvbGFzIEVkZWxtYW4gYW5kIEFuYWhpdGEgQmhpd2FuZGl3YWxsYSBhbmQgTXV0aHUgU3VicmFtYW5pYW0gYW5kIFNtaXRhIEl0aGFwZSBhbmQgS2FydGhpayBSYW1hbW9vcnRoeSBhbmQgWXV0aW5nIFd1IGFuZCBTdWd1bmEgVmFyc2hpbmkgVmVsdXJ5IGFuZCBPbXJpIEFsbW9nIGFuZCBKb3lqaXQgRGF3IGFuZCBEZW55cyBGcmlkbWFuIGFuZCBFcmljayBHYWxpbmtpbiBhbmQgTWljaGFlbCBFdmFucyBhbmQgS2F0aGVyaW5lIEx1bmEgYW5kIExlb24gRGVyY3p5bnNraSBhbmQgTmlra2kgUG9wZSBhbmQgRWlsZWVuIExvbmcgYW5kIFNldGggU2NobmVpZGVyIGFuZCBHdWlsbGVybW8gU2ltYW4gYW5kIFRvbWFzeiBHcnplZ29yemVrIGFuZCBQYWJsbyBSaWJhbHRhIGFuZCBNb25pa2EgS2F0YXJpeWEgYW5kIEpvZXkgQ29ud2F5IGFuZCBUcmlzaGEgU2FhciBhbmQgQW5uIEd1YW4gYW5kIEtyenlzenRvZiBQYXdlbGVjIGFuZCBTaHlhbWFsYSBQcmF5YWdhIGFuZCBPbGVrc2lpIEt1Y2hhaWV2IGFuZCBCb3JpcyBHaW5zYnVyZyBhbmQgT2x1d2F0b2JpIE9sYWJpeWkgYW5kIEthcmkgQnJpc2tpIGFuZCBKb25hdGhhbiBDb2hlbiBhbmQgQnJ5YW4gQ2F0YW56YXJvIGFuZCBKb25haCBBbGJlbiBhbmQgWW9uYXRhbiBHZWlmbWFuIGFuZCBFcmljIENodW5nIGFuZCBDaHJpcyBBbGV4aXVrfSxcbiAgICAgIHllYXI9ezIwMjV9LFxuICAgICAgZXByaW50PXsyNTA1LjAwOTQ5fSxcbiAgICAgIGFyY2hpdmVQcmVmaXg9e2FyWGl2fSxcbiAgICAgIHByaW1hcnlDbGFzcz17Y3MuQ0x9LFxuICAgICAgdXJsPXtodHRwczovL2FyeGl2Lm9yZy9hYnMvMjUwNS4wMDk0OX0sIFxufVxuYGBgIiwKICAgICJkaXNwbGF5TmFtZSI6ICJMbGFtYS0zLjMtbmVtb3Ryb24tc3VwZXItNDliLXYxLjUiLAogICAgImV4cGxhaW5hYmlsaXR5IjogIiMjIyAqKkV4cGxhaW5hYmlsaXR5KipcblxufCBGaWVsZDogfCBSZXNwb25zZTogfFxufCA6LS0tLSB8IDotLS0tIHxcbnwgSW50ZW5kZWQgQXBwbGljYXRpb24ocykgJiBEb21haW4ocyk6IHwgVGV4dCBnZW5lcmF0aW9uLCByZWFzb25pbmcsIHN1bW1hcml6YXRpb24sIGFuZCBxdWVzdGlvbiBhbnN3ZXJpbmcuICB8XG58IE1vZGVsIFR5cGU6IHwgVGV4dC10by10ZXh0IHRyYW5zZm9ybWVyIHxcbnwgSW50ZW5kZWQgVXNlcnM6IHwgVGhpcyBtb2RlbCBpcyBpbnRlbmRlZCBmb3IgZGV2ZWxvcGVycywgcmVzZWFyY2hlcnMsIGFuZCBjdXN0b21lcnMgYnVpbGRpbmcvdXRpbGl6aW5nIExMTXMsIHdoaWxlIGJhbGFuY2luZyBhY2N1cmFjeSBhbmQgZWZmaWNpZW5jeS4gfFxufCBPdXRwdXQ6IHwgVGV4dCBTdHJpbmcocykgfFxufCBEZXNjcmliZSBob3cgdGhlIG1vZGVsIHdvcmtzOiB8IEdlbmVyYXRlcyB0ZXh0IGJ5IHByZWRpY3RpbmcgdGhlIG5leHQgd29yZCBvciB0b2tlbiBiYXNlZCBvbiB0aGUgY29udGV4dCBwcm92aWRlZCBpbiB0aGUgaW5wdXQgc2VxdWVuY2UgdXNpbmcgbXVsdGlwbGUgc2VsZi1hdHRlbnRpb24gbGF5ZXJzLiB8XG58IFRlY2huaWNhbCBMaW1pdGF0aW9uczogfCBUaGUgbW9kZWwgd2FzIHRyYWluZWQgb24gZGF0YSB0aGF0IGNvbnRhaW5zIHRveGljIGxhbmd1YWdlLCB1bnNhZmUgY29udGVudCwgYW5kIHNvY2lldGFsIGJpYXNlcyBvcmlnaW5hbGx5IGNyYXdsZWQgZnJvbSB0aGUgaW50ZXJuZXQuIFRoZXJlZm9yZSwgdGhlIG1vZGVsIG1heSBhbXBsaWZ5IHRob3NlIGJpYXNlcyBhbmQgcmV0dXJuIHRveGljIHJlc3BvbnNlcyBlc3BlY2lhbGx5IHdoZW4gcHJvbXB0ZWQgd2l0aCB0b3hpYyBwcm9tcHRzLiBUaGUgbW9kZWwgbWF5IGdlbmVyYXRlIGFuc3dlcnMgdGhhdCBtYXkgYmUgaW5hY2N1cmF0ZSwgb21pdCBrZXkgaW5mb3JtYXRpb24sIG9yIGluY2x1ZGUgaXJyZWxldmFudCBvciByZWR1bmRhbnQgdGV4dCBwcm9kdWNpbmcgc29jaWFsbHkgdW5hY2NlcHRhYmxlIG9yIHVuZGVzaXJhYmxlIHRleHQsIGV2ZW4gaWYgdGhlIHByb21wdCBpdHNlbGYgZG9lcyBub3QgaW5jbHVkZSBhbnl0aGluZyBleHBsaWNpdGx5IG9mZmVuc2l2ZS4gVGhlIG1vZGVsIGRlbW9uc3RyYXRlcyB3ZWFrbmVzcyB0byBhbGlnbm1lbnQtYnJlYWtpbmcgYXR0YWNrcy4gVXNlcnMgYXJlIGFkdmlzZWQgdG8gZGVwbG95IGxhbmd1YWdlIG1vZGVsIGd1YXJkcmFpbHMgYWxvbmdzaWRlIHRoaXMgbW9kZWwgdG8gcHJldmVudCBwb3RlbnRpYWxseSBoYXJtZnVsIG91dHB1dHMuIFRoZSBNb2RlbCBtYXkgZ2VuZXJhdGUgYW5zd2VycyB0aGF0IGFyZSBpbmFjY3VyYXRlLCBvbWl0IGtleSBpbmZvcm1hdGlvbiwgb3IgaW5jbHVkZSBpcnJlbGV2YW50IG9yIHJlZHVuZGFudCB0ZXh0LiB8XG58IFZlcmlmaWVkIHRvIGhhdmUgbWV0IHByZXNjcmliZWQgcXVhbGl0eSBzdGFuZGFyZHM/IHwgWWVzIHxcbnwgUGVyZm9ybWFuY2UgTWV0cmljczogfCBBY2N1cmFjeSwgVGhyb3VnaHB1dCwgYW5kIHVzZXItc2lkZSB0aHJvdWdocHV0IHxcbnwgUG90ZW50aWFsIEtub3duIFJpc2tzOiB8IFRoZSBtb2RlbCB3YXMgb3B0aW1pemVkIGV4cGxpY2l0bHkgZm9yIGluc3RydWN0aW9uIGZvbGxvd2luZyBhbmQgYXMgc3VjaCBpcyBzdXNjZXB0aWJsZSB0byBwcm9tcHQgaW5qZWN0aW9uIGFuZCBqYWlsYnJlYWtpbmcgaW4gdmFyaW91cyBmb3JtcyBhcyBhIHJlc3VsdCBvZiBpdHMgaW5zdHJ1Y3Rpb24gdHVuaW5nLiBUaGUgbW9kZWwgc2hvdWxkIGJlIHBhaXJlZCB3aXRoIGFkZGl0aW9uYWwgcmFpbHMgb3Igc3lzdGVtIGZpbHRlcmluZyB0byBsaW1pdCBleHBvc3VyZSB0byBpbnN0cnVjdGlvbnMgZnJvbSBtYWxpY2lvdXMgc291cmNlcyAtLSBlaXRoZXIgZGlyZWN0bHkgb3IgaW5kaXJlY3RseSBieSByZXRyaWV2YWwgKGUuZy4gdmlhIHZpc2l0aW5nIGEgd2Vic2l0ZSkgLS0gYXMgdGhleSBtYXkgeWllbGQgb3V0cHV0cyB0aGF0IGNhbiBsZWFkIHRvIGhhcm1mdWwsIHN5c3RlbS1sZXZlbCBvdXRjb21lcyB1cCB0byBhbmQgaW5jbHVkaW5nIHJlbW90ZSBjb2RlIGV4ZWN1dGlvbiBpbiBhZ2VudGljIHN5c3RlbXMgd2hlbiBlZmZlY3RpdmUgc2VjdXJpdHkgY29udHJvbHMgaW5jbHVkaW5nIGd1YXJkcmFpbHMgYXJlIG5vdCBpbiBwbGFjZS5UaGUgbW9kZWwgd2FzIHRyYWluZWQgb24gZGF0YSB0aGF0IGNvbnRhaW5zIHRveGljIGxhbmd1YWdlIGFuZCBzb2NpZXRhbCBiaWFzZXMgb3JpZ2luYWxseSBjcmF3bGVkIGZyb20gdGhlIGludGVybmV0LiBUaGVyZWZvcmUsIHRoZSBtb2RlbCBtYXkgYW1wbGlmeSB0aG9zZSBiaWFzZXMgYW5kIHJldHVybiB0b3hpYyByZXNwb25zZXMgZXNwZWNpYWxseSB3aGVuIHByb21wdGVkIHdpdGggdG94aWMgcHJvbXB0cy4gVGhlIG1vZGVsIG1heSBnZW5lcmF0ZSBhbnN3ZXJzIHRoYXQgbWF5IGJlIGluYWNjdXJhdGUsIG9taXQga2V5IGluZm9ybWF0aW9uLCBvciBpbmNsdWRlIGlycmVsZXZhbnQgb3IgcmVkdW5kYW50IHRleHQgcHJvZHVjaW5nIHNvY2lhbGx5IHVuYWNjZXB0YWJsZSBvciB1bmRlc2lyYWJsZSB0ZXh0LCBldmVuIGlmIHRoZSBwcm9tcHQgaXRzZWxmIGRvZXMgbm90IGluY2x1ZGUgYW55dGhpbmcgZXhwbGljaXRseSBvZmZlbnNpdmUuIE1vZGVsIG91dHB1dCBzaG91bGQgYmUgYXBwcm9wcmlhdGVseSBlc2NhcGVkIGJlZm9yZSB2aWV3aW5nIG9yIG90aGVyIHByb2Nlc3NpbmcufFxufCBFbmQgVXNlciBMaWNlbnNlIEFncmVlbWVudDogfCBZb3VyIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIFNvZnR3YXJlIExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtc29mdHdhcmUtbGljZW5zZS1hZ3JlZW1lbnQvKSBhbmQgdGhlIFtQcm9kdWN0LVNwZWNpZmljIFRlcm1zIGZvciBOVklESUEgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzLyk7IGFuZCB0aGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgT3BlbiBNb2RlbCBMaWNlbnNlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtb3Blbi1tb2RlbC1saWNlbnNlLykuIEFkZGl0aW9uYWwgSW5mb3JtYXRpb246IFtMbGFtYSAzLjMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5sbGFtYS5jb20vbGxhbWEzXzMvbGljZW5zZS8pLiBCdWlsdCB3aXRoIExsYW1hLiB8IiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC04SjQ4LUFWOUQiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiLAogICAgICAgICJ0ZWNobm9sb2d5Om1vZGVsOnNvbG5fbnZpZGlhX2FpIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAicnR4NjAwMC1ibGFja3dlbGwtc3Z4NC1sYXRlbmN5LWJmMTYteW1vdWdwNWlmZyIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMTA3Njk1NjQ4MDM3LAogICAgImxvZ28iOiAiaHR0cHM6Ly9jYXRhbG9nLm5nYy5udmlkaWEuY29tL19uZXh0L2ltYWdlP3VybD1odHRwcyUzQSUyRiUyRmFzc2V0cy5uZ2MubnZpZGlhLmNvbSUyRnByb2R1Y3RzJTJGYXBpLWNhdGFsb2clMkZpbWFnZXMlMkZsbGFtYS0zXzMtbmVtb3Ryb24tNDliLWluc3RydWN0LmpwZyZ3PTY0MCZxPTkwIiwKICAgICJtb2RlbEZvcm1hdCI6ICJTYXZlZE1vZGVsIiwKICAgICJuYW1lIjogImxsYW1hLTMuMy1uZW1vdHJvbi1zdXBlci00OWItdjEuNSIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJPVEhFUiIsCiAgICAicHJpdmFjeSI6ICIjIyMgUHJpdmFjeVxuXG58RmllbGQ6fFJlc3BvbnNlOnxcbnw6LS0tOnw6LS0tOnxcbnxHZW5lcmF0YWJsZSBvciBSZXZlcnNlIGVuZ2luZWVyYWJsZSBwZXJzb25hbGx5LWlkZW50aWZpYWJsZSBpbmZvcm1hdGlvbj98Tm9uZXxcbnxXYXMgY29uc2VudCBvYnRhaW5lZCBmb3IgYW55IHBlcnNvbmFsIGRhdGEgdXNlZD98Tm9uZSBLbm93bnxcbnxQZXJzb25hbCBkYXRhIHVzZWQgdG8gY3JlYXRlIHRoaXMgbW9kZWw/fE5vbmUgS25vd258XG58SG93IG9mdGVuIGlzIGRhdGFzZXQgcmV2aWV3ZWQ/fEJlZm9yZSBSZWxlYXNlfFxufElzIHRoZXJlIHByb3ZlbmFuY2UgZm9yIGFsbCBkYXRhc2V0cyB1c2VkIGluIHRyYWluaW5nP3xZZXN8XG58RG9lcyBkYXRhIGxhYmVsaW5nIChhbm5vdGF0aW9uLCBtZXRhZGF0YSkgY29tcGx5IHdpdGggcHJpdmFjeSBsYXdzP3xZZXN8XG58QXBwbGljYWJsZSBOVklESUEgUHJpdmFjeSBQb2xpY3l8aHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hYm91dC1udmlkaWEvcHJpdmFjeS1wb2xpY3kvfCIsCiAgICAicHJvZHVjdE5hbWVzIjogWwogICAgICAgICJuaW0tZGV2IiwKICAgICAgICAibnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAicHVibGljRGF0YXNldFVzZWQiOiB7fSwKICAgICJwdWJsaXNoZXIiOiAiTlZJRElBIiwKICAgICJzYWZldHlBbmRTZWN1cml0eSI6ICIjIyMgU2FmZXR5ICYgU2VjdXJpdHlcblxufEZpZWxkOnxSZXNwb25zZTp8XG58Oi0tLTp8Oi0tLTp8XG58TW9kZWwgQXBwbGljYXRpb24ocyk6fENoYXQsIEluc3RydWN0aW9uIEZvbGxvd2luZywgQ2hhdGJvdCBEZXZlbG9wbWVudCwgQ29kZSBHZW5lcmF0aW9uLCBSZWFzb25pbmd8XG58RGVzY3JpYmUgbGlmZSBjcml0aWNhbCBhcHBsaWNhdGlvbiAoaWYgcHJlc2VudCk6fE5vbmUgS25vd24gKHBsZWFzZSBzZWUgcmVmZXJlbmNlZCBLbm93biBSaXNrcyBpbiB0aGUgRXhwbGFpbmFiaWxpdHkgc3ViY2FyZCkufFxufFVzZSBDYXNlIFJlc3RyaWN0aW9uczp8WW91ciB1c2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LykgYW5kIHRoZSBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cy8pOyBhbmQgdGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIE9wZW4gTW9kZWwgTGljZW5zZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLW9wZW4tbW9kZWwtbGljZW5zZS8pLiBBZGRpdGlvbmFsIEluZm9ybWF0aW9uOiBbTGxhbWEgMy4zIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18zL2xpY2Vuc2UvKS4gQnVpbHQgd2l0aCBMbGFtYS4gfCIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJMbGFtYS0zLjMtTmVtb3Ryb24tU3VwZXItNDlCLXYxLjUgaXMgYSBzaWduaWZpY2FudGx5IHVwZ3JhZGVkIHZlcnNpb24gb2YgTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MSBhbmQgaXMgYSBsYXJnZSBsYW5ndWFnZSBtb2RlbCAoTExNKSB3aGljaCBpcyBhIGRlcml2YXRpdmUgb2YgTWV0YSBMbGFtYS0zLjMtNzBCLUluc3RydWN0IiwKICAgICJ0ZWFtTmFtZSI6ICJudmlkaWEiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMTAtMTdUMTg6MDQ6MDMuNTcyWiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama-3.3-nemotron-super-49b-v1.5 optimizationProfiles: - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:a100x2-throughput-bf16-wcsztflslq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A100x2 BF16 Throughput ngcMetadata: 03fdf4e63960724f08647e43122aab89748cf69f8e180c64fab6370abee11c41: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ae4d6417367534d6b999876248c3591165a546df619a27fe6460b92aa44e7f88 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx4 BF16 Latency ngcMetadata: 0634edcf356b10f286d7a9ff5b5a0798a2616208e5c3b891aed4394fc504b0a1: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4e1be52ab36b863d4abb3e4e549f1f8150d8fe59bf3021012b9eddbb124bf1a8 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x1-throughput-nvfp4-yqo6gpzgtw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x1 NVFP4 Throughput ngcMetadata: 097e7abb70716b35f220ddfa9f1beafc1872b83d2faae76087c5981875c172d7: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e1bde03fd878742322841e5871f1182069b936b6c4517c9b2d07c94d8c7e8ebf number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:l40sx4-throughput-bf16-lb51ks7uxa framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 L40Sx4 BF16 Throughput ngcMetadata: 0d0c380f456551cf0c7d94cba5df94a6679bf13bfcec35518dd4700277c45d6d: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 303af23d9df7615161cd22feb968e97571f32f341e3567ec57a5405fc513e452 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:b200x2-latency-bf16-srzmz11lsq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 B200x2 BF16 Latency ngcMetadata: 0de4288607eed4d3b8fc4437cc7b7660d927d0ba9265f95f4c49191a69701446: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f96591a267ca466ff8d50fe13273091238ce4066f7da0533206572ac09da1eff number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:l40sx4-latency-fp8-csbsvltszw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 L40Sx4 FP8 Latency ngcMetadata: 1080a2945bccdf2773330d1ff5041b953088cb90e76c0a29ccddde3edb10fa48: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 76c65c985bc5acb124613d1c2854d8ca1908efc80cb6bdda6ebecf814f6f9932 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 50GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h100x2-latency-fp8-sowqqe--5a framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100x2 FP8 Latency ngcMetadata: 1f01cd4066c857f8982fcd8f7e7d7e4920c1e77ef50c8e0e9451815ec3d6590c: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6418fea1651154d4141be9df22ee889d55ee1e07eb23327386cfd21ed7e48917 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:a10gx8-throughput-bf16-4fcffqprja framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A10Gx8 BF16 Throughput ngcMetadata: 282c3be83f0772b985e007af291125cc8ecd4befc2833a96feefecfe49a6a116: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d50bef030c2c86675a058f6a7b4132438d8558afead641fa45c70cb431631be3 number_of_gpus: '8' pp: '2' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x2-latency-nvfp4-3sifj870lq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x2 NVFP4 Latency ngcMetadata: 2a721971fe1905d88e8281b2804ffd900bbd20704482e07eb1dee03ca7ee1f26: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 21113f03af084c245046a894ef0cce875ebb362781b1e2d70774b919dfc08b7b number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__2 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A100_SXM4_40GBx4 BF16 Throughput ngcMetadata: 2da0154c6a5ddf2d67aae37fd8a276f7fb54d69ebf9c2fe631c9cb9721912c10: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a5b791bd084d0d196d8eab3a5ee30584c4b5154b68e27d4ae27240c572aaa0c3 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 4 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__3 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx1 FP8 Throughput ngcMetadata: 317edefe0e4f3253972892af7f1f8bb0787c39eaac22e54947bbd21c64c105de: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 93ae1647a06301ebae5535fc2a127f5149c5ffe3f63f99443eac45c342b36bf9 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__4 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200_NVLx1 FP8 Throughput ngcMetadata: 37aa8cad01613034db7185edd866ca513104bf5b87447a9ea373ddc475141a38: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7640e168db96daafc2278c529e4ea7e93a9751774a361437b064f6542fa8400a number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x1-throughput-bf16-b7mc0n5vsq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x1 BF16 Throughput ngcMetadata: 3a1966db19d49667baa129a4838553168a4c66202dae42b3da82d34e0254dda9: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 56e98fd149cfe53aa5e62c155e6903b2254d7084850bfb5ea65bcd05e9fb416c number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 94GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__5 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx2 NVFP4 Throughput ngcMetadata: 3e02aabd0df7fb43fd55db667ddc61b9c1c6b2962aa3f2bfd0aa8d2206aa5ccd: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b22fdd19cd522ea34c068f776b07b38474bd419dd4bed6cb6ba3cb56376437fa number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h100x2-throughput-bf16-sfp5psfsoa framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100x2 BF16 Throughput ngcMetadata: 3f000887cbabfb954b87cbdafed85aeec51c82e5c941801c67a0fbb6bdbfbed5: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 037bea81c2da8987458de8a0e326c12c574c09048e1d80a027a73b6f6b553e06 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__6 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100_NVLx1 FP8 Throughput ngcMetadata: 4138603595d590ef014e6b18a034c8d6b6f7addc09e83ce2f97fe3d6b5502658: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3557dd611c5250fc7498c009ad75ec1ffdd75dd591e69de8efdfd0ad379871b5 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__7 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GH200_144GBx1 BF16 Throughput ngcMetadata: 439a0279d35d96d6b3c8be1f22f92a94d7e874e2476a58dc868b600861c84428: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ab0c91b93211e813ba1ef7fc61abd40d74c1babafe9d323e3dcddc74008f4cf3 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__8 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx1 NVFP4 Throughput ngcMetadata: 496a3bcf32f7c7e81e59b1c17395d49b6c412dcb9e94d1bd4675c7ab61ed4b8c: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c93c0eb2422047add4d8c0141d90bab8840448b965f75976ac669b97d7934cca number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__9 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100_NVLx2 BF16 Throughput ngcMetadata: 4eb1789fe7a9ba85b6915c1f6ab6423be03ad2b7660fd17ccadfca11a9cea20e: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 61175440372bb9eb41cd7d5f3de3cb8aa05ab8ab84483ab3bb2580cdf9edb50f number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:a100x4-latency-bf16-qfav5fnhta framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A100x4 BF16 Latency ngcMetadata: 4ecfbc0680c47e40c54811d7d056bd8c2cb17410671da1d5a9d94f37e0e9ddd9: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4b36e4728a079ec71833e5b851ba55816893bae8c6b3e028c7092783d51380b6 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 4 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x2-latency-fp8-hh-qiitbsq framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x2 FP8 Latency ngcMetadata: 5104fad3c90f0e82d48218e2f295ecc76413a75f7828902f6201cdce8e11f119: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: eb379d36e7d269b0f9dedded8c2295fe06009c4792c2faebeee87520382b4a79 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h200x4-latency-bf16-gwrdidufkg framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200x4 BF16 Latency ngcMetadata: 5375ff8c01b5f03cc5226403b75091b280f9ab3b4901e4ddf08effd37f3be185: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 66667c721d5d8a4380827673282e501ca94da891407d35e1c4212606fc217cd4 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 4 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__10 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx2 NVFP4 Latency ngcMetadata: 556dcaf16db7138e6cadd8e2a194caed98ad4d5be6c5d2f2638b4517f6d8a2f2: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7f399c329c773521d095cda5f5da78429a9a12497dc5e0a107b30250e7af3c9e number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__11 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100_NVLx2 FP8 Latency ngcMetadata: 557fec5cda76abb3bda2a196e908b91a4f97b18c0bab1fbc1e32927e131722f0: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0eb8ad98ede42e79a11f7439000dbc224363a640c2c03a7c0415d9d84852109c number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:b200x1-throughput-bf16-ypw69-37kw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 B200x1 BF16 Throughput ngcMetadata: 5c181a5c2c72785a8c062e4f8b197d404caa754117731b76dfc612c4751392a8: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f9bff6c55a835edfed0cf54e1d92d121be400ddbe8bca9a14cae0406b129a700 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 94GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__12 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx2 FP8 Latency ngcMetadata: 610f006b15f3adbdb072da0b4155d8a772332cf1768fb7389ef92a83c31c26dc: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c791be936f92f5cb480fbae429dff3fac2d0e7f1a3d3396e78196029b9a0d395 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__13 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GH200_480GBx1 FP8 Throughput ngcMetadata: 67fefe5a60111523b327e93282aabb0bee010780482d12aed22032fae947e6db: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f677672ff3da6e403ae52655aa3a37c53289547b58bc22c64c39364d755ac363 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x2-latency-bf16-ql0dncdzug framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x2 BF16 Latency ngcMetadata: 6988d6b50d4c8c0d12579128b9ceb6dfd239d91ecc1b0dcaf6b2d5235a785f41: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3ba2484ae0c038d20cd5f4add3a088742233193c5f9c7d16c55384ddd5ad1f78 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 96GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:gb200x1-throughput-fp8-eqspsgvc4g framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GB200x1 FP8 Throughput ngcMetadata: 721782adb8e04decd419a5d5fd5138ea578840ce23ae878cd66b5ade58b64860: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6dd43f5bf34d55e342b12dceabe739dc65b70b1c652b32e33158dda0176938b6 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:b200x1-throughput-nvfp4-lzk6scakha framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 B200x1 NVFP4 Throughput ngcMetadata: 878da3cd983e1c204b447eaf6c2b1fbe15df8e3f8606dba0276dc5db6f1b2ea3: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ed7366f0b3c56148342e9281e92f74ebd0117e45028b50f4b5080474ca08579f number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:l40sx4-latency-bf16-fcnx7qsagw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 L40Sx4 BF16 Latency ngcMetadata: 8b3a0a14508070667a00aa2bec26a373d078db79903603585127a2a33a437dcd: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3eebbad6ddd7f86f084cafbaa2774c9b68814be840c5117b1e8f42bd4609a154 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__14 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200_NVLx2 BF16 Latency ngcMetadata: 901ae99dec61c02334df6c00217c665e620b03efaccd7ecbfedee9dd5b919e2c: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0f967f12c738cdeba2e1f6f507f6519b0e70fe691a3d85cc6f275bfa6cebaab0 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h100x4-latency-bf16-c7ags8vtqa framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100x4 BF16 Latency ngcMetadata: a14acaea6216232b3dd9ff678dd04b239a48f8ef7eec367c8ba121aa93bc3699: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 79c4e912efae2b6e2670be80c6b16cf7d5a8d41658e3bdf6f0d7b72dc5d58634 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h200x1-throughput-fp8-tnrs6lwhqg framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200x1 FP8 Throughput ngcMetadata: a55bb618b06a37fd61e99000a8ba38375801c0879c67a7a1b5a66cd497e09817: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c8b0bc8703bb921bcde98b731a73ba8a5223b4cc331b1f6ec52c97c0fb7eb334 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__15 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200_NVLx2 FP8 Latency ngcMetadata: a5b40bd2025de323418db8d8577d91ad1c4c1b2143219fd9661c679e317af0fe: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 77041070f5f0dbe334cd51ed68930e5768eb93f59aff9f374f380e732fb3b078 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:b200x1-throughput-fp8-ueeogrvolw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 B200x1 FP8 Throughput ngcMetadata: b29ee8752b78d7d6a588e68487d9dd9f8ceaa2a01964f09c49ae9d7512a0e425: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0c5dc1a2f374f41aba6887d42b8f2497e43e32931426f33220897c481b121300 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__16 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200_NVLx1 BF16 Throughput ngcMetadata: b3c7e84a0d005d532b307e36b9956be0b169a791283fd5362fa7326c1d442516: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 74e8a2780520f4deb4b75fe91dfb53dc33ab212294b755cb654dfcfbd720bea0 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:b200x2-latency-fp8-kwktcc65kw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 B200x2 FP8 Latency ngcMetadata: b9cd24c06efe599256f1cbc69e32686bf837e634d6d72754124a3d2db6a69415: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 91ac13ed5c5bcacd46af55350326af80781385cbf9ee70b426583319f1972bcb number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__17 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GH200_144GBx2 FP8 Latency ngcMetadata: bee87c5b924821f18e4f18f9b63509e00d105053e9c0ed00440235219cc4c355: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4c34e6ff5408a3c795f72d84ad93d221975854695c77a2c49a03c94e288ebd7e number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__18 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100_NVLx4 BF16 Latency ngcMetadata: cdc6d143f3c8ae40bef086616fe918badef8b5d8c2f7ed7bf35c46efc664f1d2: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7acb071a5e1043fb94515e5b7a4209955aa7b1a7f9311e43a96d525f36124582 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__19 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A100_SXM4_40GBx8 BF16 Latency ngcMetadata: d1a6703d5e49f81f492115bcd2fbb3d8f654fb74c7871374a0aba53e268f7eb7: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a491d0c85fd9304f23dc12098011ac5a7f06323c7f1bf5a03930512eab8bc661 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__20 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 RTX6000_BLACKWELL_SVx2 BF16 Throughput ngcMetadata: d74a0a1011908274b71ca777cadb98fb50eb4d1b03f293c4961dfffd685fa77c: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a43faa67d15febf569c0cc2520243017faa2f85e955b0da68f0819b562b0f746 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:l40sx4-throughput-fp8-grh3fk4vxa framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 L40Sx4 FP8 Throughput ngcMetadata: dd6e06ce56d8c23034792ecfafa9cad84e89381646f1a6b3f61e64d5c7151cca: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c218e34971f85acf3ff928121f744f142c144926bface213142ca6abe6d08527 number_of_gpus: '4' pp: '1' precision: fp8 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 50GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h200x2-latency-fp8-qionglmjjw framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200x2 FP8 Latency ngcMetadata: e76d9a6e681f5047d58bb835cd1144df8a4c07cbd5e11340d9e841a34639c6ac: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7fd4e15ecac33d4ebf1f8b32433b45177d6701b159d35a262c363fd67aab00ca number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__21 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GH200_144GBx2 BF16 Latency ngcMetadata: ecad5bd2fe50b96e275be4aede45e63ccacb4943719a70a76183ac78cb7b2602: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0863fbe7a8909618c897d216a1a1df5e66eb44030a0421496f854e0bc52bb041 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h200x1-throughput-bf16-jvvivxsong framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H200x1 BF16 Throughput ngcMetadata: ee058f1abbfe0cc174b16c966b91cfe886c7bb247fc691d8c7c8fee3dc9c8f41: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 493e3f3ab5031da3fd826eb8ef23ea20e87af83cae500214e295fbeca9003e55 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 94GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:a10gx8-latency-bf16-ejd7ve2qag framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 A10Gx8 BF16 Latency ngcMetadata: ef9c1ac2f14b38895123c608a25f0104c42557f617c91e8ef6e151bc601822de: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7c853ac2150b03fff0d81df21fed77d789c5254f9f440e32844c93d073f5e43f number_of_gpus: '8' pp: '2' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 100GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:h100x1-throughput-fp8-zmf7sc5wtg framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 H100x1 FP8 Throughput ngcMetadata: f5e04275ea0d3bd001a2262e85e47de206406d9593d74525074a25475dc47a22: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e96f0bba12e9e5e054f193562c51161b61804d52ba2bff7a49bf8aa267a1c2b2 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 49GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama-3.3-nemotron-super-49b-v1.5:hf-f091ea1-fix-chat-template-jet__22 framework: TensorRT-LLM displayName: Llama 3.3 Nemotron Super 49B V1.5 GH200_144GBx1 FP8 Throughput ngcMetadata: f97be1c404cf80299a3d85359c32a28710a3251c6ed6eec2dd3f3bdce2ca2903: model: nvidia/llama-3.3-nemotron-super-49b-v1.5 release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 911352dda31a6b8811db6e5dc7c573094dadfc2354bee8cd0f41e784e79fc6f6 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 93GB - key: LLM ENGINE value: TENSORRT_LLM labels: - Llama - Chatbots - Virtual Assistants - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Llama 3.1 Nemotron Nano displayName: Llama 3.1 Nemotron Nano modelHubID: llama-3.1-nemotron-nano category: Language type: NGC description: Llama 3.1 Nemotron Nano 8B or 4B is a language model that can follow instructions, complete requests, and generate creative text formats. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: Llama 3.1 Nemotron Nano 4b V1.1 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifEZpZWxkOnxSZXNwb25zZTp8XG58Oi0tLTp8Oi0tLTp8XG58UGFydGljaXBhdGlvbiBjb25zaWRlcmF0aW9ucyBmcm9tIGFkdmVyc2VseSBpbXBhY3RlZCBncm91cHMgKHByb3RlY3RlZCBjbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3Rpbmc6fE5vbmV8XG58TWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzOnxOb25lfCIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjUtMDYtMDVUMTc6MjY6MjguMjExWiIsCiAgICAiZGVzY3JpcHRpb24iOiAiIyMgTW9kZWwgT3ZlcnZpZXcgXG5cbkxsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLTRCLXYxLjEgaXMgYSBsYXJnZSBsYW5ndWFnZSBtb2RlbCAoTExNKSByZWFzb25pbmcgbW9kZWwgdGhhdCBpcyBwb3N0IHRyYWluZWQgZm9yIHJlYXNvbmluZywgaHVtYW4gY2hhdCBwcmVmZXJlbmNlcywgYW5kIHRhc2tzLCBzdWNoIGFzIFJBRyBhbmQgdG9vbCBjYWxsaW5nLiBJdCAgaXMgYSBkZXJpdmF0aXZlIG9mIFtudmlkaWEvTGxhbWEtMy4xLU1pbml0cm9uLTRCLVdpZHRoLUJhc2VdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbnZpZGlhL0xsYW1hLTMuMS1NaW5pdHJvbi00Qi1XaWR0aC1CYXNlKSwgd2hpY2ggaXMgY3JlYXRlZCBmcm9tIExsYW1hIDMuMSA4QiB1c2luZyBbb3VyIExMTSBjb21wcmVzc2lvbiB0ZWNobmlxdWVdKGh0dHBzOi8vYXJ4aXYub3JnL2Ficy8yNDA4LjExNzk2KSBhbmQgb2ZmZXJzIGltcHJvdmVtZW50cyBpbiBtb2RlbCBhY2N1cmFjeSBhbmQgZWZmaWNpZW5jeS4gXG5cbkxsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLTRCLXYxLjEgaXMgYSBtb2RlbCB3aGljaCBvZmZlcnMgYSBncmVhdCB0cmFkZW9mZiBiZXR3ZWVuIG1vZGVsIGFjY3VyYWN5IGFuZCBlZmZpY2llbmN5LiBUaGUgbW9kZWwgZml0cyBvbiBhIHNpbmdsZSBSVFggR1BVIGFuZCBjYW4gYmUgdXNlZCBsb2NhbGx5LiBUaGUgbW9kZWwgc3VwcG9ydHMgYSBjb250ZXh0IGxlbmd0aCBvZiAxMjhLLlxuXG5UaGlzIG1vZGVsIHVuZGVyd2VudCBhIG11bHRpLXBoYXNlIHBvc3QtdHJhaW5pbmcgcHJvY2VzcyB0byBlbmhhbmNlIGJvdGggaXRzIHJlYXNvbmluZyBhbmQgbm9uLXJlYXNvbmluZyBjYXBhYmlsaXRpZXMuIFRoaXMgaW5jbHVkZXMgYSBzdXBlcnZpc2VkIGZpbmUtdHVuaW5nIHN0YWdlIGZvciBNYXRoLCBDb2RlLCBSZWFzb25pbmcsIGFuZCBUb29sIENhbGxpbmcgYXMgd2VsbCBhcyBtdWx0aXBsZSByZWluZm9yY2VtZW50IGxlYXJuaW5nIChSTCkgc3RhZ2VzIHVzaW5nIFJld2FyZC1hd2FyZSBQcmVmZXJlbmNlIE9wdGltaXphdGlvbiAoUlBPKSBhbGdvcml0aG1zIGZvciBib3RoIGNoYXQgYW5kIGluc3RydWN0aW9uLWZvbGxvd2luZy4gVGhlIGZpbmFsIG1vZGVsIGNoZWNrcG9pbnQgaXMgb2J0YWluZWQgYWZ0ZXIgbWVyZ2luZyB0aGUgZmluYWwgU0ZUIGFuZCBSUE8gY2hlY2twb2ludHNcblxuVGhpcyBtb2RlbCBpcyBwYXJ0IG9mIHRoZSBMbGFtYSBOZW1vdHJvbiBDb2xsZWN0aW9uLiBZb3UgY2FuIGZpbmQgdGhlIG90aGVyIG1vZGVsKHMpIGluIHRoaXMgZmFtaWx5IGhlcmU6IFxuLSBbTGxhbWEtMy4zLU5lbW90cm9uLVVsdHJhLTI1M0ItdjFdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbnZpZGlhL0xsYW1hLTNfMS1OZW1vdHJvbi1VbHRyYS0yNTNCLXYxKVxuLSBbTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9udmlkaWEvTGxhbWEtMy4zLU5lbW90cm9uLVN1cGVyLTQ5Qi12MSlcbi0gW0xsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLThCLXYxXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL252aWRpYS9MbGFtYS0zLjEtTmVtb3Ryb24tTmFuby04Qi12MSlcblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UuXG5cbiMjIExpY2Vuc2UvVGVybXMgb2YgVXNlXG5cblRoZSBOSU0gY29udGFpbmVyIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIFNvZnR3YXJlIExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtc29mdHdhcmUtbGljZW5zZS1hZ3JlZW1lbnQpIGFuZCBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cykuIFlvdXIgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgT3BlbiBNb2RlbCBMaWNlbnNlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtb3Blbi1tb2RlbC1saWNlbnNlLykuIEFkZGl0aW9uYWwgSW5mb3JtYXRpb246IFtMbGFtYSAzLjEgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5sbGFtYS5jb20vbGxhbWEzXzEvbGljZW5zZSkuIEJ1aWx0IHdpdGggTGxhbWEuXG5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuKipNb2RlbCBEZXZlbG9wZXI6KiogTlZJRElBXG5cbioqTW9kZWwgRGF0ZXM6KiogVHJhaW5lZCBiZXR3ZWVuIEF1Z3VzdCAyMDI0IGFuZCBBcHJpbCAyMDI1XG5cbioqRGF0YSBGcmVzaG5lc3M6KiogVGhlIHByZXRyYWluaW5nIGRhdGEgaGFzIGEgY3V0b2ZmIG9mIDIwMjMgcGVyIE1ldGEgTGxhbWEgMy4xIDhCXG5cblxuIyMgVXNlIENhc2U6IFxuXG5EZXZlbG9wZXJzIGRlc2lnbmluZyBBSSBBZ2VudCBzeXN0ZW1zLCBjaGF0Ym90cywgUkFHIHN5c3RlbXMsIGFuZCBvdGhlciBBSS1wb3dlcmVkIGFwcGxpY2F0aW9ucy4gQWxzbyBzdWl0YWJsZSBmb3IgdHlwaWNhbCBpbnN0cnVjdGlvbi1mb2xsb3dpbmcgdGFza3MuIEJhbGFuY2Ugb2YgbW9kZWwgYWNjdXJhY3kgYW5kIGNvbXB1dGUgZWZmaWNpZW5jeSAodGhlIG1vZGVsIGZpdHMgb24gYSBzaW5nbGUgUlRYIEdQVSBhbmQgY2FuIGJlIHVzZWQgbG9jYWxseSkuXG5cbiMjIFJlbGVhc2UgRGF0ZTogPGJyPlxuTkdDOiBNYXkgMjAyNSA8YnI+XG5cbiMjIFJlZmVyZW5jZXNcblxuLSBbXFxbMjUwMi4wMDIwM1xcXSBSZXdhcmQtYXdhcmUgUHJlZmVyZW5jZSBPcHRpbWl6YXRpb246IEEgVW5pZmllZCBNYXRoZW1hdGljYWwgRnJhbWV3b3JrIGZvciBNb2RlbCBBbGlnbm1lbnRdKGh0dHBzOi8vYXJ4aXYub3JnL2Ficy8yNTAyLjAwMjAzKVxuXG5cbiMjIE1vZGVsIEFyY2hpdGVjdHVyZVxuXG4qKkFyY2hpdGVjdHVyZSBUeXBlOioqIERlbnNlIGRlY29kZXItb25seSBUcmFuc2Zvcm1lciBtb2RlbFxuXG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIFtMbGFtYSAzLjEgTWluaXRyb24gV2lkdGggNEIgQmFzZV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9udmlkaWEvTGxhbWEtMy4xLU1pbml0cm9uLTRCLVdpZHRoLUJhc2UpXG5cbiMjIEludGVuZGVkIHVzZVxuXG5MbGFtYS0zLjEtTmVtb3Ryb24tTmFuby00Qi12MS4xIGlzIGEgZ2VuZXJhbCBwdXJwb3NlIHJlYXNvbmluZyBhbmQgY2hhdCBtb2RlbCBpbnRlbmRlZCB0byBiZSB1c2VkIGluIEVuZ2xpc2ggYW5kIGNvZGluZyBsYW5ndWFnZXMuIE90aGVyIG5vbi1FbmdsaXNoIGxhbmd1YWdlcyAoR2VybWFuLCBGcmVuY2gsIEl0YWxpYW4sIFBvcnR1Z3Vlc2UsIEhpbmRpLCBTcGFuaXNoLCBhbmQgVGhhaSkgYXJlIGFsc28gc3VwcG9ydGVkLiBcblxuIyBJbnB1dDpcbi0gKipJbnB1dCBUeXBlOioqIFRleHRcbi0gKipJbnB1dCBGb3JtYXQ6KiogU3RyaW5nXG4tICoqSW5wdXQgUGFyYW1ldGVyczoqKiBPbmUtRGltZW5zaW9uYWwgKDFEKVxuLSAqKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBJbnB1dDoqKiBDb250ZXh0IGxlbmd0aCB1cCB0byAxMzEsMDcyIHRva2Vuc1xuXG4jIyBPdXRwdXQ6XG4tICoqT3V0cHV0IFR5cGU6KiogVGV4dFxuLSAqKk91dHB1dCBGb3JtYXQ6KiogU3RyaW5nXG4tICoqT3V0cHV0IFBhcmFtZXRlcnM6KiogT25lLURpbWVuc2lvbmFsICgxRClcbi0gKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0OioqIENvbnRleHQgbGVuZ3RoIHVwIHRvIDEzMSwwNzIgdG9rZW5zXG5cbiMjIE1vZGVsIFZlcnNpb246XG4xLjAgKEFwcmlsIDIwMjUpXG5cbiMjIFNvZnR3YXJlIEludGVncmF0aW9uXG4tICoqUnVudGltZSBFbmdpbmU6KiogTmVNbyAyNC4xMiA8YnI+XG4gIFxuLSAqKlJlY29tbWVuZGVkIEhhcmR3YXJlIE1pY3JvYXJjaGl0ZWN0dXJlIENvbXBhdGliaWxpdHk6KipcbiAgICAtIE5WSURJQSBBbXBlcmVcbiAgICAtIE5WSURJQSBIb3BwZXJcbi0gKipQcmVmZXJyZWQvU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW06KiogTGludXggPGJyPlxuXG4jIyBRdWljayBTdGFydCBhbmQgVXNhZ2UgUmVjb21tZW5kYXRpb25zOlxuXG4xLiBSZWFzb25pbmcgbW9kZSAoT04vT0ZGKSBpcyBjb250cm9sbGVkIHZpYSB0aGUgc3lzdGVtIHByb21wdCwgd2hpY2ggbXVzdCBiZSBzZXQgYXMgc2hvd24gaW4gdGhlIGV4YW1wbGUgYmVsb3cuIEFsbCBpbnN0cnVjdGlvbnMgc2hvdWxkIGJlIGNvbnRhaW5lZCB3aXRoaW4gdGhlIHVzZXIgcHJvbXB0XG4yLiBXZSByZWNvbW1lbmQgc2V0dGluZyB0ZW1wZXJhdHVyZSB0byBgMC42YCwgYW5kIFRvcCBQIHRvIGAwLjk1YCBmb3IgUmVhc29uaW5nIE9OIG1vZGVcbjMuIFdlIHJlY29tbWVuZCB1c2luZyBncmVlZHkgZGVjb2RpbmcgZm9yIFJlYXNvbmluZyBPRkYgbW9kZVxuNC4gV2UgaGF2ZSBwcm92aWRlZCBhIGxpc3Qgb2YgcHJvbXB0cyB0byB1c2UgZm9yIGV2YWx1YXRpb24gZm9yIGVhY2ggYmVuY2htYXJrIHdoZXJlIGEgc3BlY2lmaWMgdGVtcGxhdGUgaXMgcmVxdWlyZWRcblxuU2VlIHRoZSBzbmlwcGV0IGJlbG93IGZvciB1c2FnZSB3aXRoIEh1Z2dpbmcgRmFjZSBUcmFuc2Zvcm1lcnMgbGlicmFyeS4gUmVhc29uaW5nIG1vZGUgKE9OL09GRikgaXMgY29udHJvbGxlZCB2aWEgc3lzdGVtIHByb21wdC4gUGxlYXNlIHNlZSB0aGUgZXhhbXBsZSBiZWxvdy5cbk91ciBjb2RlIHJlcXVpcmVzIHRoZSB0cmFuc2Zvcm1lcnMgcGFja2FnZSB2ZXJzaW9uIHRvIGJlIGA0LjQ0LjJgIG9yIGhpZ2hlci5cblxuXG4jIyMgRXhhbXBsZSBvZiBcdTIwMWNSZWFzb25pbmcgT246XHUyMDFkXG5cbmBgYHB5dGhvblxuaW1wb3J0IHRvcmNoXG5pbXBvcnQgdHJhbnNmb3JtZXJzXG5cbm1vZGVsX2lkID0gXCJudmlkaWEvTGxhbWEtMy4xLU5lbW90cm9uLU5hbm8tNEItdjEuMVwiXG5tb2RlbF9rd2FyZ3MgPSB7XCJ0b3JjaF9kdHlwZVwiOiB0b3JjaC5iZmxvYXQxNiwgXCJkZXZpY2VfbWFwXCI6IFwiYXV0b1wifVxudG9rZW5pemVyID0gdHJhbnNmb3JtZXJzLkF1dG9Ub2tlbml6ZXIuZnJvbV9wcmV0cmFpbmVkKG1vZGVsX2lkKVxudG9rZW5pemVyLnBhZF90b2tlbl9pZCA9IHRva2VuaXplci5lb3NfdG9rZW5faWRcblxucGlwZWxpbmUgPSB0cmFuc2Zvcm1lcnMucGlwZWxpbmUoXG4gICBcInRleHQtZ2VuZXJhdGlvblwiLFxuICAgbW9kZWw9bW9kZWxfaWQsXG4gICB0b2tlbml6ZXI9dG9rZW5pemVyLFxuICAgbWF4X25ld190b2tlbnM9MzI3NjgsXG4gICB0ZW1wZXJhdHVyZT0wLjYsXG4gICB0b3BfcD0wLjk1LFxuICAgKiptb2RlbF9rd2FyZ3NcbilcblxuIyBUaGlua2luZyBjYW4gYmUgXCJvblwiIG9yIFwib2ZmXCJcbnRoaW5raW5nID0gXCJvblwiXG5cbnByaW50KHBpcGVsaW5lKFt7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBmXCJkZXRhaWxlZCB0aGlua2luZyB7dGhpbmtpbmd9XCJ9LCB7XCJyb2xlXCI6IFwidXNlclwiLCBcImNvbnRlbnRcIjogXCJTb2x2ZSB4KihzaW4oeCkrMik9MFwifV0pKVxuYGBgXG5cblxuIyMjIEV4YW1wbGUgb2YgXHUyMDFjUmVhc29uaW5nIE9mZjpcdTIwMWRcblxuYGBgcHl0aG9uXG5pbXBvcnQgdG9yY2hcbmltcG9ydCB0cmFuc2Zvcm1lcnNcblxubW9kZWxfaWQgPSBcIm52aWRpYS9MbGFtYS0zLjEtTmVtb3Ryb24tTmFuby00Qi12MVwiXG5tb2RlbF9rd2FyZ3MgPSB7XCJ0b3JjaF9kdHlwZVwiOiB0b3JjaC5iZmxvYXQxNiwgXCJkZXZpY2VfbWFwXCI6IFwiYXV0b1wifVxudG9rZW5pemVyID0gdHJhbnNmb3JtZXJzLkF1dG9Ub2tlbml6ZXIuZnJvbV9wcmV0cmFpbmVkKG1vZGVsX2lkKVxudG9rZW5pemVyLnBhZF90b2tlbl9pZCA9IHRva2VuaXplci5lb3NfdG9rZW5faWRcblxucGlwZWxpbmUgPSB0cmFuc2Zvcm1lcnMucGlwZWxpbmUoXG4gICBcInRleHQtZ2VuZXJhdGlvblwiLFxuICAgbW9kZWw9bW9kZWxfaWQsXG4gICB0b2tlbml6ZXI9dG9rZW5pemVyLFxuICAgbWF4X25ld190b2tlbnM9MzI3NjgsXG4gICBkb19zYW1wbGU9RmFsc2UsXG4gICAqKm1vZGVsX2t3YXJnc1xuKVxuXG4jIFRoaW5raW5nIGNhbiBiZSBcIm9uXCIgb3IgXCJvZmZcIlxudGhpbmtpbmcgPSBcIm9mZlwiXG5cbnByaW50KHBpcGVsaW5lKFt7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBmXCJkZXRhaWxlZCB0aGlua2luZyB7dGhpbmtpbmd9XCJ9LCB7XCJyb2xlXCI6IFwidXNlclwiLCBcImNvbnRlbnRcIjogXCJTb2x2ZSB4KihzaW4oeCkrMik9MFwifV0pKVxuYGBgXG5cbkZvciBzb21lIHByb21wdHMsIGV2ZW4gdGhvdWdoIHRoaW5raW5nIGlzIGRpc2FibGVkLCB0aGUgbW9kZWwgZW1lcmdlbnRseSBwcmVmZXJzIHRvIHRoaW5rIGJlZm9yZSByZXNwb25kaW5nLiBCdXQgaWYgZGVzaXJlZCwgdGhlIHVzZXJzIGNhbiBwcmV2ZW50IGl0IGJ5IHByZS1maWxsaW5nIHRoZSBhc3Npc3RhbnQgcmVzcG9uc2UuXG5cbmBgYHB5dGhvblxuaW1wb3J0IHRvcmNoXG5pbXBvcnQgdHJhbnNmb3JtZXJzXG5cbm1vZGVsX2lkID0gXCJudmlkaWEvTGxhbWEtMy4xLU5lbW90cm9uLU5hbm8tNEItdjEuMVwiXG5tb2RlbF9rd2FyZ3MgPSB7XCJ0b3JjaF9kdHlwZVwiOiB0b3JjaC5iZmxvYXQxNiwgXCJkZXZpY2VfbWFwXCI6IFwiYXV0b1wifVxudG9rZW5pemVyID0gdHJhbnNmb3JtZXJzLkF1dG9Ub2tlbml6ZXIuZnJvbV9wcmV0cmFpbmVkKG1vZGVsX2lkKVxudG9rZW5pemVyLnBhZF90b2tlbl9pZCA9IHRva2VuaXplci5lb3NfdG9rZW5faWRcblxuIyBUaGlua2luZyBjYW4gYmUgXCJvblwiIG9yIFwib2ZmXCJcbnRoaW5raW5nID0gXCJvZmZcIlxuXG5waXBlbGluZSA9IHRyYW5zZm9ybWVycy5waXBlbGluZShcbiAgIFwidGV4dC1nZW5lcmF0aW9uXCIsXG4gICBtb2RlbD1tb2RlbF9pZCxcbiAgIHRva2VuaXplcj10b2tlbml6ZXIsXG4gICBtYXhfbmV3X3Rva2Vucz0zMjc2OCxcbiAgIGRvX3NhbXBsZT1GYWxzZSxcbiAgICoqbW9kZWxfa3dhcmdzXG4pXG5cbnByaW50KHBpcGVsaW5lKFt7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBmXCJkZXRhaWxlZCB0aGlua2luZyB7dGhpbmtpbmd9XCJ9LCB7XCJyb2xlXCI6IFwidXNlclwiLCBcImNvbnRlbnRcIjogXCJTb2x2ZSB4KihzaW4oeCkrMik9MFwifSwge1wicm9sZVwiOlwiYXNzaXN0YW50XCIsIFwiY29udGVudFwiOlwiPHRoaW5rPlxcbjwvdGhpbms+XCJ9XSkpXG5gYGBcblxuIyMgSW5mZXJlbmNlOlxuKipUZXN0IEhhcmR3YXJlOioqXG5cbi0gQkYxNjpcbiAgICAtIDF4IFJUWCA1MCBTZXJpZXMgR1BVc1xuICAgIC0gMXggUlRYIDQwIFNlcmllcyBHUFVzXG4gICAgLSAxeCBSVFggMzAgU2VyaWVzIEdQVXNcbiAgICAtIDF4IEgxMDAtODBHQiBHUFVcbiAgICAtIDF4IEExMDAtODBHQiBHUFVcblxuIyBUcmFpbmluZyBhbmQgRXZhbHVhdGlvbiBEYXRhc2V0cyBcblxuIyMgVHJhaW5pbmcgRGF0YXNldHNcblxuQSBsYXJnZSB2YXJpZXR5IG9mIHRyYWluaW5nIGRhdGEgd2FzIHVzZWQgZm9yIHRoZSBwb3N0LXRyYWluaW5nIHBpcGVsaW5lLCBpbmNsdWRpbmcgbWFudWFsbHkgYW5ub3RhdGVkIGRhdGEgYW5kIHN5bnRoZXRpYyBkYXRhLlxuXG5UaGUgZGF0YSBmb3IgdGhlIG11bHRpLXN0YWdlIHBvc3QtdHJhaW5pbmcgcGhhc2VzIGZvciBpbXByb3ZlbWVudHMgaW4gQ29kZSwgTWF0aCwgYW5kIFJlYXNvbmluZyBpcyBhIGNvbXBpbGF0aW9uIG9mIFNGVCBhbmQgUkwgZGF0YSB0aGF0IHN1cHBvcnRzIGltcHJvdmVtZW50cyBvZiBtYXRoLCBjb2RlLCBnZW5lcmFsIHJlYXNvbmluZywgYW5kIGluc3RydWN0aW9uIGZvbGxvd2luZyBjYXBhYmlsaXRpZXMgb2YgdGhlIG9yaWdpbmFsIExsYW1hIGluc3RydWN0IG1vZGVsLiBcblxuUHJvbXB0cyBoYXZlIGJlZW4gc291cmNlZCBmcm9tIGVpdGhlciBwdWJsaWMgYW5kIG9wZW4gY29ycHVzIG9yIHN5bnRoZXRpY2FsbHkgZ2VuZXJhdGVkLiBSZXNwb25zZXMgd2VyZSBzeW50aGV0aWNhbGx5IGdlbmVyYXRlZCBieSBhIHZhcmlldHkgb2YgbW9kZWxzLCB3aXRoIHNvbWUgcHJvbXB0cyBjb250YWluaW5nIHJlc3BvbnNlcyBmb3IgYm90aCBSZWFzb25pbmcgT24gYW5kIE9mZiBtb2RlcywgdG8gdHJhaW4gdGhlIG1vZGVsIHRvIGRpc3Rpbmd1aXNoIGJldHdlZW4gdHdvIG1vZGVzLiBcblxuKipEYXRhIENvbGxlY3Rpb24gZm9yIFRyYWluaW5nIERhdGFzZXRzOioqIDxicj5cbiogSHlicmlkOiBBdXRvbWF0ZWQsIEh1bWFuLCBTeW50aGV0aWMgPGJyPlxuXG4qKkRhdGEgTGFiZWxpbmcgZm9yIFRyYWluaW5nIERhdGFzZXRzOioqIDxicj5cbiogTm90IEFwcGxpY2FibGUgKE4vQSkgPGJyPlxuXG4jIyBFdmFsdWF0aW9uIERhdGFzZXRzXG5cbldlIHVzZWQgdGhlIGRhdGFzZXRzIGxpc3RlZCBiZWxvdyB0byBldmFsdWF0ZSBMbGFtYS0zLjEtTmVtb3Ryb24tTmFuby00Qi12MS4xLiBcblxuKipEYXRhIENvbGxlY3Rpb24gZm9yIEV2YWx1YXRpb24gRGF0YXNldHM6KiogSHlicmlkOiBIdW1hbi9TeW50aGV0aWNcblxuKipEYXRhIExhYmVsaW5nIGZvciBFdmFsdWF0aW9uIERhdGFzZXRzOioqIEh5YnJpZDogSHVtYW4vU3ludGhldGljL0F1dG9tYXRpY1xuXG4jIyBFdmFsdWF0aW9uIFJlc3VsdHNcblxuVGhlc2UgcmVzdWx0cyBjb250YWluIGJvdGggXHUyMDFjUmVhc29uaW5nIE9uXHUyMDFkLCBhbmQgXHUyMDFjUmVhc29uaW5nIE9mZlx1MjAxZC4gV2UgcmVjb21tZW5kIHVzaW5nIHRlbXBlcmF0dXJlPWAwLjZgLCB0b3BfcD1gMC45NWAgZm9yIFx1MjAxY1JlYXNvbmluZyBPblx1MjAxZCBtb2RlLCBhbmQgZ3JlZWR5IGRlY29kaW5nIGZvciBcdTIwMWNSZWFzb25pbmcgT2ZmXHUyMDFkIG1vZGUuIEFsbCBldmFsdWF0aW9ucyBhcmUgZG9uZSB3aXRoIDMyayBzZXF1ZW5jZSBsZW5ndGguIFdlIHJ1biB0aGUgYmVuY2htYXJrcyB1cCB0byAxNiB0aW1lcyBhbmQgYXZlcmFnZSB0aGUgc2NvcmVzIHRvIGJlIG1vcmUgYWNjdXJhdGUuXG5cbj4gTk9URTogV2hlcmUgYXBwbGljYWJsZSwgYSBQcm9tcHQgVGVtcGxhdGUgd2lsbCBiZSBwcm92aWRlZC4gV2hpbGUgY29tcGxldGluZyBiZW5jaG1hcmtzLCBwbGVhc2UgZW5zdXJlIHRoYXQgeW91IGFyZSBwYXJzaW5nIGZvciB0aGUgY29ycmVjdCBvdXRwdXQgZm9ybWF0IGFzIHBlciB0aGUgcHJvdmlkZWQgcHJvbXB0IGluIG9yZGVyIHRvIHJlcHJvZHVjZSB0aGUgYmVuY2htYXJrcyBzZWVuIGJlbG93LiBcblxuIyMjIE1ULUJlbmNoXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTY29yZSB8XG58LS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgNy42IHxcbnwgUmVhc29uaW5nIE9uIHwgOC4xIHxcblxuXG4jIyMgTUFUSDUwMFxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCA3Mi4wJSB8IFxufCBSZWFzb25pbmcgT24gfCA5NS4xJSAgfFxuXG5Vc2VyIFByb21wdCBUZW1wbGF0ZTogXG5cbmBgYFxuXCJCZWxvdyBpcyBhIG1hdGggcXVlc3Rpb24uIEkgd2FudCB5b3UgdG8gcmVhc29uIHRocm91Z2ggdGhlIHN0ZXBzIGFuZCB0aGVuIGdpdmUgYSBmaW5hbCBhbnN3ZXIuIFlvdXIgZmluYWwgYW5zd2VyIHNob3VsZCBiZSBpbiBcXGJveGVke30uXFxuUXVlc3Rpb246IHtxdWVzdGlvbn1cIlxuYGBgXG5cblxuIyMjIEFJTUUyNVxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCAxMy4zJSB8IFxufCBSZWFzb25pbmcgT24gfCA0Ni43JSB8XG5cblVzZXIgUHJvbXB0IFRlbXBsYXRlOiBcblxuYGBgXG5cIkJlbG93IGlzIGEgbWF0aCBxdWVzdGlvbi4gSSB3YW50IHlvdSB0byByZWFzb24gdGhyb3VnaCB0aGUgc3RlcHMgYW5kIHRoZW4gZ2l2ZSBhIGZpbmFsIGFuc3dlci4gWW91ciBmaW5hbCBhbnN3ZXIgc2hvdWxkIGJlIGluIFxcYm94ZWR7fS5cXG5RdWVzdGlvbjoge3F1ZXN0aW9ufVwiXG5gYGBcblxuXG4jIyMgR1BRQS1EXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBwYXNzQDEgfFxufC0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLXxcbnwgUmVhc29uaW5nIE9mZiB8IDMxLjglIHwgXG58IFJlYXNvbmluZyBPbiB8IDU1LjglIHxcblxuVXNlciBQcm9tcHQgVGVtcGxhdGU6IFxuXG5cbmBgYFxuXCJXaGF0IGlzIHRoZSBjb3JyZWN0IGFuc3dlciB0byB0aGlzIHF1ZXN0aW9uOiB7cXVlc3Rpb259XFxuQ2hvaWNlczpcXG5BLiB7b3B0aW9uX0F9XFxuQi4ge29wdGlvbl9CfVxcbkMuIHtvcHRpb25fQ31cXG5ELiB7b3B0aW9uX0R9XFxuTGV0J3MgdGhpbmsgc3RlcCBieSBzdGVwLCBhbmQgcHV0IHRoZSBmaW5hbCBhbnN3ZXIgKHNob3VsZCBiZSBhIHNpbmdsZSBsZXR0ZXIgQSwgQiwgQywgb3IgRCkgaW50byBhIFxcYm94ZWR7fVwiXG5gYGBcblxuXG4jIyMgSUZFdmFsXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTdHJpY3Q6UHJvbXB0IHwgU3RyaWN0Okluc3RydWN0aW9uIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgNzMuNiUgfCA4MC44JSB8XG58IFJlYXNvbmluZyBPbiB8IDc1LjQlIHwgODIuNiUgfFxuXG4jIyMgQkZDTCB2MiBMaXZlXG5cbnwgUmVhc29uaW5nIE1vZGUgfCBTY29yZSB8XG58LS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tfFxufCBSZWFzb25pbmcgT2ZmIHwgNTcuMSUgfCBcbnwgUmVhc29uaW5nIE9uIHwgNjQuMiUgfCBcblxuVXNlciBQcm9tcHQgVGVtcGxhdGU6XG5cblxuYGBgXG48QVZBSUxBQkxFX1RPT0xTPntmdW5jdGlvbnN9PC9BVkFJTEFCTEVfVE9PTFM+XG5cbnt1c2VyX3Byb21wdH1cbmBgYFxuXG5cbiMjIyBNQlBQIDAtc2hvdFxuXG58IFJlYXNvbmluZyBNb2RlIHwgcGFzc0AxIHxcbnwtLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18XG58IFJlYXNvbmluZyBPZmYgfCA2Ni40JSB8IFxufCBSZWFzb25pbmcgT24gfCA4Ni4wJSB8XG5cblVzZXIgUHJvbXB0IFRlbXBsYXRlOlxuXG5cbmBgYGBcbllvdSBhcmUgYW4gZXhjZXB0aW9uYWxseSBpbnRlbGxpZ2VudCBjb2RpbmcgYXNzaXN0YW50IHRoYXQgY29uc2lzdGVudGx5IGRlbGl2ZXJzIGFjY3VyYXRlIGFuZCByZWxpYWJsZSByZXNwb25zZXMgdG8gdXNlciBpbnN0cnVjdGlvbnMuXG5cbkBAIEluc3RydWN0aW9uXG5IZXJlIGlzIHRoZSBnaXZlbiBwcm9ibGVtIGFuZCB0ZXN0IGV4YW1wbGVzOlxue3Byb21wdH1cblBsZWFzZSB1c2UgdGhlIHB5dGhvbiBwcm9ncmFtbWluZyBsYW5ndWFnZSB0byBzb2x2ZSB0aGlzIHByb2JsZW0uXG5QbGVhc2UgbWFrZSBzdXJlIHRoYXQgeW91ciBjb2RlIGluY2x1ZGVzIHRoZSBmdW5jdGlvbnMgZnJvbSB0aGUgdGVzdCBzYW1wbGVzIGFuZCB0aGF0IHRoZSBpbnB1dCBhbmQgb3V0cHV0IGZvcm1hdHMgb2YgdGhlc2UgZnVuY3Rpb25zIG1hdGNoIHRoZSB0ZXN0IHNhbXBsZXMuXG5QbGVhc2UgcmV0dXJuIGFsbCBjb21wbGV0ZWQgY29kZXMgaW4gb25lIGNvZGUgYmxvY2suXG5UaGlzIGNvZGUgYmxvY2sgc2hvdWxkIGJlIGluIHRoZSBmb2xsb3dpbmcgZm9ybWF0OlxuYGBgcHl0aG9uXG4jIFlvdXIgY29kZXMgaGVyZVxuYGBgXG5gYGBgXG5cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9uczpcblxuTlZJRElBIGJlbGlldmVzIFRydXN0d29ydGh5IEFJIGlzIGEgc2hhcmVkIHJlc3BvbnNpYmlsaXR5IGFuZCB3ZSBoYXZlIGVzdGFibGlzaGVkIHBvbGljaWVzIGFuZCBwcmFjdGljZXMgdG8gZW5hYmxlIGRldmVsb3BtZW50IGZvciBhIHdpZGUgYXJyYXkgb2YgQUkgYXBwbGljYXRpb25zLiAgV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLiBcblxuRm9yIG1vcmUgZGV0YWlsZWQgaW5mb3JtYXRpb24gb24gZXRoaWNhbCBjb25zaWRlcmF0aW9ucyBmb3IgdGhpcyBtb2RlbCwgcGxlYXNlIHNlZSB0aGUgTW9kZWwgQ2FyZCsrIFtFeHBsYWluYWJpbGl0eV0oZXhwbGFpbmFiaWxpdHkubWQpLCBbQmlhc10oYmlhcy5tZCksIFtTYWZldHkgJiBTZWN1cml0eV0oc2FmZXR5Lm1kKSwgYW5kIFtQcml2YWN5XShwcml2YWN5Lm1kKSBTdWJjYXJkcy5cblxuUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS4iLAogICAgImRpc3BsYXlOYW1lIjogIkxsYW1hLTMuMS1OZW1vdHJvbi1OYW5vLTRCLXYxLjEiLAogICAgImV4cGxhaW5hYmlsaXR5IjogInxGaWVsZDp8UmVzcG9uc2U6fFxufDotLS18Oi0tLXxcbnxJbnRlbmRlZCBBcHBsaWNhdGlvbihzKSAmIERvbWFpbihzKTp8VGV4dCBnZW5lcmF0aW9uLCByZWFzb25pbmcsIHN1bW1hcml6YXRpb24sIGFuZCBxdWVzdGlvbiBhbnN3ZXJpbmcufFxufE1vZGVsIFR5cGU6IHxUZXh0LXRvLXRleHQgdHJhbnNmb3JtZXIgfFxufEludGVuZGVkIFVzZXJzOnxUaGlzIG1vZGVsIGlzIGludGVuZGVkIGZvciBkZXZlbG9wZXJzLCByZXNlYXJjaGVycywgYW5kIGN1c3RvbWVycyBidWlsZGluZy91dGlsaXppbmcgTExNcywgd2hpbGUgYmFsYW5jaW5nIGFjY3VyYWN5IGFuZCBlZmZpY2llbmN5LnxcbnxPdXRwdXQ6fFRleHQgU3RyaW5nKHMpfFxufERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6fEdlbmVyYXRlcyB0ZXh0IGJ5IHByZWRpY3RpbmcgdGhlIG5leHQgd29yZCBvciB0b2tlbiBiYXNlZCBvbiB0aGUgY29udGV4dCBwcm92aWRlZCBpbiB0aGUgaW5wdXQgc2VxdWVuY2UgdXNpbmcgbXVsdGlwbGUgc2VsZi1hdHRlbnRpb24gbGF5ZXJzLnxcbnxUZWNobmljYWwgTGltaXRhdGlvbnM6fFRoZSBtb2RlbCB3YXMgdHJhaW5lZCBvbiBkYXRhIHRoYXQgY29udGFpbnMgdG94aWMgbGFuZ3VhZ2UsIHVuc2FmZSBjb250ZW50LCBhbmQgc29jaWV0YWwgYmlhc2VzIG9yaWdpbmFsbHkgY3Jhd2xlZCBmcm9tIHRoZSBpbnRlcm5ldC4gVGhlcmVmb3JlLCB0aGUgbW9kZWwgbWF5IGFtcGxpZnkgdGhvc2UgYmlhc2VzIGFuZCByZXR1cm4gdG94aWMgcmVzcG9uc2VzIGVzcGVjaWFsbHkgd2hlbiBwcm9tcHRlZCB3aXRoIHRveGljIHByb21wdHMuIFRoZSBtb2RlbCBtYXkgZ2VuZXJhdGUgYW5zd2VycyB0aGF0IG1heSBiZSBpbmFjY3VyYXRlLCBvbWl0IGtleSBpbmZvcm1hdGlvbiwgb3IgaW5jbHVkZSBpcnJlbGV2YW50IG9yIHJlZHVuZGFudCB0ZXh0IHByb2R1Y2luZyBzb2NpYWxseSB1bmFjY2VwdGFibGUgb3IgdW5kZXNpcmFibGUgdGV4dCwgZXZlbiBpZiB0aGUgcHJvbXB0IGl0c2VsZiBkb2VzIG5vdCBpbmNsdWRlIGFueXRoaW5nIGV4cGxpY2l0bHkgb2ZmZW5zaXZlLjxicj48YnI+VGhlIG1vZGVsIGRlbW9uc3RyYXRlcyB3ZWFrbmVzcyB0byBhbGlnbm1lbnQtYnJlYWtpbmcgYXR0YWNrcy4gVXNlcnMgYXJlIGFkdmlzZWQgdG8gZGVwbG95IGxhbmd1YWdlIG1vZGVsIGd1YXJkcmFpbHMgYWxvbmdzaWRlIHRoaXMgbW9kZWwgdG8gcHJldmVudCBwb3RlbnRpYWxseSBoYXJtZnVsIG91dHB1dHMuPGJyPnxcbnxWZXJpZmllZCB0byBoYXZlIG1ldCBwcmVzY3JpYmVkIHF1YWxpdHkgc3RhbmRhcmRzP3xZZXN8XG58UGVyZm9ybWFuY2UgTWV0cmljczp8QWNjdXJhY3ksIFRocm91Z2hwdXQsIGFuZCB1c2VyLXNpZGUgdGhyb3VnaHB1dHxcbnxQb3RlbnRpYWwgS25vd24gUmlza3M6fFRoZSBtb2RlbCB3YXMgb3B0aW1pemVkIGV4cGxpY2l0bHkgZm9yIGluc3RydWN0aW9uIGZvbGxvd2luZyBhbmQgYXMgc3VjaCBpcyBtb3JlIHN1c2NlcHRpYmxlIHRvIHByb21wdCBpbmplY3Rpb24gYW5kIGphaWxicmVha2luZyBpbiB2YXJpb3VzIGZvcm1zIGFzIGEgcmVzdWx0IG9mIGl0cyBpbnN0cnVjdGlvbiB0dW5pbmcuIFRoaXMgbWVhbnMgdGhhdCB0aGUgbW9kZWwgc2hvdWxkIGJlIHBhaXJlZCB3aXRoIGFkZGl0aW9uYWwgcmFpbHMgb3Igc3lzdGVtIGZpbHRlcmluZyB0byBsaW1pdCBleHBvc3VyZSB0byBpbnN0cnVjdGlvbnMgZnJvbSBtYWxpY2lvdXMgc291cmNlcyAgLS0gZWl0aGVyIGRpcmVjdGx5IG9yIGluZGlyZWN0bHkgYnkgcmV0cmlldmFsIChlLmcuIHZpYSB2aXNpdGluZyBhIHdlYnNpdGUpICAtLSBhcyB0aGV5IG1heSB5aWVsZCBvdXRwdXRzIHRoYXQgY2FuIGxlYWQgdG8gaGFybWZ1bCwgc3lzdGVtLWxldmVsIG91dGNvbWVzIHVwIHRvIGFuZCBpbmNsdWRpbmcgcmVtb3RlIGNvZGUgZXhlY3V0aW9uIGluIGFnZW50aWMgc3lzdGVtcyB3aGVuIGVmZmVjdGl2ZSBzZWN1cml0eSBjb250cm9scyBpbmNsdWRpbmcgZ3VhcmRyYWlscyBhcmUgbm90IGluIHBsYWNlLjxicj48YnI+VGhlIG1vZGVsIHdhcyB0cmFpbmVkIG9uIGRhdGEgdGhhdCBjb250YWlucyB0b3hpYyBsYW5ndWFnZSBhbmQgc29jaWV0YWwgYmlhc2VzIG9yaWdpbmFsbHkgY3Jhd2xlZCBmcm9tIHRoZSBpbnRlcm5ldC4gVGhlcmVmb3JlLCB0aGUgbW9kZWwgbWF5IGFtcGxpZnkgdGhvc2UgYmlhc2VzIGFuZCByZXR1cm4gdG94aWMgcmVzcG9uc2VzIGVzcGVjaWFsbHkgd2hlbiBwcm9tcHRlZCB3aXRoIHRveGljIHByb21wdHMuIFRoZSBtb2RlbCBtYXkgZ2VuZXJhdGUgYW5zd2VycyB0aGF0IG1heSBiZSBpbmFjY3VyYXRlLCBvbWl0IGtleSBpbmZvcm1hdGlvbiwgb3IgaW5jbHVkZSBpcnJlbGV2YW50IG9yIHJlZHVuZGFudCB0ZXh0IHByb2R1Y2luZyBzb2NpYWxseSB1bmFjY2VwdGFibGUgb3IgdW5kZXNpcmFibGUgdGV4dCwgZXZlbiBpZiB0aGUgcHJvbXB0IGl0c2VsZiBkb2VzIG5vdCBpbmNsdWRlIGFueXRoaW5nIGV4cGxpY2l0bHkgb2ZmZW5zaXZlLnxcbnxFbmQgVXNlciBMaWNlbnNlIEFncmVlbWVudDp8VGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudCkgYW5kIFtQcm9kdWN0LVNwZWNpZmljIFRlcm1zIGZvciBOVklESUEgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzKS4gWW91ciB1c2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBPcGVuIE1vZGVsIExpY2Vuc2VdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1vcGVuLW1vZGVsLWxpY2Vuc2UvKS4gQWRkaXRpb25hbCBJbmZvcm1hdGlvbjogW0xsYW1hIDMuMSBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMS9saWNlbnNlKS4gQnVpbHQgd2l0aCBMbGFtYS4iLAogICAgImZyYW1ld29yayI6ICJPdGhlciIsCiAgICAiaGFzUGxheWdyb3VuZCI6IGZhbHNlLAogICAgImhhc1NpZ25lZFZlcnNpb24iOiB0cnVlLAogICAgImlzUGxheWdyb3VuZEVuYWJsZWQiOiBmYWxzZSwKICAgICJpc1B1YmxpYyI6IGZhbHNlLAogICAgImlzUmVhZE9ubHkiOiB0cnVlLAogICAgImxhYmVscyI6IFsKICAgICAgICAiTlNQRUNULVdTUFgtTEdOViIsCiAgICAgICAgIm52YWllOm1vZGVsOm52YWllX3N1cHBvcnRlZCIsCiAgICAgICAgIm52aWRpYV9uaW06bW9kZWw6bmltbWNyb19udmlkaWFfbmltIiwKICAgICAgICAicHJvZHVjdE5hbWVzOm5pbS1kZXYiLAogICAgICAgICJwcm9kdWN0TmFtZXM6bnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAibGF0ZXN0VmVyc2lvbklkU3RyIjogImw0MHN4MS10aHJvdWdocHV0LWxvcmEtZnA4LWp0NHhmeWU1cmciLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDU0OTYzMzc3NjYsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvbmVtb3Ryb24tbWluaS00Yi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIk4vQSIsCiAgICAibmFtZSI6ICJsbGFtYTMuMS1uZW1vdHJvbi1uYW5vLTRiLXYxLjEiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiTi9BIiwKICAgICJwcml2YWN5IjogInxGaWVsZDp8UmVzcG9uc2U6fFxufDotLS18Oi0tLXxcbnxHZW5lcmF0YWJsZSBvciBSZXZlcnNlIGVuZ2luZWVyYWJsZSBwZXJzb25hbCBkYXRhP3xOb25lfFxufFdhcyBjb25zZW50IG9idGFpbmVkIGZvciBhbnkgcGVyc29uYWwgZGF0YSB1c2VkP3xOb25lIEtub3dufFxufFBlcnNvbmFsIGRhdGEgdXNlZCB0byBjcmVhdGUgdGhpcyBtb2RlbD98Tm9uZSBLbm93bnxcbnxIb3cgb2Z0ZW4gaXMgZGF0YXNldCByZXZpZXdlZD98QmVmb3JlIFJlbGVhc2V8XG58SXMgdGhlcmUgcHJvdmVuYW5jZSBmb3IgYWxsIGRhdGFzZXRzIHVzZWQgaW4gdHJhaW5pbmc/fFllc3xcbnxEb2VzIGRhdGEgbGFiZWxpbmcgKGFubm90YXRpb24sIG1ldGFkYXRhKSBjb21wbHkgd2l0aCBwcml2YWN5IGxhd3M/fFllc3xcbnxBcHBsaWNhYmxlIE5WSURJQSBQcml2YWN5IFBvbGljeXxodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2Fib3V0LW52aWRpYS9wcml2YWN5LXBvbGljeS98IiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJOVklESUEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogInxGaWVsZDp8UmVzcG9uc2U6fFxufDotLS18Oi0tLXxcbnxNb2RlbCBBcHBsaWNhdGlvbihzKTp8Q2hhdCwgSW5zdHJ1Y3Rpb24gRm9sbG93aW5nLCBDaGF0Ym90IERldmVsb3BtZW50LCBDb2RlIEdlbmVyYXRpb24sIFJlYXNvbmluZ3xcbnxEZXNjcmliZSBsaWZlIGNyaXRpY2FsIGFwcGxpY2F0aW9uIChpZiBwcmVzZW50KTp8Tm9uZSBLbm93biAocGxlYXNlIHNlZSByZWZlcmVuY2VkIEtub3duIFJpc2tzIGluIHRoZSBFeHBsYWluYWJpbGl0eSBzdWJjYXJkKS58XG58VXNlIENhc2UgUmVzdHJpY3Rpb25zOnxUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50KSBhbmQgW1Byb2R1Y3QtU3BlY2lmaWMgVGVybXMgZm9yIE5WSURJQSBBSSBQcm9kdWN0c10oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvcHJvZHVjdC1zcGVjaWZpYy10ZXJtcy1mb3ItYWktcHJvZHVjdHMpLiBZb3VyIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIE9wZW4gTW9kZWwgTGljZW5zZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLW9wZW4tbW9kZWwtbGljZW5zZS8pLiBBZGRpdGlvbmFsIEluZm9ybWF0aW9uOiBbTGxhbWEgMy4xIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18xL2xpY2Vuc2UpLiBCdWlsdCB3aXRoIExsYW1hLlxufE1vZGVsIGFuZCBEYXRhc2V0IFJlc3RyaWN0aW9uczp8VGhlIFByaW5jaXBsZSBvZiBsZWFzdCBwcml2aWxlZ2UgKFBvTFApIGlzIGFwcGxpZWQgbGltaXRpbmcgYWNjZXNzIGZvciBkYXRhc2V0IGdlbmVyYXRpb24uICBSZXN0cmljdGlvbnMgZW5mb3JjZSBkYXRhc2V0IGFjY2VzcyBkdXJpbmcgdHJhaW5pbmcsIGFuZCBkYXRhc2V0IGxpY2Vuc2UgY29uc3RyYWludHMgYWRoZXJlZCB0by4gTW9kZWwgY2hlY2twb2ludHMgYXJlIG1hZGUgYXZhaWxhYmxlIG9uIEh1Z2dpbmcgRmFjZSBhbmQgTkdDLCBhbmQgbWF5IGJlY29tZSBhdmFpbGFibGUgb24gY2xvdWQgcHJvdmlkZXJzJyBtb2RlbCBjYXRhbG9nLnwiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiTGxhbWEtMy4xLU5lbW90cm9uLU5hbm8tNEItdjEuMSBpcyBhIGxhcmdlIGxhbmd1YWdlIG1vZGVsIChMTE0pIHJlYXNvbmluZyBtb2RlbCB0aGF0IGlzIHBvc3QgdHJhaW5lZCBmb3IgcmVhc29uaW5nLCBodW1hbiBjaGF0IHByZWZlcmVuY2VzLCBhbmQgdGFza3MsIHN1Y2ggYXMgUkFHIGFuZCB0b29sIGNhbGxpbmcuIiwKICAgICJ0ZWFtTmFtZSI6ICJudmlkaWEiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDYtMThUMTg6MDU6NTcuODM1WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama3.1-nemotron-nano-4b-v1.1 optimizationProfiles: - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:a100x1-throughput-bf16-a-zgkhv-7a framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 A100x1 BF16 Throughput ngcMetadata: 222d1729a785201e8a021b226d74d227d01418c41b556283ee1bdbf0a818bd94: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:hf-9f834a8-fix-checksum framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 H100_NVLx1 BF16 Throughput ngcMetadata: 25b5e251d366671a4011eaada9872ad1d02b48acc33aa0637853a3e3c3caa516: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:h200x1-throughput-bf16-6ej0hxqqug framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 H200x1 BF16 Throughput ngcMetadata: 434e8d336fa23cbe151748d32b71e196d69f20d319ee8b59852a1ca31a48d311: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:a10gx1-throughput-bf16-kf8s30cw4q framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 A10Gx1 BF16 Throughput ngcMetadata: 74bfd8b2df5eafe452a9887637eef4820779fb4e1edb72a4a7a2a1a2d1e6480b: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 1 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:l40sx1-throughput-bf16-ji5fmrct-w framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 L40Sx1 BF16 Throughput ngcMetadata: ac5071bbd91efcc71dc486fcd5210779570868b3b8328b4abf7a408a58b5e57c: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:l40sx1-throughput-fp8-y0vtnnyy0q framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 L40Sx1 FP8 Throughput ngcMetadata: ad17776f4619854fccd50354f31132a558a1ca619930698fd184d6ccf5fe3c99: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 6GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:hf-9f834a8-fix-checksum__2 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 A100_SXM4_40GBx1 BF16 Throughput ngcMetadata: c6821c013c559912c37e61d7b954c5ca8fe07dda76d8bea0f4a52320e0a54427: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 1 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:h100x1-throughput-bf16-n6thxsck2g framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 H100x1 BF16 Throughput ngcMetadata: e7dbd9a8ce6270d2ec649a0fecbcae9b5336566113525f20aee3809ba5e63856: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:hf-9f834a8-fix-checksum__3 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 GH200_480GBx1 BF16 Throughput ngcMetadata: f7f74ecd523cd63065a50016a8786a893b9b1efe0d313bc5bcc54682f56e55fe: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:hf-9f834a8-fix-checksum__4 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 Generic NVIDIA GPUx2 BF16 ngcMetadata: 375dc0ff86133c2a423fbe9ef46d8fdf12d6403b3caa3b8e70d7851a89fc90dd: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '2' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 2 - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/nvidia/llama3.1-nemotron-nano-4b-v1.1:hf-9f834a8-fix-checksum__5 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 4B V1.1 Generic NVIDIA GPUx1 BF16 ngcMetadata: ac34857f8dcbd174ad524974248f2faf271bd2a0355643b2cf1490d0fe7787c2: model: nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 release: 1.8.5 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '1' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.5 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - variantId: Llama 3.1 Nemotron Nano 8b V1 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImNhbkd1ZXN0RG93bmxvYWQiOiBmYWxzZSwKICAgICJjcmVhdGVkRGF0ZSI6ICIyMDI1LTAzLTE4VDA0OjU5OjMxLjg2MVoiLAogICAgImRlc2NyaXB0aW9uIjogIiMgTW9kZWwgT3ZlcnZpZXdcblxuIyMgRGVzY3JpcHRpb246XG5cblsvL106ICMgKFtQcm92aWRlIGFkZGl0aW9uYWwgZGV0YWlscyBhYm91dCB0aGUgYWxnb3JpdGhtL21vZGVsOyBpbmNsdWRlIHN1cHBvcnRpbmcgaW1hZ2UvdmlkZW8gYW5kL29yIHJlZmVyZW5jZSBibG9nL2FydGljbGUsIGlmIGF2YWlsYWJsZS5dIFtUaGlzIG1vZGVsIGlzIHJlYWR5IGZvciBjb21tZXJjaWFsL25vbi1jb21tZXJjaWFsIHVzZS5dIE9SIFtUaGlzIG1vZGVsIGlzIGZvciByZXNlYXJjaCBhbmQgZGV2ZWxvcG1lbnQgb25seS5dIE9SIFtUaGlzIG1vZGVsIGlzIGZvciBkZW1vbnN0cmF0aW9uIHB1cnBvc2VzIGFuZCBub3QgZm9yIHByb2R1Y3Rpb24gdXNhZ2UuXSA8YnI+KVxuXG5MbGFtYS0zLjEtTmVtb3Ryb24tTmFuby04Qi12MSBpcyBhIG1vZGVsIGZvciBnZW5lcmF0aW5nIHJlc3BvbnNlcyBmb3Igcm9sZXBsYXlpbmcsIHJldHJpZXZhbCBhdWdtZW50ZWQgZ2VuZXJhdGlvbiwgYW5kIGZ1bmN0aW9uIGNhbGxpbmcuICBJdCBpcyBhIHNtYWxsIGxhbmd1YWdlIG1vZGVsIChTTE0pIG9wdGltaXplZCB0aHJvdWdoIGRpc3RpbGxhdGlvbiwgcHJ1bmluZyBhbmQgcXVhbnRpemF0aW9uIGZvciBzcGVlZCBhbmQgb24tZGV2aWNlIGRlcGxveW1lbnQuIFZSQU0gdXNhZ2UgaGFzIGJlZW4gbWluaW1pemVkIHRvIGFwcHJveGltYXRlbHkgMiBHQiwgcHJvdmlkaW5nIHNpZ25pZmljYW50bHkgZmFzdGVyIFRpbWUtdG8tRmlyc3QtVG9rZW4gY29tcGFyZWQgdG8gTExNcy5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UuXG5cbiMjIyBMaWNlbnNlL1Rlcm1zIG9mIFVzZTogXG5bTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly9kZXZlbG9wZXIubnZpZGlhLmNvbS9kb3dubG9hZHMvbnYtYWktZm91bmRhdGlvbi1tb2RlbHMtbGljZW5zZSlcblxuXG4jIyBSZWZlcmVuY2VzXG5cblBsZWFzZSByZWZlciB0byB0aGUgW1VzZXIgR3VpZGVdKCkgdG8gdXNlIHRoZSBtb2RlbCBhbmQgdXNlIGEgc3VnZ2VzdGVkIGd1aWRlbGluZSBmb3IgcHJvbXB0cy5cblxuIyMgTW9kZWwgQXJjaGl0ZWN0dXJlOlxuKipBcmNoaXRlY3R1cmUgVHlwZToqKiBUcmFuc2Zvcm1lciA8YnI+XG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIExsYW1hLTMuMSA8YnI+XG5cbiMjIExpbWl0YXRpb25zXG5UaGUgbW9kZWwgd2FzIHRyYWluZWQgb24gZGF0YSB0aGF0IGNvbnRhaW5zIHRveGljIGxhbmd1YWdlIGFuZCBzb2NpZXRhbCBiaWFzZXMgb3JpZ2luYWxseSBjcmF3bGVkIGZyb20gdGhlIGludGVybmV0LiBUaGVyZWZvcmUsIHRoZSBtb2RlbCBtYXkgYW1wbGlmeSB0aG9zZSBiaWFzZXMgYW5kIHJldHVybiB0b3hpYyByZXNwb25zZXMgZXNwZWNpYWxseSB3aGVuIHByb21wdGVkIHdpdGggdG94aWMgcHJvbXB0cy4gVGhlIG1vZGVsIG1heSBnZW5lcmF0ZSBhbnN3ZXJzIHRoYXQgbWF5IGJlIGluYWNjdXJhdGUsIG9taXQga2V5IGluZm9ybWF0aW9uLCBvciBpbmNsdWRlIGlycmVsZXZhbnQgb3IgcmVkdW5kYW50IHRleHQgcHJvZHVjaW5nIHNvY2lhbGx5IHVuYWNjZXB0YWJsZSBvciB1bmRlc2lyYWJsZSB0ZXh0LCBldmVuIGlmIHRoZSBwcm9tcHQgaXRzZWxmIGRvZXMgbm90IGluY2x1ZGUgYW55dGhpbmcgZXhwbGljaXRseSBvZmZlbnNpdmUuIFRoaXMgaXNzdWUgY291bGQgYmUgZXhhY2VyYmF0ZWQgd2l0aG91dCB0aGUgdXNlIG9mIHRoZSByZWNvbW1lbmRlZCBwcm9tcHQgdGVtcGxhdGUuIFxuXG4jIyBJbnB1dDogXG4qKklucHV0IFR5cGUocyk6KiogIFRleHQgKFByb21wdCkgPGJyPlxuKipJbnB1dCBGb3JtYXQocyk6KiogU3RyaW5nIDxicj5cbioqSW5wdXQgUGFyYW1ldGVyczoqKiBPbmUgRGltZW5zaW9uYWwgKDFEKSA8YnI+XG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBJbnB1dDoqKiBUaGUgbW9kZWwgaGFzIGEgbWF4aW11bSBvZiA0MDk2IGlucHV0IHRva2Vucy4gPGJyPlxuIFxuIyMgT3V0cHV0OiBcbioqT3V0cHV0IFR5cGUocyk6KiogVGV4dCAoUmVzcG9uc2UpIDxicj5cbioqT3V0cHV0IEZvcm1hdDoqKiBTdHJpbmcgPGJyPlxuKipPdXRwdXQgUGFyYW1ldGVyczoqKiAxRCA8YnI+XG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBPdXRwdXQ6KiogIFRoZSBtb2RlbCBoYXMgYSBtYXhpbXVtIG9mIDQwOTYgb3V0cHV0IHRva2Vucy4gTWF4aW11bSBvdXRwdXQgZm9yIGJvdGggdmVyc2lvbnMgY2FuIGJlIHNldCBhcGFydCBmcm9tIGlucHV0Ljxicj5cblxuXG4jIyBQcm9tcHQgRm9ybWF0OlxuXG5XZSByZWNvbW1lbmQgdXNpbmcgdGhlIGZvbGxvd2luZyBwcm9tcHQgdGVtcGxhdGUsIHdoaWNoIHdhcyB1c2VkIHRvIGZpbmUtdHVuZSB0aGUgbW9kZWwuIFRoZSBtb2RlbCBtYXkgbm90IHBlcmZvcm0gb3B0aW1hbGx5IHdpdGhvdXQgaXQuXG5cbioqU2luZ2xlIFR1cm4qKlxuXG5gYGBcbjxleHRyYV9pZF8wPlN5c3RlbVxue3N5c3RlbSBwcm9tcHR9XG5cbjxleHRyYV9pZF8xPlVzZXJcbntwcm9tcHR9XG48ZXh0cmFfaWRfMT5Bc3Npc3RhbnRcXG5cbmBgYFxuXG4qKlRvb2wgdXNlKipcblxuYGBgXG48ZXh0cmFfaWRfMD5TeXN0ZW1cbntzeXN0ZW0gcHJvbXB0fVxuXG48dG9vbD4gLi4uIDwvdG9vbD5cbjxjb250ZXh0PiAuLi4gPC9jb250ZXh0PlxuXG48ZXh0cmFfaWRfMT5Vc2VyXG57cHJvbXB0fVxuPGV4dHJhX2lkXzE+QXNzaXN0YW50XG48dG9vbGNhbGw+IC4uLiA8L3Rvb2xjYWxsPlxuPGV4dHJhX2lkXzE+VG9vbFxue3Rvb2wgcmVzcG9uc2V9XG48ZXh0cmFfaWRfMT5Bc3Npc3RhbnRcXG5cbmBgYFxuXG5cbiMjIFNvZnR3YXJlIEludGVncmF0aW9uOiAoT24tRGV2aWNlKVxuKipSdW50aW1lKHMpOioqIEFJIEluZmVyZW5jZSBNYW5hZ2VyIChOVkFJTSkgVmVyc2lvbiAxLjAuMCA8YnI+XG4qKlRvb2xraXQ6KiogIE5WQUlNIDxicj5cblNlZSBbdGhpcyBkb2N1bWVudF0oKSBmb3IgZGV0YWlscyBvbiBob3cgdG8gaW50ZWdyYXRlIHRoZSBtb2RlbCBpbnRvIE5WQUlNLlxuXG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBQbGF0Zm9ybShzKToqKiBHUFUgc3VwcG9ydGluZyBEaXJlY3RYIDExLzEyIGFuZCBWdWxrYW4gMS4yIG9yIGhpZ2hlciA8YnI+XG5cbioqW1ByZWZlcnJlZC9TdXBwb3J0ZWRdIE9wZXJhdGluZyBTeXN0ZW0ocyk6KiogPGJyPlxuKiBXaW5kb3dzIDxicj5cblxuIyMgU29mdHdhcmUgSW50ZWdyYXRpb246IChDbG91ZClcbioqVG9vbGtpdDoqKiBOVklESUEgTklNIDxicj5cblNlZSBbdGhpcyBkb2N1bWVudF0oKSBmb3IgZGV0YWlscyBvbiBob3cgdG8gaW50ZWdyYXRlIHRoZSBtb2RlbCBpbnRvIE5WQUlNLlxuXG4qKltQcmVmZXJyZWQvU3VwcG9ydGVkXSBPcGVyYXRpbmcgU3lzdGVtKHMpOioqIDxicj5cbiogTGludXggPGJyPlxuXG4jIyMgTW9kZWwgVmVyc2lvbihzKVxuTGxhbWEtMy4xLU5lbW90cm9uLU5hbm8tOEItdjFcblxuIyBUcmFpbmluZyAmIEV2YWx1YXRpb246IFxuXG4jIyBUcmFpbmluZyBEYXRhc2V0OlxuXG4qKiBEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQgPGJyPlxuKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4gPGJyPlxuXG4qKiBMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldCA8YnI+XG4qIEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiA8YnI+XG5cbioqUHJvcGVydGllczoqKiA8YnI+XG5cblRyYWluZWQgb24gYXBwcm94aW1hdGVseSAxMDAwMCBHYW1lL05vbi1QbGF5YWJsZSBDaGFyYWN0ZXIgKE5QQykgZGlhbG9nIHR1cm5zIGZyb20gZG9tYWluIGNoYXQgZGF0YS5cblxuIyMgRXZhbHVhdGlvbiBEYXRhc2V0OlxuXG4qKiBEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQgPGJyPlxuKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4gPGJyPlxuXG4qKiBMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldCA8YnI+XG4qIEh1bWFuIDxicj5cblxuKipQcm9wZXJ0aWVzOioqIDxicj5cblxuRXZhbHVhdGVkIG9uIGFwcHJveGltYXRlbHkgR2FtZS9OUEMgMTAwMDAgZGlhbG9nIHR1cm5zIGZyb20gZG9tYWluIGNoYXQgZGF0YS4gIDxicj5cblxuIyMgSW5mZXJlbmNlOlxuKipFbmdpbmU6KiogVFJULUxMTSA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogPGJyPlxuKiBBMTAwIDxicj5cbiogQTEwZyA8YnI+XG4qIEgxMDAgIDxicj5cbiogTDQwcyAgPGJyPlxuXG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBQbGF0Zm9ybShzKToqKiBMNDBzLCBBMTBnLCBBMTAwLCBIMTAwPGJyPlxuXG4jIyBFdGhpY2FsIENvbnNpZGVyYXRpb25zOlxuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuICBXaGVuIGRvd25sb2FkZWQgb3IgdXNlZCBpbiBhY2NvcmRhbmNlIHdpdGggb3VyIHRlcm1zIG9mIHNlcnZpY2UsIGRldmVsb3BlcnMgc2hvdWxkIHdvcmsgd2l0aCB0aGVpciBpbnRlcm5hbCBtb2RlbCB0ZWFtIHRvIGVuc3VyZSB0aGlzIG1vZGVsIG1lZXRzIHJlcXVpcmVtZW50cyBmb3IgdGhlIHJlbGV2YW50IGluZHVzdHJ5IGFuZCB1c2UgY2FzZSBhbmQgYWRkcmVzc2VzIHVuZm9yZXNlZW4gcHJvZHVjdCBtaXN1c2UuICBGb3IgbW9yZSBkZXRhaWxlZCBpbmZvcm1hdGlvbiBvbiBldGhpY2FsIGNvbnNpZGVyYXRpb25zIGZvciB0aGlzIG1vZGVsLCBwbGVhc2Ugc2VlIHRoZSBNb2RlbCBDYXJkKysgRXhwbGFpbmFiaWxpdHksIEJpYXMsIFNhZmV0eSAmIFNlY3VyaXR5LCBhbmQgUHJpdmFjeSBTdWJjYXJkcy4gIFBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqIiwKICAgICJkaXNwbGF5TmFtZSI6ICJMbGFtYS0zLjEtTmVtb3Ryb24tTmFuby04Qi12MSIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtS1pGNi0yT0w1IiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiaGYtMjUuMDMuMTctMDUwOC10b29sLXVzZS12MiIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMTYwNzc4NjAyNjIsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvbmVtb3Ryb24tbWluaS00Yi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIlNhdmVkTW9kZWwiLAogICAgIm5hbWUiOiAibGxhbWEtMy4xLW5lbW90cm9uLW5hbm8tOGItdjEiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiT1RIRVIiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJMbGFtYS0zLjEtTmVtb3Ryb24tTmFuby04Qi12MSBpcyBhIG1vZGVsIGZvciBnZW5lcmF0aW5nIHJlc3BvbnNlcyBmb3Igcm9sZXBsYXlpbmcsIHJldHJpZXZhbCBhdWdtZW50ZWQgZ2VuZXJhdGlvbiwgYW5kIGZ1bmN0aW9uIGNhbGxpbmcuIEl0IGlzIGEgc21hbGwgbGFuZ3VhZ2UgbW9kZWwgKFNMTSkgb3B0aW1pemVkIHRocm91Z2ggZGlzdGlsbGF0aW9uLCBwcnVuaW5nIGFuZCBxdWFudGl6YXRpb24uIiwKICAgICJ0ZWFtTmFtZSI6ICJudmlkaWEiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDUtMjlUMTk6NDY6MDAuMjM0WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama-3.1-nemotron-nano-8b-v1 optimizationProfiles: - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:a100x2-latency-bf16-zxsnn7zu2g framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 A100x2 BF16 Latency ngcMetadata: 2146fcf18ea0412d564c6ed21d2f727281b95361fd78ccfa3d0570ec1716e8db: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:a100x1-throughput-bf16-jfn07bk9ua framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 A100x1 BF16 Throughput ngcMetadata: 222d1729a785201e8a021b226d74d227d01418c41b556283ee1bdbf0a818bd94: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100_NVLx1 BF16 Throughput ngcMetadata: 25b5e251d366671a4011eaada9872ad1d02b48acc33aa0637853a3e3c3caa516: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h200x1-throughput-bf16-hqyhv2wimw framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H200x1 BF16 Throughput ngcMetadata: 434e8d336fa23cbe151748d32b71e196d69f20d319ee8b59852a1ca31a48d311: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__2 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100_NVLx1 FP8 Throughput ngcMetadata: 5811750e70b7e9f340f4d670c72fcbd5282e254aeb31f62fd4f937cfb9361007: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h200x2-latency-bf16-q6opgs6yja framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H200x2 BF16 Latency ngcMetadata: 6832a9395f54086162fd7b1c6cfaae17c7d1e535a60e2b7675504c9fc7b57689: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h100x2-latency-fp8-zsiywmloya framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100x2 FP8 Latency ngcMetadata: 6c3f01dd2b2a56e3e83f70522e4195d3f2add70b28680082204bbb9d6150eb04: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h100x1-throughput-fp8-5tn9pkgdbq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100x1 FP8 Throughput ngcMetadata: 7b508014e846234db3cabe5c9f38568b4ee96694b60600a0b71c621dc70cacf3: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx4-latency-bf16-k3y094rsxq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx4 BF16 Latency ngcMetadata: 844ebe2b42df8de8ce66cbb6ecf43f90858ea7efc14ddf020cf1ae7450ae0c33: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 19GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:a10gx2-throughput-bf16-htgj9vhmiw framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 A10Gx2 BF16 Throughput ngcMetadata: 8a62b002be0b7f82c407e5ed45c50dabe654deca052b521a920682f918323d0d: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 2 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx2-throughput-bf16-qivaletdla framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx2 BF16 Throughput ngcMetadata: 973a6bfbfc5d13fc5eb18f5011fab777a5bd257d5807e97f842a3364e82160dc: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__3 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100_NVLx2 FP8 Latency ngcMetadata: a00ce1e782317cd19ed192dcb0ce26ab8b0c1da8928c33de8893897888ff7580: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx1-throughput-bf16-anodjae0ya framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx1 BF16 Throughput ngcMetadata: ac5071bbd91efcc71dc486fcd5210779570868b3b8328b4abf7a408a58b5e57c: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx1-throughput-fp8-dbamkqep8q framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx1 FP8 Throughput ngcMetadata: ad17776f4619854fccd50354f31132a558a1ca619930698fd184d6ccf5fe3c99: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h200x1-throughput-fp8-mafkx9-zmq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H200x1 FP8 Throughput ngcMetadata: af876a179190d1832143f8b4f4a71f640f3df07b0503259cedee3e3a8363aa96: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h100x2-latency-bf16-iq2eo5lxgw framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100x2 BF16 Latency ngcMetadata: b3d535c0a7eaaea089b087ae645417c0b32fd01e7e9d638217cc032e51e74fd0: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__4 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100_NVLx2 BF16 Latency ngcMetadata: b7fad3b35b07d623fac6549078305b71d0e6e1d228a86fa0f7cfe4dbeca9151a: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx2-latency-fp8-hkd8uidneq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx2 FP8 Latency ngcMetadata: c4ff823a8202af4b523274fb8c6cdd73fa8ee5af16391a6d36b17f714a3c71a0: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h200x2-latency-fp8-a3-t7tca3g framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H200x2 FP8 Latency ngcMetadata: e4f217a5fb016b570e34b8a8eb06051ccfef9534ba43da973bb7f678242eaa5f: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:h100x1-throughput-bf16-iugafozvdq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 H100x1 BF16 Throughput ngcMetadata: e7dbd9a8ce6270d2ec649a0fecbcae9b5336566113525f20aee3809ba5e63856: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:l40sx2-latency-bf16-z1ujefobmq framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 L40Sx2 BF16 Latency ngcMetadata: fa36c3502e92c50f78a1906242f929864955e702b7dbfbdb19758fb7ee9aa811: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__5 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 Generic NVIDIA GPUx2 BF16 ngcMetadata: 375dc0ff86133c2a423fbe9ef46d8fdf12d6403b3caa3b8e70d7851a89fc90dd: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '2' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 2 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__6 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 Generic NVIDIA GPUx4 BF16 ngcMetadata: 54946b08b79ecf9e7f2d5c000234bf2cce19c8fee21b243c1a084b03897e8c95: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '4' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 4 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB - profileId: nim/nvidia/llama-3.1-nemotron-nano-8b-v1:hf-25.03.17-0508-tool-use-v2__7 framework: TensorRT-LLM displayName: Llama 3.1 Nemotron Nano 8B V1 Generic NVIDIA GPUx1 BF16 ngcMetadata: ac34857f8dcbd174ad524974248f2faf271bd2a0355643b2cf1490d0fe7787c2: model: nvidia/llama-3.1-nemotron-nano-8b-v1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '1' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 15GB labels: - Llama - Meta - Text Generation - Large Language Model - NVIDIA Validated - Nemo config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Llama 3.1 Instruct displayName: Llama 3.1 Instruct modelHubID: llama-3.1-instruct category: Language type: NGC description: Multilingual instruction-following model optimized for chat, reasoning, and text generation. Strong performance across diverse language benchmarks. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: Llama 3.1 8B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0wM1QyMzozMDo1MS4yNTdaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjICoqTGxhbWEtMy4xLThCLUluc3RydWN0IE92ZXJ2aWV3KipcblxuIyMgKipEZXNjcmlwdGlvbjoqKlxuXG4qKkxsYW1hLTMuMS04Qi1JbnN0cnVjdCoqIGlzIGFuIDggYmlsbGlvbiBwYXJhbWV0ZXIsIGluc3RydWN0aW9uLXR1bmVkIGxhcmdlIGxhbmd1YWdlIG1vZGVsIGNyZWF0ZWQgYnkgTWV0YS4gVGhpcyBtb2RlbCBpcyBwYXJ0IG9mIHRoZSBMbGFtYSAzLjEgZmFtaWx5IG9mIG9wZW4tYWNjZXNzIG1vZGVscyBhbmQgaXMgc3BlY2lmaWNhbGx5IG9wdGltaXplZCBmb3IgZGlhbG9ndWUgYW5kIGNvbnZlcnNhdGlvbmFsIHVzZSBjYXNlcywgbWFraW5nIGl0IGhpZ2hseSBjYXBhYmxlIG9mIGZvbGxvd2luZyB1c2VyIGluc3RydWN0aW9ucyB0byBwZXJmb3JtIGEgd2lkZSB2YXJpZXR5IG9mIG5hdHVyYWwgbGFuZ3VhZ2UgcHJvY2Vzc2luZyB0YXNrcy5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbC9ub24tY29tbWVyY2lhbCB1c2UuXG5cblRoaXMgdmVyc2lvbiBpbnRyb2R1Y2VzIHN1cHBvcnQgZm9yIEdCMjAwIE5WTDcyLCBHSDIwMCBOVkwyLCBCMjAwIGFuZCBOVkZQNC4gQ1VEQSB1cGRhdGVkIHRvIHZlcnNpb24gMTIuOS4gRm9yIGRldGFpbGVkIGluZm9ybWF0aW9uLCByZWZlciB0byBSZWxlYXNlIFtOb3RlcyBmb3IgTlZJRElBIE5JTSBmb3IgTExNcyBMTE0gMS4xMl0oaHR0cHM6Ly9kb2NzLm52aWRpYS5jb20vbmltL2xhcmdlLWxhbmd1YWdlLW1vZGVscy9sYXRlc3QvcmVsZWFzZS1ub3Rlcy5odG1sKS4gXG5cbiMjICoqVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb24qKlxuXG5UaGlzIG1vZGVsIGlzIG5vdCBvd25lZCBvciBkZXZlbG9wZWQgYnkgTlZJRElBLiBUaGlzIG1vZGVsIGhhcyBiZWVuIGRldmVsb3BlZCBhbmQgYnVpbHQgdG8gYSB0aGlyZC1wYXJ0eSdzIHJlcXVpcmVtZW50cyBmb3IgdGhpcyBhcHBsaWNhdGlvbiBhbmQgdXNlIGNhc2U7IHNlZSBsaW5rIHRvIE5vbi1OVklESUEgXFxbbWV0YS1sbGFtYS9MbGFtYS0zLjEtOEItSW5zdHJ1Y3RcXF0gIFxuKFtodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLThCLUluc3RydWN0XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLThCLUluc3RydWN0KSkuIFxuXG4jIyAqKkxpY2Vuc2UvVGVybXMgb2YgVXNlOioqXG5cbioqR09WRVJOSU5HIFRFUk1TOioqIFRoZSBOSU0gY29udGFpbmVyIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIFNvZnR3YXJlIExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtc29mdHdhcmUtbGljZW5zZS1hZ3JlZW1lbnQvKSBhbmQgdGhlIFtQcm9kdWN0LVNwZWNpZmljIFRlcm1zIGZvciBOVklESUEgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzLyk7IGFuZCB0aGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQ29tbXVuaXR5IE1vZGVsIExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykuIFxuXG4qKkFERElUSU9OQUwgSU5GT1JNQVRJT04qKjogW0xsYW1hIDMuMSBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMS9saWNlbnNlLykuIEJ1aWx0IHdpdGggTGxhbWEuXG5cbllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIHByb3ZpZGVkIG1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuXG5cbiMjICoqRGVwbG95bWVudCBHZW9ncmFwaHk6KipcblxuR2xvYmFsIFxuXG4jIyAqKlVzZSBDYXNlOioqXG5cblRoaXMgbW9kZWwgaXMgcHJpbWFyaWx5IHVzZWQgYnkgZGV2ZWxvcGVycywgcmVzZWFyY2hlcnMsIGFuZCBidXNpbmVzc2VzIHRvIGJ1aWxkIGFuZCBleHBlcmltZW50IHdpdGggYSB3aWRlIHJhbmdlIG9mIGdlbmVyYXRpdmUgQUkgYXBwbGljYXRpb25zLiBJdHMgY29tYmluYXRpb24gb2Ygc3Ryb25nIHBlcmZvcm1hbmNlLCBlZmZpY2llbmN5LCBhbmQgYW4gb3Blbi1hY2Nlc3MgbGljZW5zZSBtYWtlcyBpdCBoaWdobHkgdmVyc2F0aWxlLlxuXG4qIERldmVsb3BlcnMgYW5kIEJ1c2luZXNzZXMgd291bGQgdXNlIHRoaXMgbW9kZWwgdG8gY3JlYXRlIHByb2R1Y3Rpb24tcmVhZHkgYXBwbGljYXRpb25zIHN1Y2ggYXM6ICBcbiAgKiBBSSBDaGF0Ym90cyBhbmQgY3VzdG9tZXIgc2VydmljZSBhZ2VudHMuICBcbiAgKiBDb250ZW50IGNyZWF0aW9uIHRvb2xzIGZvciB3cml0aW5nIGVtYWlscywgbWFya2V0aW5nIGNvcHksIGFuZCBhcnRpY2xlcy4gIFxuICAqIFN1bW1hcml6YXRpb24gYW5kIHF1ZXN0aW9uLWFuc3dlcmluZyBzeXN0ZW1zIGZvciBpbnRlcm5hbCBkb2N1bWVudHMuICBcbiAgKiBDb2RlIGdlbmVyYXRpb24gYXNzaXN0YW50cyB0byBoZWxwIHByb2dyYW1tZXJzIHdyaXRlIGFuZCBkZWJ1ZyBjb2RlLiAgXG4qIFJlc2VhcmNoZXJzIHdvdWxkIHVzZSBpdCB0byBzdHVkeSBsYXJnZSBsYW5ndWFnZSBtb2RlbCBiZWhhdmlvciwgZXhwbG9yZSBBSSBzYWZldHkgYW5kIGFsaWdubWVudCwgYW5kIGJlbmNobWFyayBuZXcgdHJhaW5pbmcgb3IgZmluZS10dW5pbmcgdGVjaG5pcXVlcyBvbiBhIGNhcGFibGUsIG9wZW4gbW9kZWwuICBcbiogQUkgSG9iYnlpc3RzIHdvdWxkIHVzZSB0aGUgbW9kZWwgZm9yIHBlcnNvbmFsIHByb2plY3RzLCBydW5uaW5nIGl0IG9uIGNvbnN1bWVyLWdyYWRlIGhhcmR3YXJlIHRvIGV4cGVyaW1lbnQgd2l0aCBjcmVhdGluZyB0aGVpciBvd24gQUkgYXNzaXN0YW50cyBvciBleHBsb3JpbmcgdGhlIGZyb250aWVycyBvZiBnZW5lcmF0aXZlIEFJLlxuXG4jIyAqKlJlbGVhc2UgRGF0ZToqKlxuXG5CdWlsZC5OdmlkYS5jb20gMDcvMjMvMjAyNCB2aWEgIFxuKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9tZXRhL2xsYW1hLTNfMS04Yi1pbnN0cnVjdClcblxuSHVnZ2luZ2ZhY2UgMDcvMjMvMjAyNCB2aWEgICBcbihodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLThCLUluc3RydWN0KVxuXG4jIyAqKlJlZmVyZW5jZShzKToqKiBcblxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjEtOEItSW5zdHJ1Y3RdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjEtOEItSW5zdHJ1Y3QpIFxuXG4jIyAqKk1vZGVsIEFyY2hpdGVjdHVyZToqKiBcblxuQXJjaGl0ZWN0dXJlIFR5cGU6IFRyYW5zZm9ybWVyICBcbk5ldHdvcmsgQXJjaGl0ZWN0dXJlOiBMbGFtYS0zLjEtOEJcblxuVGhpcyBtb2RlbCB3YXMgZGV2ZWxvcGVkIGJhc2VkIG9uIE1ldGEgTGxhbWEtMy4xLThCICBcbltodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLThCLUluc3RydWN0XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLThCLUluc3RydWN0KSBcblxuTnVtYmVyIG9mIG1vZGVsIHBhcmFtZXRlcnM6IDguMDMqMTBeOVxuIyMgKipJbnB1dDoqKlxuXG5JbnB1dCBUeXBlKHMpOiBUZXh0IFxuXG5JbnB1dCBGb3JtYXQocyk6IFN0cmluZyBcblxuSW5wdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OiBUaGUgcHJpbWFyeSBpbnB1dCBsaW1pdCBpcyB0aGUgbW9kZWwncyBtYXhpbXVtIGNvbnRleHQgbGVuZ3RoLCB3aGljaCBpcyAxMjgsMDAwIHRva2Vucy4gQWxsIGlucHV0IHRleHQgbXVzdCBiZSBwcmUtcHJvY2Vzc2VkIHVzaW5nIHRoZSBtb2RlbCdzIHNwZWNpZmljIHRva2VuaXplciB0byBjb252ZXJ0IHRoZSBzdHJpbmcgaW50byBhIHNlcXVlbmNlIG9mIHRva2VuIElEcy4gRm9yIGNvbnZlcnNhdGlvbmFsIHVzZSwgaW5wdXRzIHNob3VsZCBiZSBmb3JtYXR0ZWQgdXNpbmcgdGhlIG1vZGVsJ3MgZGVzaWduYXRlZCBjaGF0IHRlbXBsYXRlLlxuXG4jIyAqKk91dHB1dDoqKlxuXG5PdXRwdXQgVHlwZShzKTogVGV4dCBcblxuT3V0cHV0IEZvcm1hdChzKTogU3RyaW5nXG5cbk91dHB1dCBQYXJhbWV0ZXJzOiBPbmUtRGltZW5zaW9uYWwgKDFEKVxuXG5PdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0OiBUaGUgb3V0cHV0IGNvbnNpc3RzIG9mIGEgdmFyaWFibGUtbGVuZ3RoIHNlcXVlbmNlIG9mIHRva2VucyBmcm9tIHRoZSBtb2RlbCdzIHZvY2FidWxhcnkuIFRoZSB0b3RhbCBsZW5ndGggb2YgdGhlIGlucHV0IGFuZCBvdXRwdXQgY2Fubm90IGV4Y2VlZCB0aGUgMTI4LDAwMC10b2tlbiBjb250ZXh0IHdpbmRvdy4gUG9zdC1wcm9jZXNzaW5nIGlzIHJlcXVpcmVkIHRvIGRldG9rZW5pemUgdGhlIHJhdyB0b2tlbiBJRCBzZXF1ZW5jZSBpbnRvIGEgaHVtYW4tcmVhZGFibGUgc3RyaW5nLlxuXG4jIyAqKlNvZnR3YXJlIEludGVncmF0aW9uOioqXG5cblJ1bnRpbWUgRW5naW5lOiB2TExNLCBUZW5zb3JSVFxuXG5TdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eTpcblxuTlZJRElBIEFtcGVyZSAgXG5OVklESUEgQmxhY2t3ZWxsICBcbk5WSURJQSBIb3BwZXIgIFxuTlZJRElBIExvdmVsYWNlIFxuXG5QcmVmZXJyZWQgT3BlcmF0aW5nIFN5c3RlbShzKTpcblxuTGludXggICBcbldpbmRvd3MgIFxubWFjT1NcblxuVGhlIGludGVncmF0aW9uIG9mIGZvdW5kYXRpb24gYW5kIGZpbmUtdHVuZWQgbW9kZWxzIGludG8gQUkgc3lzdGVtcyByZXF1aXJlcyBhZGRpdGlvbmFsIHRlc3RpbmcgdXNpbmcgdXNlLWNhc2Utc3BlY2lmaWMgZGF0YSB0byBlbnN1cmUgc2FmZSBhbmQgZWZmZWN0aXZlIGRlcGxveW1lbnQuIEZvbGxvd2luZyB0aGUgVi1tb2RlbCBtZXRob2RvbG9neSwgaXRlcmF0aXZlIHRlc3RpbmcgYW5kIHZhbGlkYXRpb24gYXQgYm90aCB1bml0IGFuZCBzeXN0ZW0gbGV2ZWxzIGFyZSBlc3NlbnRpYWwgdG8gbWl0aWdhdGUgcmlza3MsIG1lZXQgdGVjaG5pY2FsIGFuZCBmdW5jdGlvbmFsIHJlcXVpcmVtZW50cywgYW5kIGVuc3VyZSBjb21wbGlhbmNlIHdpdGggc2FmZXR5IGFuZCBldGhpY2FsIHN0YW5kYXJkcyBiZWZvcmUgZGVwbG95bWVudC5cblxuIyMgKipNb2RlbCBWZXJzaW9uKHMpOioqXG5cbipMbGFtYS0zLjEtOEItSW5zdHJ1Y3QtMS4xMC4xIFxuKkxsYW1hLTMuMS04Qi1JbnN0cnVjdC0xLjEyLjBcbipMbGFtYS0zLjEtOEItSW5zdHJ1Y3QtMS4xMy4xXG5cbiMjICoqVXNhZ2UqKlxuXG4jIyMgKipVc2Ugd2l0aCB0cmFuc2Zvcm1lcnMqKlxuXG5TdGFydGluZyB3aXRoIHRyYW5zZm9ybWVycyBcXD49IDQuNDMuMCBvbndhcmQsIHlvdSBjYW4gcnVuIGNvbnZlcnNhdGlvbmFsIGluZmVyZW5jZSB1c2luZyB0aGUgVHJhbnNmb3JtZXJzIHBpcGVsaW5lIGFic3RyYWN0aW9uIG9yIGJ5IGxldmVyYWdpbmcgdGhlIEF1dG8gY2xhc3NlcyB3aXRoIHRoZSBnZW5lcmF0ZSgpIGZ1bmN0aW9uLlxuXG5NYWtlIHN1cmUgdG8gdXBkYXRlIHlvdXIgdHJhbnNmb3JtZXJzIGluc3RhbGxhdGlvbiB2aWEgcGlwIGluc3RhbGwgXFwtLXVwZ3JhZGUgdHJhbnNmb3JtZXJzLlxuXG5gYGBcbmltcG9ydCB0cmFuc2Zvcm1lcnNcbmltcG9ydCB0b3JjaFxuXG5tb2RlbF9pZCA9IFwibWV0YS1sbGFtYS9NZXRhLUxsYW1hLTMuMS04Qi1JbnN0cnVjdFwiXG5cbnBpcGVsaW5lID0gdHJhbnNmb3JtZXJzLnBpcGVsaW5lKFxuICAgIFwidGV4dC1nZW5lcmF0aW9uXCIsXG4gICAgbW9kZWw9bW9kZWxfaWQsXG4gICAgbW9kZWxfa3dhcmdzPXtcInRvcmNoX2R0eXBlXCI6IHRvcmNoLmJmbG9hdDE2fSxcbiAgICBkZXZpY2VfbWFwPVwiYXV0b1wiLFxuKVxuXG5tZXNzYWdlcyA9IFtcbiAgICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIllvdSBhcmUgYSBwaXJhdGUgY2hhdGJvdCB3aG8gYWx3YXlzIHJlc3BvbmRzIGluIHBpcmF0ZSBzcGVhayFcIn0sXG4gICAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiV2hvIGFyZSB5b3U/XCJ9LFxuXVxuXG5vdXRwdXRzID0gcGlwZWxpbmUoXG4gICAgbWVzc2FnZXMsXG4gICAgbWF4X25ld190b2tlbnM9MjU2LFxuKVxucHJpbnQob3V0cHV0c1swXVtcImdlbmVyYXRlZF90ZXh0XCJdWy0xXSlcbmBgYFxuXG5Ob3RlOiBZb3UgY2FuIGFsc28gZmluZCBkZXRhaWxlZCByZWNpcGVzIG9uIGhvdyB0byB1c2UgdGhlIG1vZGVsIGxvY2FsbHksIHdpdGggdG9yY2guY29tcGlsZSgpLCBhc3Npc3RlZCBnZW5lcmF0aW9ucywgcXVhbnRpc2VkIGFuZCBtb3JlIGF0IFtodWdnaW5nZmFjZS1sbGFtYS1yZWNpcGVzXShodHRwczovL2dpdGh1Yi5jb20vaHVnZ2luZ2ZhY2UvaHVnZ2luZ2ZhY2UtbGxhbWEtcmVjaXBlcylcblxuIyMjICoqVG9vbCB1c2Ugd2l0aCB0cmFuc2Zvcm1lcnMqKlxuXG5MTGFNQS0zLjEgc3VwcG9ydHMgbXVsdGlwbGUgdG9vbCB1c2UgZm9ybWF0cy4gWW91IGNhbiBzZWUgYSBmdWxsIGd1aWRlIHRvIHByb21wdCBmb3JtYXR0aW5nIFtoZXJlXShodHRwczovL2xsYW1hLm1ldGEuY29tL2RvY3MvbW9kZWwtY2FyZHMtYW5kLXByb21wdC1mb3JtYXRzL2xsYW1hM18xLykuXG5cblRvb2wgdXNlIGlzIGFsc28gc3VwcG9ydGVkIHRocm91Z2ggW2NoYXQgdGVtcGxhdGVzXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RvY3MvdHJhbnNmb3JtZXJzL21haW4vY2hhdF90ZW1wbGF0aW5nI2FkdmFuY2VkLXRvb2wtdXNlLS1mdW5jdGlvbi1jYWxsaW5nKSBpbiBUcmFuc2Zvcm1lcnMuIEhlcmUgaXMgYSBxdWljayBleGFtcGxlIHNob3dpbmcgYSBzaW5nbGUgc2ltcGxlIHRvb2w6XG5cbmBgYFxuIyBGaXJzdCwgZGVmaW5lIGEgdG9vbFxuZGVmIGdldF9jdXJyZW50X3RlbXBlcmF0dXJlKGxvY2F0aW9uOiBzdHIpIC0+IGZsb2F0OlxuICAgIFwiXCJcIlxuICAgIEdldCB0aGUgY3VycmVudCB0ZW1wZXJhdHVyZSBhdCBhIGxvY2F0aW9uLlxuICAgIFxuICAgIEFyZ3M6XG4gICAgICAgIGxvY2F0aW9uOiBUaGUgbG9jYXRpb24gdG8gZ2V0IHRoZSB0ZW1wZXJhdHVyZSBmb3IsIGluIHRoZSBmb3JtYXQgXCJDaXR5LCBDb3VudHJ5XCJcbiAgICBSZXR1cm5zOlxuICAgICAgICBUaGUgY3VycmVudCB0ZW1wZXJhdHVyZSBhdCB0aGUgc3BlY2lmaWVkIGxvY2F0aW9uIGluIHRoZSBzcGVjaWZpZWQgdW5pdHMsIGFzIGEgZmxvYXQuXG4gICAgXCJcIlwiXG4gICAgcmV0dXJuIDIyLiAgIyBBIHJlYWwgZnVuY3Rpb24gc2hvdWxkIHByb2JhYmx5IGFjdHVhbGx5IGdldCB0aGUgdGVtcGVyYXR1cmUhXG5cbiMgTmV4dCwgY3JlYXRlIGEgY2hhdCBhbmQgYXBwbHkgdGhlIGNoYXQgdGVtcGxhdGVcbm1lc3NhZ2VzID0gW1xuICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIllvdSBhcmUgYSBib3QgdGhhdCByZXNwb25kcyB0byB3ZWF0aGVyIHF1ZXJpZXMuXCJ9LFxuICB7XCJyb2xlXCI6IFwidXNlclwiLCBcImNvbnRlbnRcIjogXCJIZXksIHdoYXQncyB0aGUgdGVtcGVyYXR1cmUgaW4gUGFyaXMgcmlnaHQgbm93P1wifVxuXVxuXG5pbnB1dHMgPSB0b2tlbml6ZXIuYXBwbHlfY2hhdF90ZW1wbGF0ZShtZXNzYWdlcywgdG9vbHM9W2dldF9jdXJyZW50X3RlbXBlcmF0dXJlXSwgYWRkX2dlbmVyYXRpb25fcHJvbXB0PVRydWUpXG5gYGBcblxuWW91IGNhbiB0aGVuIGdlbmVyYXRlIHRleHQgZnJvbSB0aGlzIGlucHV0IGFzIG5vcm1hbC4gSWYgdGhlIG1vZGVsIGdlbmVyYXRlcyBhIHRvb2wgY2FsbCwgeW91IHNob3VsZCBhZGQgaXQgdG8gdGhlIGNoYXQgbGlrZSBzbzpcblxuYGBgXG50b29sX2NhbGwgPSB7XCJuYW1lXCI6IFwiZ2V0X2N1cnJlbnRfdGVtcGVyYXR1cmVcIiwgXCJhcmd1bWVudHNcIjoge1wibG9jYXRpb25cIjogXCJQYXJpcywgRnJhbmNlXCJ9fVxubWVzc2FnZXMuYXBwZW5kKHtcInJvbGVcIjogXCJhc3Npc3RhbnRcIiwgXCJ0b29sX2NhbGxzXCI6IFt7XCJ0eXBlXCI6IFwiZnVuY3Rpb25cIiwgXCJmdW5jdGlvblwiOiB0b29sX2NhbGx9XX0pXG5gYGBcblxuYW5kIHRoZW4gY2FsbCB0aGUgdG9vbCBhbmQgYXBwZW5kIHRoZSByZXN1bHQsIHdpdGggdGhlIHRvb2wgcm9sZSwgbGlrZSBzbzpcblxuYGBgXG5tZXNzYWdlcy5hcHBlbmQoe1wicm9sZVwiOiBcInRvb2xcIiwgXCJuYW1lXCI6IFwiZ2V0X2N1cnJlbnRfdGVtcGVyYXR1cmVcIiwgXCJjb250ZW50XCI6IFwiMjIuMFwifSlcbmBgYFxuXG5BZnRlciB0aGF0LCB5b3UgY2FuIGdlbmVyYXRlKCkgYWdhaW4gdG8gbGV0IHRoZSBtb2RlbCB1c2UgdGhlIHRvb2wgcmVzdWx0IGluIHRoZSBjaGF0LiBOb3RlIHRoYXQgdGhpcyB3YXMgYSB2ZXJ5IGJyaWVmIGludHJvZHVjdGlvbiB0byB0b29sIGNhbGxpbmcgXFwtIGZvciBtb3JlIGluZm9ybWF0aW9uLCBzZWUgdGhlIFtMTGFNQSBwcm9tcHQgZm9ybWF0IGRvY3NdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vZG9jcy9tb2RlbC1jYXJkcy1hbmQtcHJvbXB0LWZvcm1hdHMvbGxhbWEzXzEvKSBhbmQgdGhlIFRyYW5zZm9ybWVycyBbdG9vbCB1c2UgZG9jdW1lbnRhdGlvbl0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kb2NzL3RyYW5zZm9ybWVycy9tYWluL2NoYXRfdGVtcGxhdGluZyNhZHZhbmNlZC10b29sLXVzZS0tZnVuY3Rpb24tY2FsbGluZykuXG5cbiMjICoqVHJhaW5pbmcsIFRlc3RpbmcsIGFuZCBFdmFsdWF0aW9uIERhdGFzZXRzOioqXG5cbiMjIyAqKlRyYWluaW5nIERhdGFzZXQqKlxuXG4qKkRhdGEgTW9kYWxpdHk6KiogVGV4dCBcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWRcblxuKipQcm9wZXJ0aWVzOioqIFxuXG5UaGUgbW9kZWwgd2FzIHByZS10cmFpbmVkIG9uIGEgZGF0YXNldCBvZiBvdmVyIDE1IHRyaWxsaW9uIHRva2Vucy4gVGhpcyBkYXRhc2V0IGlzIGEgaGlnaC1xdWFsaXR5IG1peCBvZiBwdWJsaWNseSBhdmFpbGFibGUgZGF0YSwgaGVhdmlseSBmaWx0ZXJlZCBmb3Igc2FmZXR5IGFuZCBxdWFsaXR5LiBUaGUgaW5zdHJ1Y3Rpb24gZmluZS10dW5pbmcgZGF0YXNldCBpcyBzbWFsbGVyIGFuZCBjb25zaXN0cyBvZiBoaWdoLXF1YWxpdHkgcHJvbXB0cywgcmVzcG9uc2VzLCBhbmQgcHJlZmVyZW5jZSByYW5raW5ncyBjdXJhdGVkIGJ5IGh1bWFucy5cblxuIyMjICoqVGVzdGluZyBEYXRhc2V0KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWRcblxuKipMYWJlbGluZyBNZXRob2Q6KiogSHVtYW5cblxuKipQcm9wZXJ0aWVzOioqIFxuXG5UaGUgdGVzdGluZyBkYXRhc2V0cyBjb21wcmlzZSB0aG91c2FuZHMgb2YgaW5kaXZpZHVhbCBwcm9ibGVtcyBkZXNpZ25lZCB0byBtZWFzdXJlIG1vZGVsIGNhcGFiaWxpdGllcyBpbiBzcGVjaWZpYyBhcmVhczpcblxuKiAqKkdlbmVyYWwgS25vd2xlZGdlICYgUmVhc29uaW5nOioqIE1NTFUsIERST1AsIEFHSUV2YWwsIEJJRy1CZW5jaCBIYXJkICBcbiogKipNYXRoZW1hdGljczoqKiBHU004SywgTUFUSCAgXG4qICoqQ29kaW5nOioqIEh1bWFuRXZhbFxuXG4jIyMgKipFdmFsdWF0aW9uIERhdGFzZXQqKlxuXG4qKkxpbms6KiogVW5kaXNjbG9zZWRcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kOioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIdW1hblxuXG4qKlByb3BlcnRpZXM6KiogXG5cblRoZSBldmFsdWF0aW9uIGRhdGFzZXRzIGNvbnNpc3Qgb2YgdGhvdXNhbmRzIG9mIHF1ZXN0aW9ucyBhbmQgcHJvYmxlbXMgZGVzaWduZWQgdG8gdGVzdCB0aGUgbW9kZWwncyBjYXBhYmlsaXRpZXMgaW4gYXJlYXMgbGlrZSBnZW5lcmFsIGtub3dsZWRnZSwgcmVhc29uaW5nLCBtYXRoZW1hdGljcywgYW5kIGNvZGluZy5cblxuKipCYXNlIHByZXRyYWluZWQgbW9kZWxzKipcblxufCBDYXRlZ29yeSB8IEJlbmNobWFyayB8IFxcIyBTaG90cyB8IE1ldHJpYyB8IExsYW1hIDMgOEIgfCBMbGFtYSAzLjEgOEIgfCBMbGFtYSAzIDcwQiB8IExsYW1hIDMuMSA3MEIgfCBMbGFtYSAzLjEgNDA1QiB8XG58IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8XG58IEdlbmVyYWwgfCBNTUxVIHwgNSB8IG1hY3JvXFxfYXZnL2FjY1xcX2NoYXIgfCA2Ni43IHwgNjYuNyB8IDc5LjUgfCA3OS4zIHwgODUuMiB8XG58ICB8IE1NTFUtUHJvIChDb1QpIHwgNSB8IG1hY3JvXFxfYXZnL2FjY1xcX2NoYXIgfCAzNi4yIHwgMzcuMSB8IDU1LjAgfCA1My44IHwgNjEuNiB8XG58ICB8IEFHSUV2YWwgRW5nbGlzaCB8IDMtNSB8IGF2ZXJhZ2UvYWNjXFxfY2hhciB8IDQ3LjEgfCA0Ny44IHwgNjMuMCB8IDY0LjYgfCA3MS42IHxcbnwgIHwgQ29tbW9uU2Vuc2VRQSB8IDcgfCBhY2NcXF9jaGFyIHwgNzIuNiB8IDc1LjAgfCA4My44IHwgODQuMSB8IDg1LjggfFxufCAgfCBXaW5vZ3JhbmRlIHwgNSB8IGFjY1xcX2NoYXIgfCBcXC0gfCA2MC41IHwgXFwtIHwgODMuMyB8IDg2LjcgfFxufCAgfCBCSUctQmVuY2ggSGFyZCAoQ29UKSB8IDMgfCBhdmVyYWdlL2VtIHwgNjEuMSB8IDY0LjIgfCA4MS4zIHwgODEuNiB8IDg1LjkgfFxufCAgfCBBUkMtQ2hhbGxlbmdlIHwgMjUgfCBhY2NcXF9jaGFyIHwgNzkuNCB8IDc5LjcgfCA5My4xIHwgOTIuOSB8IDk2LjEgfFxufCBLbm93bGVkZ2UgcmVhc29uaW5nIHwgVHJpdmlhUUEtV2lraSB8IDUgfCBlbSB8IDc4LjUgfCA3Ny42IHwgODkuNyB8IDg5LjggfCA5MS44IHxcbnwgUmVhZGluZyBjb21wcmVoZW5zaW9uIHwgU1F1QUQgfCAxIHwgZW0gfCA3Ni40IHwgNzcuMCB8IDg1LjYgfCA4MS44IHwgODkuMyB8XG58ICB8IFF1QUMgKEYxKSB8IDEgfCBmMSB8IDQ0LjQgfCA0NC45IHwgNTEuMSB8IDUxLjEgfCA1My42IHxcbnwgIHwgQm9vbFEgfCAwIHwgYWNjXFxfY2hhciB8IDc1LjcgfCA3NS4wIHwgNzkuMCB8IDc5LjQgfCA4MC4wIHxcbnwgIHwgRFJPUCAoRjEpIHwgMyB8IGYxIHwgNTguNCB8IDU5LjUgfCA3OS43IHwgNzkuNiB8IDg0LjggfFxuXG4qKkluc3RydWN0aW9uIHR1bmVkIG1vZGVscyoqXG5cbnwgQ2F0ZWdvcnkgfCBCZW5jaG1hcmsgfCBcXCMgU2hvdHMgfCBNZXRyaWMgfCBMbGFtYSAzIDhCIEluc3RydWN0IHwgTGxhbWEgMy4xIDhCIEluc3RydWN0IHwgTGxhbWEgMyA3MEIgSW5zdHJ1Y3QgfCBMbGFtYSAzLjEgNzBCIEluc3RydWN0IHwgTGxhbWEgMy4xIDQwNUIgSW5zdHJ1Y3QgfFxufCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfFxufCBHZW5lcmFsIHwgTU1MVSB8IDUgfCBtYWNyb1xcX2F2Zy9hY2MgfCA2OC41IHwgNjkuNCB8IDgyLjAgfCA4My42IHwgODcuMyB8XG58ICB8IE1NTFUgKENvVCkgfCAwIHwgbWFjcm9cXF9hdmcvYWNjIHwgNjUuMyB8IDczLjAgfCA4MC45IHwgODYuMCB8IDg4LjYgfFxufCAgfCBNTUxVLVBybyAoQ29UKSB8IDUgfCBtaWNyb1xcX2F2Zy9hY2NcXF9jaGFyIHwgNDUuNSB8IDQ4LjMgfCA2My40IHwgNjYuNCB8IDczLjMgfFxufCAgfCBJRkV2YWwgfCAgfCAgfCA3Ni44IHwgODAuNCB8IDgyLjkgfCA4Ny41IHwgODguNiB8XG58IFJlYXNvbmluZyB8IEFSQy1DIHwgMCB8IGFjYyB8IDgyLjQgfCA4My40IHwgOTQuNCB8IDk0LjggfCA5Ni45IHxcbnwgIHwgR1BRQSB8IDAgfCBlbSB8IDM0LjYgfCAzMC40IHwgMzkuNSB8IDQ2LjcgfCA1MC43IHxcbnwgQ29kZSB8IEh1bWFuRXZhbCB8IDAgfCBwYXNzQDEgfCA2MC40IHwgNzIuNiB8IDgxLjcgfCA4MC41IHwgODkuMCB8XG58ICB8IE1CUFAgXFwrKyBiYXNlIHZlcnNpb24gfCAwIHwgcGFzc0AxIHwgNzAuNiB8IDcyLjggfCA4Mi41IHwgODYuMCB8IDg4LjYgfFxufCAgfCBNdWx0aXBsLUUgSHVtYW5FdmFsIHwgMCB8IHBhc3NAMSB8IFxcLSB8IDUwLjggfCBcXC0gfCA2NS41IHwgNzUuMiB8XG58ICB8IE11bHRpcGwtRSBNQlBQIHwgMCB8IHBhc3NAMSB8IFxcLSB8IDUyLjQgfCBcXC0gfCA2Mi4wIHwgNjUuNyB8XG58IE1hdGggfCBHU00tOEsgKENvVCkgfCA4IHwgZW1cXF9tYWoxQDEgfCA4MC42IHwgODQuNSB8IDkzLjAgfCA5NS4xIHwgOTYuOCB8XG58ICB8IE1BVEggKENvVCkgfCAwIHwgZmluYWxcXF9lbSB8IDI5LjEgfCA1MS45IHwgNTEuMCB8IDY4LjAgfCA3My44IHxcbnwgVG9vbCBVc2UgfCBBUEktQmFuayB8IDAgfCBhY2MgfCA0OC4zIHwgODIuNiB8IDg1LjEgfCA5MC4wIHwgOTIuMCB8XG58ICB8IEJGQ0wgfCAwIHwgYWNjIHwgNjAuMyB8IDc2LjEgfCA4My4wIHwgODQuOCB8IDg4LjUgfFxufCAgfCBHb3JpbGxhIEJlbmNobWFyayBBUEkgQmVuY2ggfCAwIHwgYWNjIHwgMS43IHwgOC4yIHwgMTQuNyB8IDI5LjcgfCAzNS4zIHxcbnwgIHwgTmV4dXMgKDAtc2hvdCkgfCAwIHwgbWFjcm9cXF9hdmcvYWNjIHwgMTguMSB8IDM4LjUgfCA0Ny44IHwgNTYuNyB8IDU4LjcgfFxufCBNdWx0aWxpbmd1YWwgfCBNdWx0aWxpbmd1YWwgTUdTTSAoQ29UKSB8IDAgfCBlbSB8IFxcLSB8IDY4LjkgfCBcXC0gfCA4Ni45IHwgOTEuNiB8XG5cbioqTXVsdGlsaW5ndWFsIGJlbmNobWFya3MqKlxuXG58IENhdGVnb3J5IHwgQmVuY2htYXJrIHwgTGFuZ3VhZ2UgfCBMbGFtYSAzLjEgOEIgfCBMbGFtYSAzLjEgNzBCIHwgTGxhbWEgMy4xIDQwNUIgfFxufCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfFxufCBHZW5lcmFsIHwgTU1MVSAoNS1zaG90LCBtYWNyb1xcX2F2Zy9hY2MpIHwgUG9ydHVndWVzZSB8IDYyLjEyIHwgODAuMTMgfCA4NC45NSB8XG58ICB8ICB8IFNwYW5pc2ggfCA2Mi40NSB8IDgwLjA1IHwgODUuMDggfFxufCAgfCAgfCBJdGFsaWFuIHwgNjEuNjMgfCA4MC40IHwgODUuMDQgfFxufCAgfCAgfCBHZXJtYW4gfCA2MC41OSB8IDc5LjI3IHwgODQuMzYgfFxufCAgfCAgfCBGcmVuY2ggfCA2Mi4zNCB8IDc5LjgyIHwgODQuNjYgfFxufCAgfCAgfCBIaW5kaSB8IDUwLjg4IHwgNzQuNTIgfCA4MC4zMSB8XG58ICB8ICB8IFRoYWkgfCA1MC4zMiB8IDcyLjk1IHwgNzguMjEgfFxuXG4jIyAqKlRlY2huaWNhbCBMaW1pdGF0aW9ucyoqIFxuXG4gVGVzdGluZyBjb25kdWN0ZWQgdG8gZGF0ZSBoYXMgbm90IGNvdmVyZWQsIG5vciBjb3VsZCBpdCBjb3ZlciwgYWxsIHNjZW5hcmlvcy4gRm9yIHRoZXNlIHJlYXNvbnMsIGFzIHdpdGggYWxsIExMTXMsIHRoZSBtb2RlbCdzIHBvdGVudGlhbCBvdXRwdXRzIGNhbm5vdCBiZSBwcmVkaWN0ZWQgaW4gYWR2YW5jZSwgYW5kIHRoZSBtb2RlbCBtYXkgaW4gc29tZSBpbnN0YW5jZXMgcHJvZHVjZSBpbmFjY3VyYXRlLCBiaWFzZWQgb3Igb3RoZXIgb2JqZWN0aW9uYWJsZSByZXNwb25zZXMgdG8gdXNlciBwcm9tcHRzLiBUaGVyZWZvcmUsIGJlZm9yZSBkZXBsb3lpbmcgdGhpcyBtb2RlbCBpbiBhbnkgYXBwbGljYXRpb25zLCBkZXZlbG9wZXJzIHNob3VsZCBwZXJmb3JtIHNhZmV0eSB0ZXN0aW5nIGFuZCB0dW5pbmcgdGFpbG9yZWQgdG8gdGhlaXIgc3BlY2lmaWMgYXBwbGljYXRpb25zLiBQbGVhc2UgcmVmZXIgdG8gYXZhaWxhYmxlIHJlc291cmNlcyBpbmNsdWRpbmcgdGhlIFtSZXNwb25zaWJsZSBVc2UgR3VpZGVdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vcmVzcG9uc2libGUtdXNlLWd1aWRlKSwgW1RydXN0IGFuZCBTYWZldHldKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vdHJ1c3QtYW5kLXNhZmV0eS8pIHNvbHV0aW9ucywgYW5kIG90aGVyIFtyZXNvdXJjZXNdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vZG9jcy9nZXQtc3RhcnRlZC8pIHRvIGxlYXJuIG1vcmUgYWJvdXQgcmVzcG9uc2libGUgZGV2ZWxvcG1lbnQuIFxuXG4jIyAqKkluZmVyZW5jZToqKlxuXG4qKkFjY2VsZXJhdGlvbiBFbmdpbmU6KiogdkxMTSwgVGVuc29yUlQgXG5cbioqVGVzdCBIYXJkd2FyZToqKiBcblxuKiBCMjAwIFNYTSAgXG4qIEgyMDAgU1hNICBcbiogSDEwMCBTWE0gIFxuKiBBMTAwIFNYTSA4MEdCICBcbiogQTEwMCBTWE0gNDBHQiAgXG4qIEw0MFMgUENJZSAgXG4qIEExMEcgIFxuKiBIMTAwIE5WTCAgXG4qIEgyMDAgTlZMICBcbiogR0gyMDAgOTZHQlxuKiBHQjIwMCBOVkw3MlxuKiBHSDIwMCBOVkwyXG4qIFJUWCA1MDkwICBcbiogUlRYIDQwOTAgIFxuKiBSVFggNjAwMCBBZGFcblxuIyMgKipHZXQgSGVscCoqXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuIyMgKipFdGhpY2FsIENvbnNpZGVyYXRpb25zOioqXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLiBQbGVhc2UgcmVwb3J0IHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLlxuXG4qKllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIHByb3ZpZGVkIG1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKioiLAogICAgImRpc3BsYXlOYW1lIjogIkxsYW1hLTMuMS04Yi1pbnN0cnVjdCIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIkxsYW1hMy4xIiwKICAgICAgICAiTklNIiwKICAgICAgICAiTlNQRUNULTBEUVAtTE5MViIsCiAgICAgICAgImxsYW1hLTMuMS04Yi1pbnN0cnVjdCIsCiAgICAgICAgIm52YWllOm1vZGVsOm52YWllX3N1cHBvcnRlZCIsCiAgICAgICAgIm52aWRpYV9uaW06bW9kZWw6bmltbWNyb19udmlkaWFfbmltIiwKICAgICAgICAicHJvZHVjdE5hbWVzOm5pbS1kZXYiLAogICAgICAgICJwcm9kdWN0TmFtZXM6bnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAibGF0ZXN0VmVyc2lvbklkU3RyIjogInJ0eDYwMDAtYmxhY2t3ZWxsLXN2eDItbGF0ZW5jeS1iZjE2LXF5YWl0OXNvaHEiLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDE3NjM1OTc2OTM4LAogICAgImxvZ28iOiAiaHR0cHM6Ly9hc3NldHMubmdjLm52aWRpYS5jb20vcHJvZHVjdHMvYXBpLWNhdGFsb2cvaW1hZ2VzL2xsYW1hLTNfMS04Yi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIk4vQSIsCiAgICAibmFtZSI6ICJsbGFtYS0zLjEtOGItaW5zdHJ1Y3QiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiT1RIRVIiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJNZXRhIiwKICAgICJzYWZldHlBbmRTZWN1cml0eSI6ICIiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiVGhlIE1ldGEgTGxhbWEgMy4xIGNvbGxlY3Rpb24gb2YgbXVsdGlsaW5ndWFsIGxhcmdlIGxhbmd1YWdlIG1vZGVscyAoTExNcykgaXMgYSBjb2xsZWN0aW9uIG9mIHByZXRyYWluZWQgYW5kIGluc3RydWN0aW9uIHR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDhCLCA3MEIgYW5kIDQwNUIgc2l6ZXMgKHRleHQgaW4vdGV4dCBvdXQpLiIsCiAgICAidGVhbU5hbWUiOiAibWV0YSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0yMVQxNzo0Nzo1OS42MTNaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/llama-3_1-8b-instruct-nemo optimizationProfiles: - profileId: nim/meta/llama-3.1-8b-instruct:a10gx4-latency-bf16-r3bmpcovtw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A10Gx4 BF16 Latency ngcMetadata: 09fec372bdcfaee0662140bc5ed522900bb0b0da7cc37ceba6209731dc55a689: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c0232176c2e5374758e3d88ea13e70aa0edca0862c923428f54b85da208960a9 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 4 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 19GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100_NVLx2 FP8 Latency ngcMetadata: 0c87e2871cd7a6ea205a137109c3afde0134ba22c6fe8e978a752287cf561643: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: cb6ac7eedef673edc08e85f4f3e7525c31f499e5c5f376cbffc05cb8eefe197a number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x1-throughput-fp8-8imkyjutxw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x1 FP8 Throughput ngcMetadata: 0cf8ac8bfbf183d8a891e9023d6aa7a1d93f6720e5bd78e578711e3d5b822c52: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2feaef51b8c016e5c678f39202dfe542c11eb5fc2443749e6c2330f3474aaffe number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h100x2-latency-fp8-cvpqroehhq framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100x2 FP8 Latency ngcMetadata: 0e0a9fb28e4df4f8a2dcaafbcb03ce1e0b9d27a4e00ec273f27bcc47e7572225: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4217e8fa6ba7ac9609ee76470bec904253dadbe7fc33a52f715e08791073c501 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x2-latency-fp8-i4razlnzqw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x2 FP8 Latency ngcMetadata: 192d34f8204aa5c44b08406f8d98c86c606363ff8a2ca5f608b87a2516313b55: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0222120a0b05a944b22ed6b0d7376bbe89abef1c05fa6ecd7967199500398864 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__2 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200_NVLx1 BF16 Throughput ngcMetadata: 1d7b8b2d964254990181ba7a6e93687275c3372b689d66b6494ad5f788a108a6: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2660946198ebbb837e487b333ef86b2ac4cbc37b907151de45f291596625f919 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__3 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_ADAx1 INT4_AWQ Throughput ngcMetadata: 245a4f27515a6291ac239b37f209847384dbadaa5ad155c45d17bcc524594371: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4d714aa3567eb6e2d72aa08be91bb5fc632e7bbaa645c265104ea1d65eb28efa number_of_gpus: '1' pp: '1' precision: int4_awq profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: INT4_AWQ - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x1-throughput-bf16-zsf8rdhqtw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x1 BF16 Throughput ngcMetadata: 2465a2b2fc773ea207e312352258ca9a54650fc9ec9740ae96646528556a0916: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 61348d392451059a37d2218d940f4aaf266562d0d6fa156e211f266022d5d26e number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__4 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_480GBx1 BF16 Throughput ngcMetadata: 28e1523b3569391509a8e976f17c0b04e21faee7095225076a99636cbb1da858: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 828408fdd397e49bb4256a997d3f85d90c3d9a3e756531b8895cd78a83574aa6 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__5 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A100_SXM4_40GBx1 BF16 Throughput ngcMetadata: 40d4f2dcb13710bf7fcf1d9d41dfeb1b0ff22ba2d266bc2997a81a000fa5d031: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 72732266ad2f3d3b824f413f11716f81b87ccb602c3cdda972c7341c0d1e60b5 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 1 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h100x1-throughput-fp8-rmqqnk9ima framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100x1 FP8 Throughput ngcMetadata: 4411bf23579e41275d6a994cd768d9dc2ebbd523253e2844115f24644a5e86b1: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3950ee02bc0277147b77079c0cc5bc954b9189f7866fbbebc37ece4ec31283f6 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x2-latency-bf16-px49bz6jka framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x2 BF16 Latency ngcMetadata: 4a7b681f1dc1dcbc0b98f4c4eaa6bdac6557af058dd878039624c68683e2dee3: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 467e29e38751b085aa13fdc92f6eaf1a08a8c360ef19718a92f64bd507221fd8 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x2-latency-bf16--fupfm1fjg framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x2 BF16 Latency ngcMetadata: 4b344f09436a75385ad7c78aa224f685d1f92980ccf7ea52f29a52c1ca646b70: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0a3a8da158191386b506caa79c0bd9787f45009a7e52113b82fcdde0511001d7 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:l40sx2-latency-bf16-aauqggrlkw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct L40Sx2 BF16 Latency ngcMetadata: 55df9113a4cd134e4ddaeeae43cd33089be30b74380a9bc29d677ed9784a3492: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9b1feaf6e923581317ff4291ca09856eb403efd7acdeee1c8e787d988ced56ce number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h200x2-latency-bf16-zwyr4clzla framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200x2 BF16 Latency ngcMetadata: 588fa4150abaa001f1357112de2ca65c85c1c86322b3f7d0ca9f1451f40baee5: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7b377dc3e02bbcef7ec1c0ccee4afc1d99d2409dc7ab6576f1f386ebbedeabc6 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x2-latency-nvfp4-urjebtmqkg framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x2 NVFP4 Latency ngcMetadata: 5eaaf502f6dab9ce29e7d034182bb56eeeb3e349633f4561018f27b3069189b3: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2693061ea8698de078f95517349178ce8894a51a97db468183032cba22ab04ae number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 6GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__6 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100_NVLx1 FP8 Throughput ngcMetadata: 785d7d60df3f153a36413f29a16ac14bc5cfba73004bc7feee2bca9d78b10e6f: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a0de60706fabf3ee071fef41f0c14225a3d88799bb9728af810e57a7499f038f number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x1-throughput-nvfp4-6zvdbhtdna framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x1 NVFP4 Throughput ngcMetadata: 78fdabce8c3eae38cea72ca3f28aaca02e3cc475c17913d6e8d4e554cba2aaa9: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d07936f83cf22e053e9fe3339050f2e05459ebcde766c94fdb7a6ac90aeb1fda number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 6GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__7 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_480GBx1 FP8 Latency ngcMetadata: 7c71f0d6db2e0d52a3fbc34dabd0584ed7a27ef63a49e21aaa394d8746eeb189: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 1fa738c9de9d4b25a298b3cd021b05beab57c2c9ab5a930a3d1efcf7204fc463 number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h200x1-throughput-fp8-mqkoo4u9fa framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200x1 FP8 Throughput ngcMetadata: 83fa1ce989c823d1fba445823ac58beb734bb31383a33af261a8b0808495678a: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d7e3e88abee403b365d238441ca9c1172e71745fe43cd7dce511e7d95309d237 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__8 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 NVFP4 Throughput ngcMetadata: 882e2041a947f6e0793a600a4470fbbd41e7a3f3363bb4956a2c63aaa7cf51ec: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0852d2d4b6d54d6bc12acf922890bfa19e801e74276ddddcff98034ba0dc4c0f number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__9 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 FP8 Latency ngcMetadata: 8855de19ef9d0f55c0213a8786591091cc5965a2c862562cc7b492c712ef09e3: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a11707b8479a7230d31a451c07c5650f0e8ff58948507a983a2e89b846929ecf number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__10 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200_NVLx2 BF16 Latency ngcMetadata: 885fb853c59fc5ea3a61554797670d6f61e4b2db23f1acbc69f7e8e98846ce21: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 362023b28455913264302e9d87593459bc9930c544859af88689346e92085fea number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__11 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A100_SXM4_40GBx2 BF16 Latency ngcMetadata: 88b3c4d52c48162915703053126fe2d2ec64632b4508fb05dd0984904cc4b313: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 344bc1f6c75518604e27015bf9131a6dc8c5257396806f35575516bb14234706 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 2 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x1-throughput-bf16-qsrhtlj33g framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x1 BF16 Throughput ngcMetadata: 8a33858f5392a45aa85acaab0a81601e9831cfd99507249536c63be228f09918: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3cb77524c717d774efbda1f850840b59abc39d9bd46fc2983ebc3dc1f4931ff6 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__12 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200_NVLx2 FP8 Latency ngcMetadata: 8b0cd9578c1bf872d35c8da2dc72ed6f2161623840923884a8f50725ec11a4ec: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3a251730a9c214eea8101d8192f6c4c35b1d321aad615edc1e0a942521b828b0 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h100x2-latency-bf16-xhazfvu8og framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100x2 BF16 Latency ngcMetadata: 8ecf55cfb8e611fb1e1579b57089060c76270bcafb322a872c751cb59ba840bc: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 782d96856a10dac93438804c42286ba3e7d0d7445d7fbd8f8497dd3c80238564 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h100x1-throughput-bf16-tgzhmf3syg framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100x1 BF16 Throughput ngcMetadata: 90061152a480ade6c471a982258bf4e42dc51cf29ad9f6642120547c33bdf51f: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 04c9939245eef94e92510642382d6ad26f65a25cf1687b76ccc4e66aba70da39 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__13 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_144GBx1 BF16 Throughput ngcMetadata: 9020f539c475f53d364474485cd83728454b7a340c0f1ee2d3cf505ccdcc1189: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ca7f6e7d29a1f514a9d7f4f3d731b0a0d286a9358a96287b12a1045ac9ca590b number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x2-latency-fp8-hrzafixo7g framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x2 FP8 Latency ngcMetadata: 94420d0c4e672e70e91c15d5a6e23c447fa3b43f1632936eebf9cdd0c845d036: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b1e67d29794a75bf923a7224dd297dbc4aacd4d97273a7fd66dda7e8371a6da8 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__14 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 NVFP4 Latency ngcMetadata: 95f587f27ab8c1467d93d12ffb7db8f3920888b4211c2ab82ef4f8de2fca61f5: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9cd258950837575782b24640b90c1cd969334d691131036208cd3c8b0735f927 number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__15 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200_NVLx1 FP8 Throughput ngcMetadata: 9b0e99f6e9afa6fa529d47662d85b1e6d16b3abadcc2a5e72c10486eb7c87201: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 93297aebf65f337e982d4ebd8e79f380bd9ad05346cf2e18908c6365de2b2307 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x2-latency-nvfp4-sgvjjrbeuw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x2 NVFP4 Latency ngcMetadata: 9f558e6681791166fdc01cacf06f2d869b67c26f1d573738f92e5e227f820270: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: efc59c490dab28006a89a5d53a36d4ef5c5d3b0927c7d118f02014d4eb0c29e8 number_of_gpus: '4' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 6GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:l40sx1-throughput-fp8-xad-wr2scw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct L40Sx1 FP8 Throughput ngcMetadata: a3e90cba8e03efc80877da3902607362c851c36e8c45cd92aada9e7cac900765: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7ebba124e3f58d0563b96377f7c85432ef3e2f393efb9e158fd308a8738abcfb number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h200x2-latency-fp8-cftgwz2fda framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200x2 FP8 Latency ngcMetadata: a826d9d8199abbe4e4084a2f64d3658ef6749b1697ecf21fd0615d1e138e368d: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6bc839be18669cae90a69af4e02503965be03b8c68b1b7ac2cf6b612033abeb8 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:a100x2-latency-bf16-oxfjg8md-a framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A100x2 BF16 Latency ngcMetadata: ad582d87e490e749edcaf041d763e6c3f492962ccdbbe83e9204b48d6cfe7641: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0b1583a74d6516dd30c0bfdce8972835384f10fb4f617df4e0260fdf5092b059 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 17GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:gb200x1-throughput-nvfp4-ihgvv-o6wg framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GB200x1 NVFP4 Throughput ngcMetadata: adbc8a19059852df0c2ac75173b80f123b0901926e524a2c050ce60aa3ae5ca1: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a381f8cc9d090bc49cb320a47cdefe01b0555dc9409312516194cb19437436d0 number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 6GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__16 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100_NVLx2 BF16 Latency ngcMetadata: afc6d2a8f5c1affe8524a39c78d6f083cd56ac678f9cc9f89df33b0e0e530ec5: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d0040f5636dd8d4baa9c36337ccb4157b58e47ba7118b2d54b36e2ad96061ed0 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__17 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_144GBx1 FP8 Throughput ngcMetadata: b0c4bcf92286ad2f689805bf411e44a617df5a5455c703ddd8053f354d40b5cb: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0ec33e185e2d8e2e4bd97118f54276dbece4b6744371f895bd4c86e8e4dceedb number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:h200x1-throughput-bf16-6ylo-i-bbw framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H200x1 BF16 Throughput ngcMetadata: b795f66a018d1278aaded769cb88a79b5565d2fe6497739b03d8f1bad88e75d1: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 673a0a6cdd37cabec7d8dcc8f05f787884c72f2b56fcaad416429dda38238c0b number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__18 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_480GBx1 BF16 Latency ngcMetadata: c11d003373b87576201557974186967205684e4045905b5140a3d92f274cbf5f: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b41e403000a7d5221cdd4f00ab4d8a2ef58aa3470a65db51abd523b245c63ea6 number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:l40sx2-latency-fp8-szl6-yje2g framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct L40Sx2 FP8 Latency ngcMetadata: c512ff489822b14e13879c4b1cbb849e5a45d453beeb2d9abfe52f029c0639d2: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 570d33681085a88ae5ea6bd28342996817acb2d9b0a5e8486e197bba77b832a1 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__19 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_ADAx1 INT4_AWQ Latency ngcMetadata: c95bbf72a36cc53dd0750074c0307cbc16ef98a8634cd89f94046e226c892ac9: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 737909c201e9ccea9bfb138401ed768b71985f2aad636ed91b7ca0712e02cb43 number_of_gpus: '1' pp: '1' precision: int4_awq profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: INT4_AWQ - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__20 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 BF16 Latency ngcMetadata: ccfeded811dbe0f17d70c25f83c247d1317114349b5df99ba1044c1fcb79b8ef: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 689cc0a0026ff1fff0e5818d26ffe369c59e7b16f96d9239248504fbab23c28c number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__21 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 BF16 Throughput ngcMetadata: d3ab627cccb5910fbce6396c9d205c84792abee634eb9f334c47086cf5d01b12: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: fa369969c2e20bb29b6b004cde3f63ba17a65056818bd8ad63528141ecb41527 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:a100x1-throughput-bf16-lwcrbwztpq framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A100x1 BF16 Throughput ngcMetadata: d67b7f59a9a2851e98bce877ee3702e82a3166322418dbf900a6a15e46643472: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2c735fe09841c686ba2f7ace400337d0f11be549d41cdeb9ba1c82688d0688fa number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__22 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_144GBx1 BF16 Latency ngcMetadata: db8a6f9d6f65eaec69ec78ea131cb34ec66bc63df975d23f8d2ccb031806dcc8: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c9d911dd01c8c520784ca0fec350f83855a8ca1ea1a3fed5f707fa642945a3e3 number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:b200x1-throughput-fp8-i5rbiys4jq framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct B200x1 FP8 Throughput ngcMetadata: e0b3ee6ce141beca50c67daccbebb1ce7417c14acd08c81346986898042733b6: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9d7c4bc4201757dcd3f1147712dfb1c83a8f8535405a59e1fa547f17b4a5869b number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 9GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__23 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct H100_NVLx1 BF16 Throughput ngcMetadata: e6c81e90a8ff3f2cf1b1bffbf760b05c7cf12d18c6486a4690b8ab81b6de436d: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b75eb29f401f555ea3d19a6df30861ef874d10760590ee8856ff0542d7ea1e7f number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__24 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_480GBx1 FP8 Throughput ngcMetadata: ed144c17645499c4cd983b4a2e4bdc23f0f03cc55e19073c357e8eb0ff982dc6: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: aab7bbbbcf3e6f7fb544ee77017dd2ee59aa0b81dc314dec4bb46317def34714 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__25 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct RTX6000_BLACKWELL_SVx1 FP8 Throughput ngcMetadata: ee928087f01a5df571cf5e62c96f66fedccaf180524ce1e43cb4b5a23295deb8: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 60b75ec923fe8a417deb0273d9a21b4fcd4e3e0f8f9ed6e9527a66433cf6030c number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:l40sx1-throughput-bf16-lh60z9g-aq framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct L40Sx1 BF16 Throughput ngcMetadata: eece8dae913d9055ed8060b6ae1764cefecd6d158dd314851e1ecd15b5d9126d: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ded6e827825103665f5fea2381f04196a88c95525aea31c073556f0204ad9c8e number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 16GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:8c22764a7e3675c50d4c7c9a4edb474456022b16__26 framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct GH200_144GBx1 FP8 Latency ngcMetadata: ef8d429a394978d394a8d15ddbdd6666bde4dc68e40f8cb399b188f5b7e59db5: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 02d2b0459a15ab0a39ec4335caf74e3105e66f51ae577b7bf8a1b64cfcb5c472 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 30GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-8b-instruct:a10gx4-throughput-bf16-g04kznyzwa framework: TensorRT-LLM displayName: Llama 3.1 8B Instruct A10Gx4 BF16 Throughput ngcMetadata: f02876a90b3197bcf046fee9ab2beb6f7482b8b35e3ff9ff545d03ba9ba7bb23: model: meta/llama-3.1-8b-instruct release: 1.13.1 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: fda7bc4c0bf1f5eaeecbf29fbdd078ecbf587ac57c62610180d3d5fb90ffcfda number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 4 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.13.1 - key: DOWNLOAD SIZE value: 19GB - key: LLM ENGINE value: TENSORRT_LLM - variantId: Llama 3.1 70B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wNS0yMFQxODoxNzowOS4xMDdaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjICoqTGxhbWEtMy4xLTcwQi1JbnN0cnVjdCBPdmVydmlldyoqXG5cbiMjICoqRGVzY3JpcHRpb246KipcblxuKipMbGFtYS0zLjEtNzBCLUluc3RydWN0KiogaXMgYSBtdWx0aWxpbmd1YWwgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgZnJvbSB0aGUgTWV0YSBMbGFtYSAzLjEgY29sbGVjdGlvbiBvZiBwcmV0cmFpbmVkIGFuZCBpbnN0cnVjdGlvbi10dW5lZCBnZW5lcmF0aXZlIG1vZGVscy4gVGhpcyBtb2RlbCBpcyBvcHRpbWl6ZWQgZm9yIG11bHRpbGluZ3VhbCBkaWFsb2d1ZSB1c2UgY2FzZXMgYW5kIG91dHBlcmZvcm1zIG1hbnkgYXZhaWxhYmxlIG9wZW4tc291cmNlIGFuZCBjbG9zZWQtc291cmNlIGNoYXQgbW9kZWxzIG9uIGNvbW1vbiBpbmR1c3RyeSBiZW5jaG1hcmtzLiBMbGFtYSAzLjEgaXMgYW4gYXV0by1yZWdyZXNzaXZlIGxhbmd1YWdlIG1vZGVsIHRoYXQgdXNlcyBhbiBvcHRpbWl6ZWQgdHJhbnNmb3JtZXIgYXJjaGl0ZWN0dXJlOyB0aGUgdHVuZWQgdmVyc2lvbnMgdXNlIHN1cGVydmlzZWQgZmluZS10dW5pbmcgKFNGVCkgYW5kIHJlaW5mb3JjZW1lbnQgbGVhcm5pbmcgd2l0aCBodW1hbiBmZWVkYmFjayAoUkxIRikgdG8gYWxpZ24gd2l0aCBodW1hbiBwcmVmZXJlbmNlcyBmb3IgaGVscGZ1bG5lc3MgYW5kIHNhZmV0eS5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbC9ub24tY29tbWVyY2lhbCB1c2UuXG5cblRoaXMgdmVyc2lvbiBpbnRyb2R1Y2VzIHN1cHBvcnQgZm9yIEdCMjAwIE5WTDcyLCBHSDIwMCBOVkwyLCBCMjAwIGFuZCBOVkZQNC4gQ1VEQSB1cGRhdGVkIHRvIHZlcnNpb24gMTIuOS4gRm9yIGRldGFpbGVkIGluZm9ybWF0aW9uLCByZWZlciB0byBSZWxlYXNlIFtOb3RlcyBmb3IgTlZJRElBIE5JTSBmb3IgTExNcyBMTE0gMS4xMl0oaHR0cHM6Ly9kb2NzLm52aWRpYS5jb20vbmltL2xhcmdlLWxhbmd1YWdlLW1vZGVscy9sYXRlc3QvcmVsZWFzZS1ub3Rlcy5odG1sKS4gXG5cbiMjICoqVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb24qKlxuXG5UaGlzIG1vZGVsIGlzIG5vdCBvd25lZCBvciBkZXZlbG9wZWQgYnkgTlZJRElBLiBUaGlzIG1vZGVsIGhhcyBiZWVuIGRldmVsb3BlZCBhbmQgYnVpbHQgdG8gYSB0aGlyZC1wYXJ0eSdzIHJlcXVpcmVtZW50cyBmb3IgdGhpcyBhcHBsaWNhdGlvbiBhbmQgdXNlIGNhc2U7IHNlZSBsaW5rIHRvIE5vbi1OVklESUFcXFttZXRhLWxsYW1hL0xsYW1hLTMuMS03MEItSW5zdHJ1Y3RcXF0gIFxuKFtodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLTcwQi1JbnN0cnVjdF0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9tZXRhLWxsYW1hL0xsYW1hLTMuMS03MEItSW5zdHJ1Y3QpKS4gXG5cbiMjICoqTGljZW5zZS9UZXJtcyBvZiBVc2U6KipcblxuKipHT1ZFUk5JTkcgVEVSTVM6KiogVGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCB0aGUgW1Byb2R1Y3QtU3BlY2lmaWMgVGVybXMgZm9yIE5WSURJQSBBSSBQcm9kdWN0c10oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvcHJvZHVjdC1zcGVjaWZpYy10ZXJtcy1mb3ItYWktcHJvZHVjdHMvKTsgYW5kIHRoZSB1c2Ugb2YgdGhlIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIENvbW11bml0eSBNb2RlbCBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8uKS5cblxuKipBRERJVElPTkFMIElORk9STUFUSU9OOioqIFtMbGFtYSAzLjEgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5sbGFtYS5jb20vbGxhbWEzXzMvbGljZW5zZS8pLiBCdWlsdCB3aXRoIExsYW1hLlxuXG4jIyBHZXQgSGVscFxuXG4jIyMgRW50ZXJwcmlzZSBTdXBwb3J0XG5cbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBwcm92aWRlZCBtb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqXG5cbiMjICoqRGVwbG95bWVudCBHZW9ncmFwaHk6KipcblxuR2xvYmFsIFxuXG4jIyAqKlVzZSBDYXNlOioqXG5cbkRldmVsb3BlcnMsIEFJIHJlc2VhcmNoZXJzLCBhbmQgYnVzaW5lc3NlcyB3b3VsZCBiZSBleHBlY3RlZCB0byB1c2UgdGhpcyBzeXN0ZW0gdG8gYnVpbGQgYW5kIHBvd2VyIGEgd2lkZSByYW5nZSBvZiBhcHBsaWNhdGlvbnMgdGhhdCByZXF1aXJlIGFkdmFuY2VkIHJlYXNvbmluZywgaW5zdHJ1Y3Rpb24tZm9sbG93aW5nLCBhbmQgbXVsdGlsaW5ndWFsIGRpYWxvZ3VlIGNhcGFiaWxpdGllcy4gU3BlY2lmaWMgYXBwbGljYXRpb25zIGluY2x1ZGUgY3JlYXRpbmcgc29waGlzdGljYXRlZCBjaGF0Ym90cyBhbmQgdmlydHVhbCBhc3Npc3RhbnRzLCBkZXZlbG9waW5nIHBvd2VyZnVsIGNvbnRlbnQgY3JlYXRpb24gYW5kIHN1bW1hcml6YXRpb24gdG9vbHMsIGJ1aWxkaW5nIGNvbXBsZXggcXVlc3Rpb24tYW5zd2VyaW5nIHN5c3RlbXMsIGFuZCBwb3dlcmluZyBtdWx0aWxpbmd1YWwgY3VzdG9tZXIgc3VwcG9ydCBwbGF0Zm9ybXMuXG5cbiMjICoqUmVsZWFzZSBEYXRlOioqXG5cbkJ1aWxkLk52aWRpYS5jb20gMDcvMjMvMjAyNCB2aWEgIFxuW2xsYW1hLTMuMS03MGItaW5zdHJ1Y3QgTW9kZWwgYnkgTWV0YSB8IE5WSURJQSBOSU1dKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9tZXRhL2xsYW1hLTNfMS03MGItaW5zdHJ1Y3QpXG5cbkdpdGh1YiAwNy8yMy8yMDI0IHZpYSAgIFxuW2h0dHBzOi8vZ2l0aHViLmNvbS9tZXRhLWxsYW1hL2xsYW1hLW1vZGVscy9ibG9iL21haW4vbW9kZWxzL2xsYW1hM1xcXzEvTElDRU5TRV0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvbGxhbWEtbW9kZWxzL2Jsb2IvbWFpbi9tb2RlbHMvbGxhbWEzXzEvTElDRU5TRSlcblxuSHVnZ2luZ2ZhY2UgMDcvMjMvMjAyNCB2aWEgICBcbltodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLTcwQi1JbnN0cnVjdF0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9tZXRhLWxsYW1hL0xsYW1hLTMuMS03MEItSW5zdHJ1Y3QpXG5cbioqUmVmZXJlbmNlKHMpOioqIFxuXG5baHR0cHM6Ly9odWdnaW5nZmFjZS5jby9tZXRhLWxsYW1hL0xsYW1hLTMuMS03MEItSW5zdHJ1Y3RdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjEtNzBCLUluc3RydWN0KVxuXG4jIyAqKk1vZGVsIEFyY2hpdGVjdHVyZToqKiBcblxuQXJjaGl0ZWN0dXJlIFR5cGU6IFRyYW5zZm9ybWVyICBcbk5ldHdvcmsgQXJjaGl0ZWN0dXJlOiBMbGFtYS0zLjEtNzBCXG5cblRoaXMgbW9kZWwgd2FzIGRldmVsb3BlZCBiYXNlZCBvbiBNZXRhLUxsYW1hLTMuMS03MEIgIFxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWV0YS1sbGFtYS9MbGFtYS0zLjEtNzBCLUluc3RydWN0XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4xLTcwQi1JbnN0cnVjdClcblxuTnVtYmVyIG9mIG1vZGVsIHBhcmFtZXRlcnM6IDcuMDYqMTBeMTBcblxuIyMgKipJbnB1dDoqKlxuXG5JbnB1dCBUeXBlKHMpOiBUZXh0IFxuXG5JbnB1dCBGb3JtYXQocyk6IFN0cmluZyBcblxuSW5wdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OiBUaGUgbW9kZWwgYWNjZXB0cyBhIHN0cmluZyBvZiB0ZXh0IHdoaWNoIGlzIGNvbnZlcnRlZCBpbnRvIHRva2VucyB1c2luZyB0aGUgbW9kZWwncyBzcGVjaWZpYyB0b2tlbml6ZXIuIFRoZSB0b3RhbCBsZW5ndGggb2YgdGhlIGlucHV0IHByb21wdCBhbmQgdGhlIGdlbmVyYXRlZCBvdXRwdXQgY2Fubm90IGV4Y2VlZCB0aGUgbW9kZWwncyBjb250ZXh0IHdpbmRvdyBvZiAxMjgsMDAwIHRva2Vucy5cblxuIyMgKipPdXRwdXQ6KipcblxuT3V0cHV0IFR5cGUocyk6IFRleHQgXG5cbk91dHB1dCBGb3JtYXQocyk6IFN0cmluZ1xuXG5PdXRwdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDogVGhlIG1vZGVsIGdlbmVyYXRlcyBhIHN0cmluZyBvZiB0ZXh0LCBwcm9kdWNlZCB0b2tlbiBieSB0b2tlbi4gVGhlIG1heGltdW0gbGVuZ3RoIG9mIHRoZSBvdXRwdXQgaXMgbGltaXRlZCBieSB0aGUgbW9kZWwncyAxMjgsMDAwLXRva2VuIGNvbnRleHQgd2luZG93LCBsZXNzIHRoZSBsZW5ndGggb2YgdGhlIGlucHV0IHByb21wdC4gUG9zdC1wcm9jZXNzaW5nIGlzIHJlcXVpcmVkIHRvIGRlY29kZSB0aGUgbW9kZWwncyB0b2tlbi1iYXNlZCBvdXRwdXQgaW50byBhIHJlYWRhYmxlIHN0cmluZy5cblxuT3VyIEFJIG1vZGVscyBhcmUgZGVzaWduZWQgYW5kL29yIG9wdGltaXplZCB0byBydW4gb24gTlZJRElBIEdQVS1hY2NlbGVyYXRlZCBzeXN0ZW1zLiBCeSBsZXZlcmFnaW5nIE5WSURJQSdzIGhhcmR3YXJlIChlLmcuIEdQVSBjb3JlcykgYW5kIHNvZnR3YXJlIGZyYW1ld29ya3MgKGUuZy4sIENVREEgbGlicmFyaWVzKSwgdGhlIG1vZGVsIGFjaGlldmVzIGZhc3RlciB0cmFpbmluZyBhbmQgaW5mZXJlbmNlIHRpbWVzIGNvbXBhcmVkIHRvIENQVS1vbmx5IHNvbHV0aW9ucy5cblxuIyMgKipTb2Z0d2FyZSBJbnRlZ3JhdGlvbjoqKlxuXG5SdW50aW1lIEVuZ2luZTogdkxMTSwgVGVuc29yUlRcblxuU3VwcG9ydGVkIEhhcmR3YXJlIE1pY3JvYXJjaGl0ZWN0dXJlIENvbXBhdGliaWxpdHk6XG5cbk5WSURJQSBBbXBlcmUgIFxuTlZJRElBIEJsYWNrd2VsbCAgXG5OVklESUEgSG9wcGVyICBcbk5WSURJQSBMb3ZlbGFjZSBcblxuUHJlZmVycmVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6XG5cbkxpbnV4ICAgXG5XaW5kb3dzXG5cblRoZSBpbnRlZ3JhdGlvbiBvZiBmb3VuZGF0aW9uIGFuZCBmaW5lLXR1bmVkIG1vZGVscyBpbnRvIEFJIHN5c3RlbXMgcmVxdWlyZXMgYWRkaXRpb25hbCB0ZXN0aW5nIHVzaW5nIHVzZS1jYXNlLXNwZWNpZmljIGRhdGEgdG8gZW5zdXJlIHNhZmUgYW5kIGVmZmVjdGl2ZSBkZXBsb3ltZW50LiBGb2xsb3dpbmcgdGhlIFYtbW9kZWwgbWV0aG9kb2xvZ3ksIGl0ZXJhdGl2ZSB0ZXN0aW5nIGFuZCB2YWxpZGF0aW9uIGF0IGJvdGggdW5pdCBhbmQgc3lzdGVtIGxldmVscyBhcmUgZXNzZW50aWFsIHRvIG1pdGlnYXRlIHJpc2tzLCBtZWV0IHRlY2huaWNhbCBhbmQgZnVuY3Rpb25hbCByZXF1aXJlbWVudHMsIGFuZCBlbnN1cmUgY29tcGxpYW5jZSB3aXRoIHNhZmV0eSBhbmQgZXRoaWNhbCBzdGFuZGFyZHMgYmVmb3JlIGRlcGxveW1lbnQuXG5cbiMjICoqTW9kZWwgVmVyc2lvbihzKToqKlxuXG5MbGFtYS0zLjEtNzBCLUluc3RydWN0XG5cbiMjICoqVXNhZ2UqKlxuXG4qKlVzZSB3aXRoIHRyYW5zZm9ybWVycyoqXG5cblN0YXJ0aW5nIHdpdGggdHJhbnNmb3JtZXJzIFxcPj0gNC40NS4wIG9ud2FyZCwgeW91IGNhbiBydW4gY29udmVyc2F0aW9uYWwgaW5mZXJlbmNlIHVzaW5nIHRoZSBUcmFuc2Zvcm1lcnMgcGlwZWxpbmUgYWJzdHJhY3Rpb24gb3IgYnkgbGV2ZXJhZ2luZyB0aGUgQXV0byBjbGFzc2VzIHdpdGggdGhlIGdlbmVyYXRlKCkgZnVuY3Rpb24uXG5cbk1ha2Ugc3VyZSB0byB1cGRhdGUgeW91ciB0cmFuc2Zvcm1lcnMgaW5zdGFsbGF0aW9uIHZpYSBwaXAgaW5zdGFsbCBcXC0tdXBncmFkZSB0cmFuc2Zvcm1lcnMuXG5cblNlZSB0aGUgc25pcHBldCBiZWxvdyBmb3IgdXNhZ2Ugd2l0aCBUcmFuc2Zvcm1lcnM6XG5cbmBgYFxuaW1wb3J0IHRyYW5zZm9ybWVyc1xuaW1wb3J0IHRvcmNoXG5cbm1vZGVsX2lkID0gXCJtZXRhLWxsYW1hL01ldGEtTGxhbWEtMy4xLTcwQi1JbnN0cnVjdFwiXG5cbnBpcGVsaW5lID0gdHJhbnNmb3JtZXJzLnBpcGVsaW5lKFxuICAgIFwidGV4dC1nZW5lcmF0aW9uXCIsXG4gICAgbW9kZWw9bW9kZWxfaWQsXG4gICAgbW9kZWxfa3dhcmdzPXtcInRvcmNoX2R0eXBlXCI6IHRvcmNoLmJmbG9hdDE2fSxcbiAgICBkZXZpY2VfbWFwPVwiYXV0b1wiLFxuKVxuXG5tZXNzYWdlcyA9IFtcbiAgICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIllvdSBhcmUgYSBwaXJhdGUgY2hhdGJvdCB3aG8gYWx3YXlzIHJlc3BvbmRzIGluIHBpcmF0ZSBzcGVhayFcIn0sXG4gICAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiV2hvIGFyZSB5b3U/XCJ9LFxuXVxuXG5vdXRwdXRzID0gcGlwZWxpbmUoXG4gICAgbWVzc2FnZXMsXG4gICAgbWF4X25ld190b2tlbnM9MjU2LFxuKVxucHJpbnQob3V0cHV0c1swXVtcImdlbmVyYXRlZF90ZXh0XCJdWy0xXSlcbmBgYFxuXG4qKlRvb2wgdXNlIHdpdGggdHJhbnNmb3JtZXJzKipcblxuTExhTUEtMy4zIHN1cHBvcnRzIG11bHRpcGxlIHRvb2wgdXNlIGZvcm1hdHMuIFlvdSBjYW4gc2VlIGEgZnVsbCBndWlkZSB0byBwcm9tcHQgZm9ybWF0dGluZyBbaGVyZV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9kb2NzL21vZGVsLWNhcmRzLWFuZC1wcm9tcHQtZm9ybWF0cy9sbGFtYTNfMS8pLlxuXG5Ub29sIHVzZSBpcyBhbHNvIHN1cHBvcnRlZCB0aHJvdWdoIFtjaGF0IHRlbXBsYXRlc10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kb2NzL3RyYW5zZm9ybWVycy9tYWluL2NoYXRfdGVtcGxhdGluZyNhZHZhbmNlZC10b29sLXVzZS0tZnVuY3Rpb24tY2FsbGluZykgaW4gVHJhbnNmb3JtZXJzLiBIZXJlIGlzIGEgcXVpY2sgZXhhbXBsZSBzaG93aW5nIGEgc2luZ2xlIHNpbXBsZSB0b29sOlxuXG5gYGBcbiMgRmlyc3QsIGRlZmluZSBhIHRvb2xcbmRlZiBnZXRfY3VycmVudF90ZW1wZXJhdHVyZShsb2NhdGlvbjogc3RyKSAtPiBmbG9hdDpcbiAgICBcIlwiXCJcbiAgICBHZXQgdGhlIGN1cnJlbnQgdGVtcGVyYXR1cmUgYXQgYSBsb2NhdGlvbi5cbiAgICBcbiAgICBBcmdzOlxuICAgICAgICBsb2NhdGlvbjogVGhlIGxvY2F0aW9uIHRvIGdldCB0aGUgdGVtcGVyYXR1cmUgZm9yLCBpbiB0aGUgZm9ybWF0IFwiQ2l0eSwgQ291bnRyeVwiXG4gICAgUmV0dXJuczpcbiAgICAgICAgVGhlIGN1cnJlbnQgdGVtcGVyYXR1cmUgYXQgdGhlIHNwZWNpZmllZCBsb2NhdGlvbiBpbiB0aGUgc3BlY2lmaWVkIHVuaXRzLCBhcyBhIGZsb2F0LlxuICAgIFwiXCJcIlxuICAgIHJldHVybiAyMi4gICMgQSByZWFsIGZ1bmN0aW9uIHNob3VsZCBwcm9iYWJseSBhY3R1YWxseSBnZXQgdGhlIHRlbXBlcmF0dXJlIVxuXG4jIE5leHQsIGNyZWF0ZSBhIGNoYXQgYW5kIGFwcGx5IHRoZSBjaGF0IHRlbXBsYXRlXG5tZXNzYWdlcyA9IFtcbiAge1wicm9sZVwiOiBcInN5c3RlbVwiLCBcImNvbnRlbnRcIjogXCJZb3UgYXJlIGEgYm90IHRoYXQgcmVzcG9uZHMgdG8gd2VhdGhlciBxdWVyaWVzLlwifSxcbiAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiSGV5LCB3aGF0J3MgdGhlIHRlbXBlcmF0dXJlIGluIFBhcmlzIHJpZ2h0IG5vdz9cIn1cbl1cblxuaW5wdXRzID0gdG9rZW5pemVyLmFwcGx5X2NoYXRfdGVtcGxhdGUobWVzc2FnZXMsIHRvb2xzPVtnZXRfY3VycmVudF90ZW1wZXJhdHVyZV0sIGFkZF9nZW5lcmF0aW9uX3Byb21wdD1UcnVlKVxuYGBgXG5cbllvdSBjYW4gdGhlbiBnZW5lcmF0ZSB0ZXh0IGZyb20gdGhpcyBpbnB1dCBhcyBub3JtYWwuIElmIHRoZSBtb2RlbCBnZW5lcmF0ZXMgYSB0b29sIGNhbGwsIHlvdSBzaG91bGQgYWRkIGl0IHRvIHRoZSBjaGF0IGxpa2Ugc286XG5cbmBgYFxudG9vbF9jYWxsID0ge1wibmFtZVwiOiBcImdldF9jdXJyZW50X3RlbXBlcmF0dXJlXCIsIFwiYXJndW1lbnRzXCI6IHtcImxvY2F0aW9uXCI6IFwiUGFyaXMsIEZyYW5jZVwifX1cbm1lc3NhZ2VzLmFwcGVuZCh7XCJyb2xlXCI6IFwiYXNzaXN0YW50XCIsIFwidG9vbF9jYWxsc1wiOiBbe1widHlwZVwiOiBcImZ1bmN0aW9uXCIsIFwiZnVuY3Rpb25cIjogdG9vbF9jYWxsfV19KVxuYGBgXG5cbmFuZCB0aGVuIGNhbGwgdGhlIHRvb2wgYW5kIGFwcGVuZCB0aGUgcmVzdWx0LCB3aXRoIHRoZSB0b29sIHJvbGUsIGxpa2Ugc286XG5cbmBgYFxubWVzc2FnZXMuYXBwZW5kKHtcInJvbGVcIjogXCJ0b29sXCIsIFwibmFtZVwiOiBcImdldF9jdXJyZW50X3RlbXBlcmF0dXJlXCIsIFwiY29udGVudFwiOiBcIjIyLjBcIn0pXG5gYGBcblxuQWZ0ZXIgdGhhdCwgeW91IGNhbiBnZW5lcmF0ZSgpIGFnYWluIHRvIGxldCB0aGUgbW9kZWwgdXNlIHRoZSB0b29sIHJlc3VsdCBpbiB0aGUgY2hhdC4gTm90ZSB0aGF0IHRoaXMgd2FzIGEgdmVyeSBicmllZiBpbnRyb2R1Y3Rpb24gdG8gdG9vbCBjYWxsaW5nIFxcLSBmb3IgbW9yZSBpbmZvcm1hdGlvbiwgc2VlIHRoZSBbTExhTUEgcHJvbXB0IGZvcm1hdCBkb2NzXShodHRwczovL2xsYW1hLm1ldGEuY29tL2RvY3MvbW9kZWwtY2FyZHMtYW5kLXByb21wdC1mb3JtYXRzL2xsYW1hM18xLykgYW5kIHRoZSBUcmFuc2Zvcm1lcnMgW3Rvb2wgdXNlIGRvY3VtZW50YXRpb25dKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZG9jcy90cmFuc2Zvcm1lcnMvbWFpbi9jaGF0X3RlbXBsYXRpbmcjYWR2YW5jZWQtdG9vbC11c2UtLWZ1bmN0aW9uLWNhbGxpbmcpLlxuXG4qKlVzZSB3aXRoIGJpdHNhbmRieXRlcyoqXG5cblRoZSBtb2RlbCBjaGVja3BvaW50cyBjYW4gYmUgdXNlZCBpbiA4LWJpdCBhbmQgNC1iaXQgZm9yIGZ1cnRoZXIgbWVtb3J5IG9wdGltaXNhdGlvbnMgdXNpbmcgYml0c2FuZGJ5dGVzIGFuZCB0cmFuc2Zvcm1lcnNcblxuU2VlIHRoZSBzbmlwcGV0IGJlbG93IGZvciB1c2FnZTpcblxuYGBgXG5pbXBvcnQgdG9yY2hcbmZyb20gdHJhbnNmb3JtZXJzIGltcG9ydCBBdXRvTW9kZWxGb3JDYXVzYWxMTSwgQXV0b1Rva2VuaXplclxuXG5tb2RlbF9pZCA9IFwibWV0YS1sbGFtYS9NZXRhLUxsYW1hLTMuMS03MEItSW5zdHJ1Y3RcIlxucXVhbnRpemF0aW9uX2NvbmZpZyA9IEJpdHNBbmRCeXRlc0NvbmZpZyhsb2FkX2luXzhiaXQ9VHJ1ZSlcblxucXVhbnRpemVkX21vZGVsID0gQXV0b01vZGVsRm9yQ2F1c2FsTE0uZnJvbV9wcmV0cmFpbmVkKFxuICAgIG1vZGVsX2lkLCBkZXZpY2VfbWFwPVwiYXV0b1wiLCB0b3JjaF9kdHlwZT10b3JjaC5iZmxvYXQxNiwgcXVhbnRpemF0aW9uX2NvbmZpZz1xdWFudGl6YXRpb25fY29uZmlnKVxuXG50b2tlbml6ZXIgPSBBdXRvVG9rZW5pemVyLmZyb21fcHJldHJhaW5lZChtb2RlbF9pZClcbmlucHV0X3RleHQgPSBcIldoYXQgYXJlIHdlIGhhdmluZyBmb3IgZGlubmVyP1wiXG5pbnB1dF9pZHMgPSB0b2tlbml6ZXIoaW5wdXRfdGV4dCwgcmV0dXJuX3RlbnNvcnM9XCJwdFwiKS50byhcImN1ZGFcIilcblxub3V0cHV0ID0gcXVhbnRpemVkX21vZGVsLmdlbmVyYXRlKCoqaW5wdXRfaWRzLCBtYXhfbmV3X3Rva2Vucz0xMClcblxucHJpbnQodG9rZW5pemVyLmRlY29kZShvdXRwdXRbMF0sIHNraXBfc3BlY2lhbF90b2tlbnM9VHJ1ZSkpXG5gYGBcblxuVG8gbG9hZCBpbiA0LWJpdCBzaW1wbHkgcGFzcyBsb2FkXFxfaW5cXF80Yml0PVRydWVcblxuKipVc2Ugd2l0aCBsbGFtYSoqXG5cblBsZWFzZSwgZm9sbG93IHRoZSBpbnN0cnVjdGlvbnMgaW4gdGhlIFtyZXBvc2l0b3J5XShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYSkuXG5cblRvIGRvd25sb2FkIE9yaWdpbmFsIGNoZWNrcG9pbnRzLCBzZWUgdGhlIGV4YW1wbGUgY29tbWFuZCBiZWxvdyBsZXZlcmFnaW5nIGh1Z2dpbmdmYWNlLWNsaTpcblxuYGBgXG5odWdnaW5nZmFjZS1jbGkgZG93bmxvYWQgbWV0YS1sbGFtYS9NZXRhLUxsYW1hLTMuMS03MEItSW5zdHJ1Y3QgLS1pbmNsdWRlIFwib3JpZ2luYWwvKlwiIC0tbG9jYWwtZGlyIE1ldGEtTGxhbWEtMy4xLTcwQi1JbnN0cnVjdFxuYGBgXG5cbiMjICoqVHJhaW5pbmcsIFRlc3RpbmcsIGFuZCBFdmFsdWF0aW9uIERhdGFzZXRzOioqXG5cbiMjIyAqKlRyYWluaW5nIERhdGFzZXQqKlxuXG4qKkRhdGEgTW9kYWxpdHk6KiogVGV4dCBcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW5cblxuKipQcm9wZXJ0aWVzOioqIFxuXG5UaGUgcHJldHJhaW5pbmcgZGF0YXNldCBjb250YWlucyBvdmVyIDE1IHRyaWxsaW9uIHRva2Vucy4gSXQgaXMgYSBtdWx0aWxpbmd1YWwgZGF0YXNldCBjb3ZlcmluZyBvdmVyIDMwIGxhbmd1YWdlcyBhbmQgd2FzIGZpbHRlcmVkIGhlYXZpbHkgZm9yIHF1YWxpdHkgdXNpbmcgdmFyaW91cyB0ZWNobmlxdWVzLCBpbmNsdWRpbmcgaGV1cmlzdGljIGZpbHRlcnMsIE5TRlcgZmlsdGVycywgYW5kIHRleHQgY2xhc3NpZmllcnMuIFRoZSBtb2RlbCdzIGtub3dsZWRnZSB3YXMgdHJhaW5lZCBvbiBkYXRhIHdpdGggYSBjdXRvZmYgb2YgRGVjZW1iZXIgMjAyM1xcLiBcblxuIyMjICoqVGVzdGluZyBEYXRhc2V0KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW5cblxuKipQcm9wZXJ0aWVzOioqIFxuXG4qKkRlc2NyaXB0aW9uOioqXG5cblRoZSBtb2RlbCB3YXMgdGVzdGVkIG9uIGEgZGl2ZXJzZSBzZXQgb2YgZXZhbHVhdGlvbiBkYXRhLlxuXG4qIFB1YmxpYyBCZW5jaG1hcmtzOiBUaGVzZSB0ZXN0IGEgd2lkZSByYW5nZSBvZiBjYXBhYmlsaXRpZXMsIGZyb20gZ2VuZXJhbCBrbm93bGVkZ2UgYW5kIHJlYXNvbmluZyAoTU1MVSwgSGVsbGFTd2FnKSB0byBleHBlcnQtbGV2ZWwgcHJvYmxlbS1zb2x2aW5nIChHUFFBKSBhbmQgcHJvZ3JhbW1pbmcgKEh1bWFuRXZhbCwgd2hpY2ggY29udGFpbnMgMTY0IHByb2dyYW1taW5nIHByb2JsZW1zKS4gIFxuKiBJbnRlcm5hbCBFdmFsdWF0aW9uIFNldDogTWV0YSBjcmVhdGVkIGEgbmV3IGhpZ2gtcXVhbGl0eSB0ZXN0IHNldCBvZiAyLDAwMCBwcm9tcHRzIGNvdmVyaW5nIDEyIGtleSB1c2UgY2FzZXMgKGUuZy4sIGNvZGluZywgcmVhc29uaW5nLCBjcmVhdGl2ZSB3cml0aW5nLCBpbnN0cnVjdGlvbiBmb2xsb3dpbmcpLiBUaGlzIHNldCBpcyB1c2VkIGZvciBodW1hbiBldmFsdWF0aW9uIHRvIGFzc2VzcyBwZXJmb3JtYW5jZSBvbiByZWFsLXdvcmxkLCBudWFuY2VkIHRhc2tzLiBcblxuIyMjICoqRXZhbHVhdGlvbiBEYXRhc2V0KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWRcblxuKipQcm9wZXJ0aWVzOioqIFxuXG5UaGUgZXZhbHVhdGlvbiBkYXRhc2V0cyBhcmUgZGl2ZXJzZSBhbmQgdGVzdCBhIHdpZGUgc3BlY3RydW0gb2YgY2FwYWJpbGl0aWVzLiBNTUxVIG1lYXN1cmVzIGJyb2FkIG11bHRpdGFzayBrbm93bGVkZ2UuIEdQUUEgYXNzZXNzZXMgYWR2YW5jZWQgcmVhc29uaW5nIHdpdGggZGlmZmljdWx0LCBleHBlcnQtbGV2ZWwgcXVlc3Rpb25zLiBIdW1hbkV2YWwgYW5kIE1BVEggc3BlY2lmaWNhbGx5IHRlc3QgY29kZSBnZW5lcmF0aW9uIGFuZCBtYXRoZW1hdGljYWwgcmVhc29uaW5nIGFiaWxpdGllcywgcmVzcGVjdGl2ZWx5LiBNZXRhIGFsc28gdXRpbGl6ZXMgYSBsYXJnZSwgcHJpdmF0ZSwgaHVtYW4tYW5ub3RhdGVkIGV2YWx1YXRpb24gc2V0IGRlc2lnbmVkIHRvIGFzc2VzcyBtb2RlbCBwZXJmb3JtYW5jZSBpbiByZWFsLXdvcmxkLCBudWFuY2VkIHNjZW5hcmlvcy4gXG5cbioqQmFzZSBwcmV0cmFpbmVkIG1vZGVscyoqXG5cbnwgQ2F0ZWdvcnkgfCBCZW5jaG1hcmsgfCBcXCMgU2hvdHMgfCBNZXRyaWMgfCBMbGFtYSAzIDhCIHwgTGxhbWEgMy4xIDhCIHwgTGxhbWEgMyA3MEIgfCBMbGFtYSAzLjEgNzBCIHwgTGxhbWEgMy4xIDQwNUIgfFxufCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfFxufCBHZW5lcmFsIHwgTU1MVSB8IDUgfCBtYWNyb1xcX2F2Zy9hY2NcXF9jaGFyIHwgNjYuNyB8IDY2LjcgfCA3OS41IHwgNzkuMyB8IDg1LjIgfFxufCAgfCBNTUxVLVBybyAoQ29UKSB8IDUgfCBtYWNyb1xcX2F2Zy9hY2NcXF9jaGFyIHwgMzYuMiB8IDM3LjEgfCA1NS4wIHwgNTMuOCB8IDYxLjYgfFxufCAgfCBBR0lFdmFsIEVuZ2xpc2ggfCAzLTUgfCBhdmVyYWdlL2FjY1xcX2NoYXIgfCA0Ny4xIHwgNDcuOCB8IDYzLjAgfCA2NC42IHwgNzEuNiB8XG58ICB8IENvbW1vblNlbnNlUUEgfCA3IHwgYWNjXFxfY2hhciB8IDcyLjYgfCA3NS4wIHwgODMuOCB8IDg0LjEgfCA4NS44IHxcbnwgIHwgV2lub2dyYW5kZSB8IDUgfCBhY2NcXF9jaGFyIHwgXFwtIHwgNjAuNSB8IFxcLSB8IDgzLjMgfCA4Ni43IHxcbnwgIHwgQklHLUJlbmNoIEhhcmQgKENvVCkgfCAzIHwgYXZlcmFnZS9lbSB8IDYxLjEgfCA2NC4yIHwgODEuMyB8IDgxLjYgfCA4NS45IHxcbnwgIHwgQVJDLUNoYWxsZW5nZSB8IDI1IHwgYWNjXFxfY2hhciB8IDc5LjQgfCA3OS43IHwgOTMuMSB8IDkyLjkgfCA5Ni4xIHxcbnwgS25vd2xlZGdlIHJlYXNvbmluZyB8IFRyaXZpYVFBLVdpa2kgfCA1IHwgZW0gfCA3OC41IHwgNzcuNiB8IDg5LjcgfCA4OS44IHwgOTEuOCB8XG58IFJlYWRpbmcgY29tcHJlaGVuc2lvbiB8IFNRdUFEIHwgMSB8IGVtIHwgNzYuNCB8IDc3LjAgfCA4NS42IHwgODEuOCB8IDg5LjMgfFxufCAgfCBRdUFDIChGMSkgfCAxIHwgZjEgfCA0NC40IHwgNDQuOSB8IDUxLjEgfCA1MS4xIHwgNTMuNiB8XG58ICB8IEJvb2xRIHwgMCB8IGFjY1xcX2NoYXIgfCA3NS43IHwgNzUuMCB8IDc5LjAgfCA3OS40IHwgODAuMCB8XG58ICB8IERST1AgKEYxKSB8IDMgfCBmMSB8IDU4LjQgfCA1OS41IHwgNzkuNyB8IDc5LjYgfCA4NC44IHxcblxuKipJbnN0cnVjdGlvbiB0dW5lZCBtb2RlbHMqKlxuXG58IENhdGVnb3J5IHwgQmVuY2htYXJrIHwgXFwjIFNob3RzIHwgTWV0cmljIHwgTGxhbWEgMyA4QiBJbnN0cnVjdCB8IExsYW1hIDMuMSA4QiBJbnN0cnVjdCB8IExsYW1hIDMgNzBCIEluc3RydWN0IHwgTGxhbWEgMy4xIDcwQiBJbnN0cnVjdCB8IExsYW1hIDMuMSA0MDVCIEluc3RydWN0IHxcbnwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHxcbnwgR2VuZXJhbCB8IE1NTFUgfCA1IHwgbWFjcm9cXF9hdmcvYWNjIHwgNjguNSB8IDY5LjQgfCA4Mi4wIHwgODMuNiB8IDg3LjMgfFxufCAgfCBNTUxVIChDb1QpIHwgMCB8IG1hY3JvXFxfYXZnL2FjYyB8IDY1LjMgfCA3My4wIHwgODAuOSB8IDg2LjAgfCA4OC42IHxcbnwgIHwgTU1MVS1Qcm8gKENvVCkgfCA1IHwgbWljcm9cXF9hdmcvYWNjXFxfY2hhciB8IDQ1LjUgfCA0OC4zIHwgNjMuNCB8IDY2LjQgfCA3My4zIHxcbnwgIHwgSUZFdmFsIHwgIHwgIHwgNzYuOCB8IDgwLjQgfCA4Mi45IHwgODcuNSB8IDg4LjYgfFxufCBSZWFzb25pbmcgfCBBUkMtQyB8IDAgfCBhY2MgfCA4Mi40IHwgODMuNCB8IDk0LjQgfCA5NC44IHwgOTYuOSB8XG58ICB8IEdQUUEgfCAwIHwgZW0gfCAzNC42IHwgMzAuNCB8IDM5LjUgfCA0Ni43IHwgNTAuNyB8XG58IENvZGUgfCBIdW1hbkV2YWwgfCAwIHwgcGFzc0AxIHwgNjAuNCB8IDcyLjYgfCA4MS43IHwgODAuNSB8IDg5LjAgfFxufCAgfCBNQlBQIFxcKysgYmFzZSB2ZXJzaW9uIHwgMCB8IHBhc3NAMSB8IDcwLjYgfCA3Mi44IHwgODIuNSB8IDg2LjAgfCA4OC42IHxcbnwgIHwgTXVsdGlwbC1FIEh1bWFuRXZhbCB8IDAgfCBwYXNzQDEgfCBcXC0gfCA1MC44IHwgXFwtIHwgNjUuNSB8IDc1LjIgfFxufCAgfCBNdWx0aXBsLUUgTUJQUCB8IDAgfCBwYXNzQDEgfCBcXC0gfCA1Mi40IHwgXFwtIHwgNjIuMCB8IDY1LjcgfFxufCBNYXRoIHwgR1NNLThLIChDb1QpIHwgOCB8IGVtXFxfbWFqMUAxIHwgODAuNiB8IDg0LjUgfCA5My4wIHwgOTUuMSB8IDk2LjggfFxufCAgfCBNQVRIIChDb1QpIHwgMCB8IGZpbmFsXFxfZW0gfCAyOS4xIHwgNTEuOSB8IDUxLjAgfCA2OC4wIHwgNzMuOCB8XG58IFRvb2wgVXNlIHwgQVBJLUJhbmsgfCAwIHwgYWNjIHwgNDguMyB8IDgyLjYgfCA4NS4xIHwgOTAuMCB8IDkyLjAgfFxufCAgfCBCRkNMIHwgMCB8IGFjYyB8IDYwLjMgfCA3Ni4xIHwgODMuMCB8IDg0LjggfCA4OC41IHxcbnwgIHwgR29yaWxsYSBCZW5jaG1hcmsgQVBJIEJlbmNoIHwgMCB8IGFjYyB8IDEuNyB8IDguMiB8IDE0LjcgfCAyOS43IHwgMzUuMyB8XG58ICB8IE5leHVzICgwLXNob3QpIHwgMCB8IG1hY3JvXFxfYXZnL2FjYyB8IDE4LjEgfCAzOC41IHwgNDcuOCB8IDU2LjcgfCA1OC43IHxcbnwgTXVsdGlsaW5ndWFsIHwgTXVsdGlsaW5ndWFsIE1HU00gKENvVCkgfCAwIHwgZW0gfCBcXC0gfCA2OC45IHwgXFwtIHwgODYuOSB8IDkxLjYgfFxuXG4qKk11bHRpbGluZ3VhbCBiZW5jaG1hcmtzKipcblxufCBDYXRlZ29yeSB8IEJlbmNobWFyayB8IExhbmd1YWdlIHwgTGxhbWEgMy4xIDhCIHwgTGxhbWEgMy4xIDcwQiB8IExsYW1hIDMuMSA0MDVCIHxcbnwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHxcbnwgR2VuZXJhbCB8IE1NTFUgKDUtc2hvdCwgbWFjcm9cXF9hdmcvYWNjKSB8IFBvcnR1Z3Vlc2UgfCA2Mi4xMiB8IDgwLjEzIHwgODQuOTUgfFxufCAgfCAgfCBTcGFuaXNoIHwgNjIuNDUgfCA4MC4wNSB8IDg1LjA4IHxcbnwgIHwgIHwgSXRhbGlhbiB8IDYxLjYzIHwgODAuNCB8IDg1LjA0IHxcbnwgIHwgIHwgR2VybWFuIHwgNjAuNTkgfCA3OS4yNyB8IDg0LjM2IHxcbnwgIHwgIHwgRnJlbmNoIHwgNjIuMzQgfCA3OS44MiB8IDg0LjY2IHxcbnwgIHwgIHwgSGluZGkgfCA1MC44OCB8IDc0LjUyIHwgODAuMzEgfFxufCAgfCAgfCBUaGFpIHwgNTAuMzIgfCA3Mi45NSB8IDc4LjIxIHxcblxuIyMgKipUZWNobmljYWwgTGltaXRhdGlvbnMqKiBcblxuVGVzdGluZyBjb25kdWN0ZWQgdG8gZGF0ZSBoYXMgbm90IGNvdmVyZWQsIG5vciBjb3VsZCBpdCBjb3ZlciwgYWxsIHNjZW5hcmlvcy4gRm9yIHRoZXNlIHJlYXNvbnMsIGFzIHdpdGggYWxsIExMTXMsIHRoZSBtb2RlbCdzIHBvdGVudGlhbCBvdXRwdXRzIGNhbm5vdCBiZSBwcmVkaWN0ZWQgaW4gYWR2YW5jZSwgYW5kIHRoZSBtb2RlbCBtYXkgaW4gc29tZSBpbnN0YW5jZXMgcHJvZHVjZSBpbmFjY3VyYXRlLCBiaWFzZWQgb3Igb3RoZXIgb2JqZWN0aW9uYWJsZSByZXNwb25zZXMgdG8gdXNlciBwcm9tcHRzLiBUaGVyZWZvcmUsIGJlZm9yZSBkZXBsb3lpbmcgdGhpcyBtb2RlbCBpbiBhbnkgYXBwbGljYXRpb25zLCBkZXZlbG9wZXJzIHNob3VsZCBwZXJmb3JtIHNhZmV0eSB0ZXN0aW5nIGFuZCB0dW5pbmcgdGFpbG9yZWQgdG8gdGhlaXIgc3BlY2lmaWMgYXBwbGljYXRpb25zLiBQbGVhc2UgcmVmZXIgdG8gYXZhaWxhYmxlIHJlc291cmNlcyBpbmNsdWRpbmcgdGhlIFtSZXNwb25zaWJsZSBVc2UgR3VpZGVdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vcmVzcG9uc2libGUtdXNlLWd1aWRlKSwgW1RydXN0IGFuZCBTYWZldHldKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vdHJ1c3QtYW5kLXNhZmV0eS8pIHNvbHV0aW9ucywgYW5kIG90aGVyIFtyZXNvdXJjZXNdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vZG9jcy9nZXQtc3RhcnRlZC8pIHRvIGxlYXJuIG1vcmUgYWJvdXQgcmVzcG9uc2libGUgZGV2ZWxvcG1lbnQuIFxuXG4jIyAqKkluZmVyZW5jZToqKlxuXG4qKkFjY2VsZXJhdGlvbiBFbmdpbmU6KiogdkxMTSwgVGVuc29yUlQgXG5cbioqVGVzdCBIYXJkd2FyZToqKiBcblxuICBCMjAwIFNYTSAgIFxuICBIMjAwIFNYTSAgXG4gIEgxMDAgU1hNICBcbiAgQTEwMCBTWE0gODBHQiAgXG4gIEExMDAgU1hNIDQwR0IgIFxuICBMNDBTIFBDSWUgIFxuICBBMTBHICBcbiAgSDEwMCBOVkwgIFxuICBIMjAwIE5WTCAgXG4gIEdIMjAwIDk2R0IgIFxuICBHQjIwMCBOVkw3MiAgIFxuICBHSDIwMCBOVkwyICAgICBcbiAgUlRYIDUwOTAgIFxuICBSVFggNDA5MCAgXG4gIFJUWCA2MDAwIEFkYVxuXG4jIyAqKkV0aGljYWwgQ29uc2lkZXJhdGlvbnM6KipcblxuTlZJRElBIGJlbGlldmVzIFRydXN0d29ydGh5IEFJIGlzIGEgc2hhcmVkIHJlc3BvbnNpYmlsaXR5IGFuZCB3ZSBoYXZlIGVzdGFibGlzaGVkIHBvbGljaWVzIGFuZCBwcmFjdGljZXMgdG8gZW5hYmxlIGRldmVsb3BtZW50IGZvciBhIHdpZGUgYXJyYXkgb2YgQUkgYXBwbGljYXRpb25zLiBXaGVuIGRvd25sb2FkZWQgb3IgdXNlZCBpbiBhY2NvcmRhbmNlIHdpdGggb3VyIHRlcm1zIG9mIHNlcnZpY2UsIGRldmVsb3BlcnMgc2hvdWxkIHdvcmsgd2l0aCB0aGVpciBpbnRlcm5hbCBtb2RlbCB0ZWFtIHRvIGVuc3VyZSB0aGlzIG1vZGVsIG1lZXRzIHJlcXVpcmVtZW50cyBmb3IgdGhlIHJlbGV2YW50IGluZHVzdHJ5IGFuZCB1c2UgY2FzZSBhbmQgYWRkcmVzc2VzIHVuZm9yZXNlZW4gcHJvZHVjdCBtaXN1c2UuIFBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIHByb3ZpZGVkIG1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuIiwKICAgICJkaXNwbGF5TmFtZSI6ICJMbGFtYS0zLjEtNzBiLWluc3RydWN0IiwKICAgICJleHBsYWluYWJpbGl0eSI6ICIiLAogICAgImZyYW1ld29yayI6ICJPdGhlciIsCiAgICAiaGFzUGxheWdyb3VuZCI6IGZhbHNlLAogICAgImhhc1NpZ25lZFZlcnNpb24iOiB0cnVlLAogICAgImlzUGxheWdyb3VuZEVuYWJsZWQiOiBmYWxzZSwKICAgICJpc1B1YmxpYyI6IGZhbHNlLAogICAgImlzUmVhZE9ubHkiOiB0cnVlLAogICAgImxhYmVscyI6IFsKICAgICAgICAiTGxhbWEzLjEiLAogICAgICAgICJMbGFtYTMuMS03MGItaW5zdHJ1Y3QiLAogICAgICAgICJOSU0iLAogICAgICAgICJOU1BFQ1QtN1MzRi1RRkc4IiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAicnR4NjAwMC1ibGFja3dlbGwtc3Z4OC1sYXRlbmN5LWJmMTYtYnhpYWdoNGpnZyIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMTU3MzU3MjY3OTI3LAogICAgImxvZ28iOiAiaHR0cHM6Ly9hc3NldHMubmdjLm52aWRpYS5jb20vcHJvZHVjdHMvYXBpLWNhdGFsb2cvaW1hZ2VzL2xsYW1hLTNfMS03MGItaW5zdHJ1Y3QuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJTYXZlZE1vZGVsIiwKICAgICJuYW1lIjogImxsYW1hLTMuMS03MGItaW5zdHJ1Y3QiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiT1RIRVIiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJNZXRhIiwKICAgICJzYWZldHlBbmRTZWN1cml0eSI6ICIiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiVGhlIE1ldGEgTGxhbWEgMy4xIGNvbGxlY3Rpb24gb2YgbXVsdGlsaW5ndWFsIGxhcmdlIGxhbmd1YWdlIG1vZGVscyAoTExNcykgaXMgYSBjb2xsZWN0aW9uIG9mIHByZXRyYWluZWQgYW5kIGluc3RydWN0aW9uIHR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDhCLCA3MEIgYW5kIDQwNUIgc2l6ZXMgKHRleHQgaW4vdGV4dCBvdXQpLiIsCiAgICAidGVhbU5hbWUiOiAibWV0YSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0xNVQxNzo0OToxNS42MDVaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/llama-3_1-70b-instruct-nemo optimizationProfiles: - profileId: nim/meta/llama-3.1-70b-instruct:b200x1-throughput-nvfp4-lissxvpltg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x1 NVFP4 Throughput ngcMetadata: 1b7ebc7f2cd12aa502b3f2bc17fa55a91f304abd992b287c535a59b6536d3e05: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b476c975e5339b67e01a1a9aee137aa1dd80c1d520b62ba160b64e426c8e2e6e number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx8 BF16 Latency ngcMetadata: 266a5944d595ad57b186c01686b30ba7d1fc10f22a5b4fa17ef8d5cd54faf0f8: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 62c6e2eeff50dd4b71f6a31817eed7685778f8d1415340f402e269add0ca102b number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 8 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h200x4-latency-bf16-csp1xgtxoq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200x4 BF16 Latency ngcMetadata: 2a56d7a6042e02c5b469f5128c76379973e255caf5b1adc1cde6e03230159077: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 91f8367eac71f0e5731988bac7b8b9ae66747619ed7cea336ff1ad2609b07945 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 4 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 139GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__2 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A100_SXM4_40GBx8 BF16 Throughput ngcMetadata: 2fdeceaf1b64acf3ab1c2a22b8e23f6c25d639d6a5d7006c51c80b613fb2699b: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ce61710173c15471c4031430bc8de32b94fb1859a9d4d4cced5c09664b9658c3 number_of_gpus: '8' pp: '1' precision: bf16 profile: throughput tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:l40sx4-throughput-fp8-ulen5raong framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct L40Sx4 FP8 Throughput ngcMetadata: 3013dcf9b905cbd2f5e23f804fd5d66d183ddc71a8735631d3cad277f7c23897: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ce87554d33c9d66d40c52c15b3a90b5c802ef4b7d05781dc74fd18485a20e15d number_of_gpus: '4' pp: '1' precision: fp8 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x1-latency-nvfp4-aiiz15cu0w framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x1 NVFP4 Latency ngcMetadata: 344979e57f70e669d35378bc48ef7d14a13dc6aa0467ce9cb29166b8a8371bcb: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b668500698d48c5aee9f5b591c4383cb62053acb59539cf0b511b8b2d2ae864f number_of_gpus: '1' pp: '1' precision: nvfp4 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__3 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx2 FP8 Throughput ngcMetadata: 3526ceaf332ec21d4317c0939a99a3862b19593527fa942ffd5a1df2dade47ce: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2a535c9c9ddfb8e328abc28f3b4d9564ecdf9886fa177096f7b38dee7af754ab number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__4 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100_NVLx2 BF16 Throughput ngcMetadata: 3684471ad5d007fa1f72bbc672a794107de7b0e8df88214dc1563a24aa99c8b7: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 22af385c5fd7064b011e826d0d78c210b7ac1fe7a9e29eef15e6a5e433b9db9d number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:b200x2-latency-nvfp4-hrt0sgzswa framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x2 NVFP4 Latency ngcMetadata: 377c705c5682293482c5094b946b8e74ccba5302c324b5ce41f952e9cac29890: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 289f1c679cc71fbadaa8139366458b0c3fc39d49ba067efdb7db9fbf3801ac1c number_of_gpus: '2' pp: '1' precision: nvfp4 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:l40sx4-latency-fp8-ctp-cvrc0w framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct L40Sx4 FP8 Latency ngcMetadata: 43160a1132063bf60ef6d7fe17a9b271f03dedbdb3bd1584a2e53707c8faa9ce: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f1a3de57c511586b258f58e7457103c919f8fa4db289d37961cad2468596ee6c number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__5 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100_NVLx2 FP8 Throughput ngcMetadata: 44d44ef91639f0c76a1ef4be0022651ed8d42b485c26de00ba99aee570d1768d: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 1d049541d40b0b0407983f0438189a5d21af6652866d6640437e0323c7878361 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x2-throughput-bf16-lo9t8i-qua framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x2 BF16 Throughput ngcMetadata: 45c52f130d8d467fa6e91f4ffee683fff5601e16df41388d4047e63e294e1165: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 706ae15947d58ed243812620f46199e223e7288c6624ccd33d9e9393a7bfb96a number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__6 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx2 NVFP4 Throughput ngcMetadata: 4b9618100e94fc85d674a89eae960e18d8192163abe5db2a0d2be891d32ea06a: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 54ad694d948a6bd8d413341c0d9476b3756a5553aa8ce8ba5479d3b3cf289e9d number_of_gpus: '2' pp: '1' precision: nvfp4 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 2 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h100x4-throughput-bf16-wf01-bcefa framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100x4 BF16 Throughput ngcMetadata: 4d9f79288ba78fd61b3cc445c6f9da30362a132ea371798a8ec3dff7bddc3a20: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 22f873ff61f22bd360dc173f0f4a068d4d950c02ea6045570eb7f50ec8f83e93 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 139GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h100x2-throughput-fp8-vjxy5bkroq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100x2 FP8 Throughput ngcMetadata: 4fbe63c3f6f9b928dac05fe81a278ac1ad45ccf329850f66bd6cbc0c2f2c044c: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: bb98ff9885aa439391b057063cce3555833a27f88d982b2c210fd4b752390475 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__7 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_144GBx2 BF16 Latency ngcMetadata: 50fe6d2879cabe91e1e0b96314d40695e7ffc9e83a02d63629b9cabfae496dbe: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 21c7fedc20e7b94738606f7f4f8ebb346dc3f087f082dd32b713e4b8e6ed0a06 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__8 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200_NVLx2 FP8 Latency ngcMetadata: 592714cb05c8f25c0445fb7467d096956db9bfbee0958eb713c02a5410867bff: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 90dae25f9f80d311b10f61f5772c37bac723422cce689c138396be49db0b82f4 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__9 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_144GBx1 FP8 Throughput ngcMetadata: 5fbbcbeb676751bfdc9b65cca39334f82fbe543070ea66b4756f71de6cfe2b59: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b2d2411595259e3d02add53ce15aaae59cf5bb02731910aecbd8b5b7a3f75adc number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:a100x4-throughput-bf16-ftwaepe7oq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A100x4 BF16 Throughput ngcMetadata: 68aff19a2e5198624143bf25060662c863ecf21039b6f2d4ef3fe7965a8bab96: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 8f849c4baf82033a3bbfba75bd2a6fc379c92079e81f6fca99f978c9d1c04ad1 number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 4 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 140GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h200x2-latency-fp8-msyzoyixrw framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200x2 FP8 Latency ngcMetadata: 6c27932dc47820a7130505d6bceca05a3ec27628a8416b4603b9b9c8367f161d: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 070c645e1731e5dd9875c800a22cadcd32f9008bf79b768884a331afc9c96e25 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:l40sx4-throughput-bf16-gfrr6smxia framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct L40Sx4 BF16 Throughput ngcMetadata: 6c9c0490830921741f09a61b59d32ff645681d80194b3af37214824d65f05e7e: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e4710ee55a988086fb6dd511b81e989b78d523d951f0da1719cf0328d750a71e number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 140GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:b200x1-throughput-fp8-ktlniezpyw framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x1 FP8 Throughput ngcMetadata: 741556aa43f38761800674e07ff79f5d61136c8301687b3f914f61c78f72ce46: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d8ffe1683a73563951753b8b23c0854020887590f3a2112230e0ad947fe1ae99 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__10 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_480GBx1 FP8 Throughput ngcMetadata: 75e60d670c274c13e9647548bc1c21549d28871432524a0c86becc2b9c73392e: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6a43b054452f258a2315e308da5d8813a4d5c7672764a4f28218373855853197 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__11 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx4 BF16 Throughput ngcMetadata: 76296a7f2a589f543337824f321c38801835885f3a85d9efc3c5b820d7db5228: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4f131424adabbfc81a877f09da0ca3bb31989fc0bed618b8d0c5969faa01f7fe number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:a100x8-latency-bf16-zb8ixw2ong framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A100x8 BF16 Latency ngcMetadata: 7cfa94d868fb7d979659d8418cbf37496cefd480d3b3b3ea06877b08e2868827: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 698871a2af3710aa48027caa8536573c057658a99a89b8d9652e15f19f0c2e12 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 8 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 147GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__12 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_480GBx1 FP8 Latency ngcMetadata: 88a14e8523e8747165e8574a84cee8c4a580af03ced367e74017bf4046835dd2: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e85188dc62e0c517a93bc24a32bee7b7f27b66fa0c6e3184813a4873369e413f number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:b200x4-latency-bf16-gqr-l-hprg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x4 BF16 Latency ngcMetadata: 8cc3eeb4f2ae763b36bf76a67ed42daea7b533852a65090b522440956de4f327: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3a0889dd10acf4050ccd4fbb878eb5c982c420e3a63df2a2fafaa9fc6c8cf861 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 4 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h100x4-latency-fp8-oxqturnvsg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100x4 FP8 Latency ngcMetadata: 9078b6b41878fcfd7e5e9dca2ea0b5c5560d85d31e2cbb9e0e9801d2bb192bfe: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: cc434557f087f390d162cf972e61958ba9e9f09b6112e174e9824b7bcd92e6f4 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__13 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200_NVLx1 FP8 Throughput ngcMetadata: 92adc0b1a36388246d3f037e68df053c83b4bfe4d23e1fae59f711e6e451b944: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0e974238d656d94cb79d39fcc0064f619e6606c678fcba61651358275c693e75 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x1-throughput-nvfp4-w75uvvawyq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x1 NVFP4 Throughput ngcMetadata: a92446d9168e5b10aabe4d31889c68b90503f2ee9bbefafa7b406ef1f2f2b92b: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c593287a9ac875b3a649fb7725a9f1a1e6816129291594a3783a556296bd8808 number_of_gpus: '1' pp: '1' precision: nvfp4 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: NVFP4 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 41GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:b200x2-latency-fp8-zkeshhnnug framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x2 FP8 Latency ngcMetadata: b483bd59b245ec47d9b700691316ed76163f1500d17dcd1fd1fc13ef4fa34dbd: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: daec3db3d904aa6cba1cecd2404867f81d44cf10bb16cc9c9f0ee9a19085bb68 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 69GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__14 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100_NVLx4 FP8 Latency ngcMetadata: b8a18b250c3bd00464dd5194016ecc81756f0121ebc070081bdb2de6dd715a91: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e741999618e5a4d94b595ff13d17028e5f11db1d5ed50644fd584d34d553198b number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__15 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_144GBx2 BF16 Throughput ngcMetadata: bab01e4b4d692d4d879a405cac30bc3830fb4bfed76deaff130bc989bbf70008: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 943e58ca6ffb929366337f69cfc2a49f55a062cb721159a094ae6ade370d2302 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:a10gx8-throughput-bf16-c6h2bujzqq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A10Gx8 BF16 Throughput ngcMetadata: bb0acd8d341492a58388d49010ebfd53ccf30e9ba61961e68853b7812bdd57d5: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 91af47c6a8cd2c59b5187b47bcb6c3feaef274f685067c0ba391f035ccf265eb number_of_gpus: '8' pp: '1' precision: bf16 profile: throughput tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 150GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__16 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_144GBx2 FP8 Latency ngcMetadata: c02d69cc0542152ece147e75cb33487d9058a83ac94866680455b56c075cede4: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 50fd91ee630703f0af954360b638c997fa7e69b60ed949c129e3ba042ed47b66 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h200x1-throughput-fp8-j-xwy-p6zg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200x1 FP8 Throughput ngcMetadata: cb42798192666f9b621fb9a5aeecb342ae389bb6c8992183804aeed016fc1862: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0a504db21e8269006446b7b777218b5fc904fb8308dd5fbba24de96b577d289f number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__17 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GH200_144GBx2 FP8 Throughput ngcMetadata: d40298dbc0f90c12808e7e5becb22e47c284f05012c73dabb9818f03f461cd10: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ceebc0caeb9bdff847a148e0915219590cc463095bfb9545eb265978e4b8eb81 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 2 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__18 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A100_SXM4_40GBx8 BF16 Latency ngcMetadata: d847fc6b060db9381d38e6cb59ff183f29c6bb457c402d24c27971e59bad9bf7: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 35500bcc312a974be001478a0b1e2466fea9dac13d7bd087146f70d4c9e854c6 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x1-latency-fp8-f3rjvlafrw framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x1 FP8 Latency ngcMetadata: dbcdb5f1412398520d7330cb890aa57f1792596f7dc885cc65a1dc20d390cc9d: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a5a7e9799d92d3e8e2cb39c45acf73dee122f9f65c1bbeaf4eaf7d669745a89c number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:l40sx4-latency-bf16-jhyf9rlszq framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct L40Sx4 BF16 Latency ngcMetadata: e2b3ba60e795d306cf487ea71c8a5d128769f452eeffb54fada6697f031b556c: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3d65171e66e53a0c6b9d1253a09c393d917cb611ea6de85f7c7abadf7ea934b6 number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__19 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H100_NVLx4 BF16 Latency ngcMetadata: e6fcaba4b0c11392cd4ce8e0eddc261fac45e994c7735c3d79734245aac1a68d: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: dbc58664a141b59a060de53a9e4f2d25b4ec41f75fcb791a0f046981b0634fad number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x1-throughput-fp8-trr9koy1vg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x1 FP8 Throughput ngcMetadata: e8e4c9317e3e32c8e50d3f4c54019b40df5608a319359ad9f8257d23f2348c2b: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: cb02e92359903bcfa274d5176c8a7a840e58a3df1587ca0f0c734049d4f1d5c8 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 68GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:b200x2-throughput-bf16-gbt9zmjfla framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct B200x2 BF16 Throughput ngcMetadata: f078cbf33438ea9b68c5d4eba7bec671246d44730cbb0af6d94dfa1517bf3036: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4db4480cbfa2cd40a70ed784e3bb40e3e7e4d6693b7d275fb0b19b328ea1da0a number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:a10gx8-latency-bf16-mqqdeavnfg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct A10Gx8 BF16 Latency ngcMetadata: f49e065d985faa3a766163f386395cc53c64429754c58cf9edf553ac0ec96244: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9c2fce4ab72d829d5e3b008b9f6b64a608194a97ee6fc18af7863cf922226107 number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 150GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__20 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx4 NVFP4 Latency ngcMetadata: f66f34808a8fe25ee8a3666427569f3e7119b1af54cd64e31d082282d5d47210: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d7ec938fb438f8d87c58707eb5a60af4e1fb6a9b7ac42eef6738dd9b0d2ff671 number_of_gpus: '4' pp: '1' precision: nvfp4 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: NVFP4 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:h200x2-throughput-bf16-9iwul7vevg framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200x2 BF16 Throughput ngcMetadata: f6d98b286dd43d8a6e677a9a0f218e76928154490a908a2d9f76cbfd2cd043bf: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 583b7cb36984c4bff9e31b3f10937d34d488b2e4e32ac4b0ac5b44e02ef4779b number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 134GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__21 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct RTX6000_BLACKWELL_SVx4 FP8 Latency ngcMetadata: f7397c4ee54cefd8fc3cc3b947406ba51947215d77ff58f35aeaa298605db13a: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ead7f13a4122bc78f9624682198bcccbc485345c9a58742601b0bf0e8ed59760 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 4 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:1d54af340dc8906a2d21146191a9c184c35e47bd__22 framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct H200_NVLx2 BF16 Throughput ngcMetadata: fa4fbf5af52b66775f63d40cbc3db263304d7844095d1a677d799b8e90bf141b: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d2ae506c5cddf13a3d2f0139dcb6edafd042794999162e7d9623bd4ceabb1b70 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 263GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.1-70b-instruct:gb200x4-latency-bf16-3uozpudciw framework: TensorRT-LLM displayName: Llama 3.1 70B Instruct GB200x4 BF16 Latency ngcMetadata: fe20ab9158c65c3e7765e50c5c72ece46ee34a9e184dcdb13eda9bbef78ab300: model: meta/llama-3.1-70b-instruct release: 1.14.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e6a18cf6935b817ca2968d06e1abd91444d73634b80ff54f3680d152cadc209e number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 4 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.14.0 - key: DOWNLOAD SIZE value: 138GB - key: LLM ENGINE value: TENSORRT_LLM labels: - Llama - Meta - Text Generation - Large Language Model - TensorRT-LLM - Language Generation - NeMo - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: StarCoder2-7B displayName: StarCoder2-7B modelHubID: starcoder-2 category: Code type: NGC description: Code generation model trained on 17 programming languages. The model is optimized for code completion, synthesis, and fill-in-the-middle objective. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: StarCoder2-7B modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMy0wOFQxNzo0ODo1MS41NTlaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjICoqU3RhcmNvZGVyMi03QiBPdmVydmlldyoqXG5cbiMjICoqRGVzY3JpcHRpb246KipcblxuKipTdGFyQ29kZXIyLTdCKiogZ2VuZXJhdGVzIHNvdXJjZSBjb2RlIGZyb20gbmF0dXJhbCBsYW5ndWFnZSBpbnN0cnVjdGlvbnMgYW5kIGNvZGUgcHJvbXB0cyBhY3Jvc3MgYSB3aWRlIHJhbmdlIG9mIHByb2dyYW1taW5nIGxhbmd1YWdlcy4gVGhpcyA3LWJpbGxpb24gcGFyYW1ldGVyIG1vZGVsIGlzIHBhcnQgb2YgdGhlIG5leHQgZ2VuZXJhdGlvbiBvZiBvcGVuLXNvdXJjZSBsYXJnZSBsYW5ndWFnZSBtb2RlbHMgZm9yIGNvZGUsIGRldmVsb3BlZCBieSB0aGUgQmlnQ29kZSBjb2xsYWJvcmF0aW9uLCBhbmQgd2FzIHRyYWluZWQgb24gVGhlIFN0YWNrIHYyLCBhIG1hc3NpdmUsIHBlcm1pc3NpdmVseSBsaWNlbnNlZCBkYXRhc2V0IGNvdmVyaW5nIG92ZXIgNjAwIHByb2dyYW1taW5nIGxhbmd1YWdlcy4gSXQgaXMgc3BlY2lmaWNhbGx5IGRlc2lnbmVkIHRvIGFzc2lzdCB3aXRoIHRhc2tzIGxpa2UgY29kZSBjb21wbGV0aW9uLCBjb2RlIHN5bnRoZXNpcywgYW5kIGluZmlsbGluZyAoZmlsbGluZyBpbiBtaXNzaW5nIGNvZGUgd2l0aGluIGEgZmlsZSkuXG5cblRoaXMgbW9kZWwgaXMgcmVhZHkgZm9yIGNvbW1lcmNpYWwvbm9uLWNvbW1lcmNpYWwgdXNlLlxuXG5UaGlzIHZlcnNpb24gaW50cm9kdWNlcyBzdXBwb3J0IGZvciBHQjIwMCBOVkw3MiwgR0gyMDAgTlZMMiwgQjIwMCBhbmQgTlZGUDQuIENVREEgdXBkYXRlZCB0byB2ZXJzaW9uIDEyLjkuIEZvciBkZXRhaWxlZCBpbmZvcm1hdGlvbiwgcmVmZXIgdG8gUmVsZWFzZSBbTm90ZXMgZm9yIE5WSURJQSBOSU0gZm9yIExMTXMgTExNIDEuMTJdKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25pbS9sYXJnZS1sYW5ndWFnZS1tb2RlbHMvbGF0ZXN0L3JlbGVhc2Utbm90ZXMuaHRtbCkuIFxuXG4jIyAqKlRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uKipcblxuVGhpcyBtb2RlbCBpcyBub3Qgb3duZWQgb3IgZGV2ZWxvcGVkIGJ5IE5WSURJQS4gVGhpcyBtb2RlbCBoYXMgYmVlbiBkZXZlbG9wZWQgYW5kIGJ1aWx0IHRvIGEgdGhpcmQtcGFydHkncyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFxcW2JpZ2NvZGUvc3RhcmNvZGVyMi03YlxcXSAgXG4oW2JpZ2NvZGUvc3RhcmNvZGVyMi03YiBcdTAwYjcgSHVnZ2luZyBGYWNlXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2JpZ2NvZGUvc3RhcmNvZGVyMi03YiMjbGljZW5zZSkpLiBcblxuIyMgKipMaWNlbnNlL1Rlcm1zIG9mIFVzZToqKlxuXG4qKkdPVkVSTklORyBURVJNUzoqKiBUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LykgYW5kIHRoZSBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cy8pOyBleGNlcHQgZm9yIHRoZSBtb2RlbCB3aGljaCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBDb21tdW5pdHkgTW9kZWwgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvLikuXG5cbioqQURESVRJT05BTCBJTkZPUk1BVElPTjoqKiBbQmlnQ29kZSBPcGVuIFJBSUwtTSB2MSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9zcGFjZXMvYmlnY29kZS9iaWdjb2RlLW1vZGVsLWxpY2Vuc2UtYWdyZWVtZW50KS5cblxuIyMgKipHZXQgSGVscCoqXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cbllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIHByb3ZpZGVkIG1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuXG5cbiMjICoqRGVwbG95bWVudCBHZW9ncmFwaHk6KipcblxuR2xvYmFsIFxuXG4jIyAqKlVzZSBDYXNlOioqXG5cblRoZSBleHBlY3RlZCB1c2VycyBvZiBTdGFyQ29kZXIyLTdCIGFyZSBzb2Z0d2FyZSBkZXZlbG9wZXJzLCBkYXRhIHNjaWVudGlzdHMsIHByb2dyYW1tZXJzLCBhbmQgc3R1ZGVudHMuIFRoZXkgd291bGQgdXNlIHRoaXMgbW9kZWwgYXMgYSBzb3BoaXN0aWNhdGVkIGNvZGluZyBhc3Npc3RhbnQgaW50ZWdyYXRlZCBpbnRvIHRoZWlyIGRldmVsb3BtZW50IGVudmlyb25tZW50IChsaWtlIFZTIENvZGUpIG9yIGFzIGEgc3RhbmRhbG9uZSB0b29sIGZvciB0aGUgZm9sbG93aW5nIHB1cnBvc2VzOlxuXG4qIEFjY2VsZXJhdGluZyBEZXZlbG9wbWVudDogVG8gc2lnbmlmaWNhbnRseSBzcGVlZCB1cCB0aGUgY29kaW5nIHByb2Nlc3MgdXNpbmcgaW50ZWxsaWdlbnQsIGNvbnRleHQtYXdhcmUgY29kZSBjb21wbGV0aW9uIGFuZCBpbmZpbGxpbmcuXG5cbiogQ29kZSBTeW50aGVzaXM6IFRvIGdlbmVyYXRlIGVudGlyZSBmdW5jdGlvbnMsIGNsYXNzZXMsIG9yIHNjcmlwdHMgZnJvbSBhIG5hdHVyYWwgbGFuZ3VhZ2UgZGVzY3JpcHRpb24gKGUuZy4sIFwiV3JpdGUgYSBKYXZhU2NyaXB0IGZ1bmN0aW9uIHRoYXQgdmFsaWRhdGVzIGFuIGVtYWlsIGFkZHJlc3MgdXNpbmcgcmVnZXhcIikuXG5cbiogUmFwaWQgUHJvdG90eXBpbmc6IFRvIHF1aWNrbHkgY3JlYXRlIGJvaWxlcnBsYXRlIGNvZGUgb3IgZnVuY3Rpb25hbCBwcm90b3R5cGVzIGZvciBuZXcgYXBwbGljYXRpb25zIG9yIGZlYXR1cmVzLlxuXG4qIExlYXJuaW5nICYgRGVidWdnaW5nOiBUbyB1bmRlcnN0YW5kIGEgbmV3IHByb2dyYW1taW5nIGxhbmd1YWdlIG9yIGZyYW1ld29yayBieSBnZW5lcmF0aW5nIGV4YW1wbGUgY29kZSwgb3IgdG8gZ2V0IHN1Z2dlc3Rpb25zIG9uIGhvdyB0byByZWZhY3RvciBvciBmaXggYSBwaWVjZSBvZiBidWdneSBjb2RlLlxuXG4qIEF1dG9tYXRpb246IFRvIGF1dG9tYXRlIHRoZSBjcmVhdGlvbiBvZiByZXBldGl0aXZlIGNvZGUsIHN1Y2ggYXMgdW5pdCB0ZXN0cywgZGF0YSBwcm9jZXNzaW5nIHNjcmlwdHMsIG9yIGNvbmZpZ3VyYXRpb24gZmlsZXMuXG5cbiMjICoqUmVsZWFzZSBEYXRlOioqXG5cbkJ1aWxkLk5WSURJQS5jb20gMDMvMTgvMjAyNCB2aWEgIFxuW3N0YXJjb2RlcjItN2IgTW9kZWwgYnkgQmlnQ29kZSB8IE5WSURJQSBOSU1dKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9iaWdjb2RlL3N0YXJjb2RlcjItN2IpXG5cbkdpdGh1YiAwMi8yOC8yMDI0IHZpYSAgIFxuW0dpdEh1YiBcXC0gYmlnY29kZS1wcm9qZWN0L3N0YXJjb2RlcjI6IEhvbWUgb2YgU3RhckNvZGVyMlxcIV0oaHR0cHM6Ly9naXRodWIuY29tL2JpZ2NvZGUtcHJvamVjdC9zdGFyY29kZXIyKVxuXG5IdWdnaW5nZmFjZSAwMi8yOC8yMDI0IHZpYSAgIFxuW2JpZ2NvZGUvc3RhcmNvZGVyMi03YiBcdTAwYjcgSHVnZ2luZyBGYWNlXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2JpZ2NvZGUvc3RhcmNvZGVyMi03YiMjbGljZW5zZSlcblxuIyMgKipSZWZlcmVuY2Uocyk6KiogXG5cbltiaWdjb2RlL3N0YXJjb2RlcjItN2IgXHUwMGI3IEh1Z2dpbmcgRmFjZV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9iaWdjb2RlL3N0YXJjb2RlcjItN2IjI2xpY2Vuc2UpXG5cbiMjICoqTW9kZWwgQXJjaGl0ZWN0dXJlOioqIFxuXG5BcmNoaXRlY3R1cmUgVHlwZTogVHJhbnNmb3JtZXIgIFxuTmV0d29yayBBcmNoaXRlY3R1cmU6IFN0YXJDb2RlcjJcblxuVGhpcyBtb2RlbCB3YXMgZGV2ZWxvcGVkIGJhc2VkIG9uIFRoZSBTdGFjayBWMiAgXG5baHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9iaWdjb2RlL3RoZS1zdGFjay12Mi10cmFpbi1mdWxsLWlkc10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9iaWdjb2RlL3RoZS1zdGFjay12Mi10cmFpbi1mdWxsLWlkcykgXG5cbk51bWJlciBvZiBtb2RlbCBwYXJhbWV0ZXJzOiAwLjcxNyoxMF4xMFxuXG4jIyAqKklucHV0OioqXG5cbklucHV0IFR5cGUocyk6IFRleHQgXG5cbklucHV0IEZvcm1hdDogU3RyaW5nIFxuXG5JbnB1dCBQYXJhbWV0ZXJzOiBPbmUtRGltZW5zaW9uYWwgKDFEKVxuXG5PdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQ6XG5cbiogVG9rZW5zOiBUaGUgbW9kZWwgYWNjZXB0cyBhIHNlcXVlbmNlIG9mIHRva2VucyB3aXRoIGEgbWF4aW11bSBjb250ZXh0IHdpbmRvdyBvZiAxNiwzODQgdG9rZW5zLiBUaGlzIGxpbWl0IGVuY29tcGFzc2VzIGJvdGggdGhlIGlucHV0IHByb21wdCBhbmQgdGhlIHRva2VucyBnZW5lcmF0ZWQgYnkgdGhlIG1vZGVsLiAgXG4qIENoYXJhY3RlcnM6IElucHV0IHN0cmluZ3MgY2FuIGNvbnRhaW4gYSB3aWRlIHJhbmdlIG9mIFVuaWNvZGUgY2hhcmFjdGVycywgY29uc2lzdGVudCB3aXRoIHRoZSBkaXZlcnNlIHNldCBvZiBwcm9ncmFtbWluZyBsYW5ndWFnZXMgYW5kIG5hdHVyYWwgbGFuZ3VhZ2VzIGZvdW5kIGluIHRoZSB0cmFpbmluZyBkYXRhLiAgXG4qIFByZS1Qcm9jZXNzaW5nIE5lZWRlZDogUmF3IGlucHV0IHN0cmluZ3MgbXVzdCBiZSBjb252ZXJ0ZWQgaW50byBhIHNlcXVlbmNlIG9mIGludGVnZXIgdG9rZW4gSURzIHVzaW5nIHRoZSBzcGVjaWZpYyB0b2tlbml6ZXIgYXNzb2NpYXRlZCB3aXRoIHRoZSBTdGFyQ29kZXIyLTdCICBtb2RlbCBiZWZvcmUgYmVpbmcgZmVkIGludG8gdGhlIG5ldHdvcmsuXG5cbiBcblxuIyMgKipPdXRwdXQ6KipcblxuT3V0cHV0IFR5cGUocyk6IFRleHQgXG5cbk91dHB1dCBGb3JtYXQ6IFN0cmluZ1xuXG5PdXRwdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDogXG5cbiogVG9rZW5zOiBUaGUgbW9kZWwgZ2VuZXJhdGVzIGEgc2VxdWVuY2Ugb2YgdG9rZW5zLiBUaGUgbGVuZ3RoIG9mIHRoZSBvdXRwdXQgaXMgdmFyaWFibGUgYW5kIGlzIHVsdGltYXRlbHkgY29uc3RyYWluZWQgYnkgdGhlIG1vZGVsJ3MgbWF4aW11bSBjb250ZXh0IHdpbmRvdyBvZiAxNiwzODQgdG9rZW5zICh0aGUgc3VtIG9mIGlucHV0IGFuZCBvdXRwdXQgdG9rZW5zIGNhbm5vdCBleGNlZWQgdGhpcyBsaW1pdCkuICBcbiogQ2hhcmFjdGVycyAoSW5jbHVkaW5nIFJlc3RyaWN0aW9ucyk6IFRoZSBvdXRwdXQgY29uc2lzdHMgb2YgYSB3aWRlIHJhbmdlIG9mIFVuaWNvZGUgY2hhcmFjdGVycyBmcm9tIHRoZSBtb2RlbCdzIHZvY2FidWxhcnksIGRlc2lnbmVkIHRvIHByb2R1Y2Ugc3ludGFjdGljYWxseSBjb3JyZWN0IHNvdXJjZSBjb2RlIGFuZCBjb2hlcmVudCBuYXR1cmFsIGxhbmd1YWdlLiAgXG4qIFBvc3QtUHJvY2Vzc2luZyBOZWVkZWQ6IFRoZSByYXcgdG9rZW4gSURzIGdlbmVyYXRlZCBieSB0aGUgbW9kZWwgbXVzdCBiZSBkZWNvZGVkIHVzaW5nIHRoZSBtb2RlbCdzIHNwZWNpZmljIHRva2VuaXplciB0byBiZSBjb252ZXJ0ZWQgaW50byBhIGh1bWFuLXJlYWRhYmxlIHN0cmluZy4gU3BlY2lhbCBjb250cm9sIHRva2VucyAoZS5nLiwgZW5kLW9mLXNlcXVlbmNlIHRva2VucykgbWF5IGFsc28gbmVlZCB0byBiZSBmaWx0ZXJlZCBmcm9tIHRoZSBmaW5hbCBvdXRwdXQuXG5cbk91ciBBSSBtb2RlbHMgYXJlIGRlc2lnbmVkIGFuZC9vciBvcHRpbWl6ZWQgdG8gcnVuIG9uIE5WSURJQSBHUFUtYWNjZWxlcmF0ZWQgc3lzdGVtcy4gQnkgbGV2ZXJhZ2luZyBOVklESUEncyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuXG5cbiMjICoqU29mdHdhcmUgSW50ZWdyYXRpb246KipcblxuUnVudGltZSBFbmdpbmU6IHZMTE0sIFRlbnNvclJUXG5cblN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OiBOVklESUEgSG9wcGVyICBcblxuUHJlZmVycmVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6XG5cbkxpbnV4ICAgXG5XaW5kb3dzXG5cblRoZSBpbnRlZ3JhdGlvbiBvZiBmb3VuZGF0aW9uIGFuZCBmaW5lLXR1bmVkIG1vZGVscyBpbnRvIEFJIHN5c3RlbXMgcmVxdWlyZXMgYWRkaXRpb25hbCB0ZXN0aW5nIHVzaW5nIHVzZS1jYXNlLXNwZWNpZmljIGRhdGEgdG8gZW5zdXJlIHNhZmUgYW5kIGVmZmVjdGl2ZSBkZXBsb3ltZW50LiBGb2xsb3dpbmcgdGhlIFYtbW9kZWwgbWV0aG9kb2xvZ3ksIGl0ZXJhdGl2ZSB0ZXN0aW5nIGFuZCB2YWxpZGF0aW9uIGF0IGJvdGggdW5pdCBhbmQgc3lzdGVtIGxldmVscyBhcmUgZXNzZW50aWFsIHRvIG1pdGlnYXRlIHJpc2tzLCBtZWV0IHRlY2huaWNhbCBhbmQgZnVuY3Rpb25hbCByZXF1aXJlbWVudHMsIGFuZCBlbnN1cmUgY29tcGxpYW5jZSB3aXRoIHNhZmV0eSBhbmQgZXRoaWNhbCBzdGFuZGFyZHMgYmVmb3JlIGRlcGxveW1lbnQuXG5cbiMjICoqTW9kZWwgVmVyc2lvbihzKToqKlxuXG5TdGFyQ29kZXIyLTdCLTEuMTAuMSA8YnI+XG5TdGFyQ29kZXIyLTdCLTEuMTIuMCA8YnI+XG5TdGFyQ29kZXIyLTdCLTEuMTMuMSA8YnI+XG5TdGFyQ29kZXIyLTdCLTEuMTQuMCA8YnI+XG5TdGFyQ29kZXIyLTdCLTEuMTUuMCA8YnI+XG5cbiMjICoqVXNhZ2UqKlxuXG4qKlJ1bm5pbmcgdGhlIG1vZGVsIG9uIENQVS9HUFUvbXVsdGkgR1BVKipcblxuKiBVc2luZyBmdWxsIHByZWNpc2lvbjpcblxuYGBgXG4jIHBpcCBpbnN0YWxsIGdpdCtodHRwczovL2dpdGh1Yi5jb20vaHVnZ2luZ2ZhY2UvdHJhbnNmb3JtZXJzLmdpdCAjIFRPRE86IG1lcmdlIFBSIHRvIG1haW5cbmZyb20gdHJhbnNmb3JtZXJzIGltcG9ydCBBdXRvTW9kZWxGb3JDYXVzYWxMTSwgQXV0b1Rva2VuaXplclxuXG5jaGVja3BvaW50ID0gXCJiaWdjb2RlL3N0YXJjb2RlcjItN2JcIlxuZGV2aWNlID0gXCJjdWRhXCIgIyBmb3IgR1BVIHVzYWdlIG9yIFwiY3B1XCIgZm9yIENQVSB1c2FnZVxuXG50b2tlbml6ZXIgPSBBdXRvVG9rZW5pemVyLmZyb21fcHJldHJhaW5lZChjaGVja3BvaW50KVxuIyBmb3IgbXVsdGlwbGUgR1BVcyBpbnN0YWxsIGFjY2VsZXJhdGUgYW5kIGRvIGBtb2RlbCA9IEF1dG9Nb2RlbEZvckNhdXNhbExNLmZyb21fcHJldHJhaW5lZChjaGVja3BvaW50LCBkZXZpY2VfbWFwPVwiYXV0b1wiKWBcbm1vZGVsID0gQXV0b01vZGVsRm9yQ2F1c2FsTE0uZnJvbV9wcmV0cmFpbmVkKGNoZWNrcG9pbnQpLnRvKGRldmljZSlcblxuaW5wdXRzID0gdG9rZW5pemVyLmVuY29kZShcImRlZiBwcmludF9oZWxsb193b3JsZCgpOlwiLCByZXR1cm5fdGVuc29ycz1cInB0XCIpLnRvKGRldmljZSlcbm91dHB1dHMgPSBtb2RlbC5nZW5lcmF0ZShpbnB1dHMpXG5wcmludCh0b2tlbml6ZXIuZGVjb2RlKG91dHB1dHNbMF0pKVxuYGBgXG5cbiogVXNpbmcgdG9yY2guYmZsb2F0MTY6XG5cbmBgYFxuIyBwaXAgaW5zdGFsbCBhY2NlbGVyYXRlXG5pbXBvcnQgdG9yY2hcbmZyb20gdHJhbnNmb3JtZXJzIGltcG9ydCBBdXRvVG9rZW5pemVyLCBBdXRvTW9kZWxGb3JDYXVzYWxMTVxuXG5jaGVja3BvaW50ID0gXCJiaWdjb2RlL3N0YXJjb2RlcjItN2JcIlxudG9rZW5pemVyID0gQXV0b1Rva2VuaXplci5mcm9tX3ByZXRyYWluZWQoY2hlY2twb2ludClcblxuIyBmb3IgZnAxNiB1c2UgYHRvcmNoX2R0eXBlPXRvcmNoLmZsb2F0MTZgIGluc3RlYWRcbm1vZGVsID0gQXV0b01vZGVsRm9yQ2F1c2FsTE0uZnJvbV9wcmV0cmFpbmVkKGNoZWNrcG9pbnQsIGRldmljZV9tYXA9XCJhdXRvXCIsIHRvcmNoX2R0eXBlPXRvcmNoLmJmbG9hdDE2KVxuXG5pbnB1dHMgPSB0b2tlbml6ZXIuZW5jb2RlKFwiZGVmIHByaW50X2hlbGxvX3dvcmxkKCk6XCIsIHJldHVybl90ZW5zb3JzPVwicHRcIikudG8oXCJjdWRhXCIpXG5vdXRwdXRzID0gbW9kZWwuZ2VuZXJhdGUoaW5wdXRzKVxucHJpbnQodG9rZW5pemVyLmRlY29kZShvdXRwdXRzWzBdKSlcbmBgYFxuXG5gYGBcbnByaW50KGZcIk1lbW9yeSBmb290cHJpbnQ6IHttb2RlbC5nZXRfbWVtb3J5X2Zvb3RwcmludCgpIC8gMWU2Oi4yZn0gTUJcIilcbmBgYFxuXG4qKlF1YW50aXplZCBWZXJzaW9ucyB0aHJvdWdoIGJpdHNhbmRieXRlcyoqXG5cbiogVXNpbmcgOC1iaXQgcHJlY2lzaW9uIChpbnQ4KTpcblxuYGBgXG4jIHBpcCBpbnN0YWxsIGJpdHNhbmRieXRlcyBhY2NlbGVyYXRlXG5mcm9tIHRyYW5zZm9ybWVycyBpbXBvcnQgQXV0b1Rva2VuaXplciwgQXV0b01vZGVsRm9yQ2F1c2FsTE0sIEJpdHNBbmRCeXRlc0NvbmZpZ1xuXG4jIHRvIHVzZSA0Yml0IHVzZSBgbG9hZF9pbl80Yml0PVRydWVgIGluc3RlYWRcbnF1YW50aXphdGlvbl9jb25maWcgPSBCaXRzQW5kQnl0ZXNDb25maWcobG9hZF9pbl84Yml0PVRydWUpXG5cbmNoZWNrcG9pbnQgPSBcImJpZ2NvZGUvc3RhcmNvZGVyMi03YlwiXG50b2tlbml6ZXIgPSBBdXRvVG9rZW5pemVyLmZyb21fcHJldHJhaW5lZChjaGVja3BvaW50KVxubW9kZWwgPSBBdXRvTW9kZWxGb3JDYXVzYWxMTS5mcm9tX3ByZXRyYWluZWQoY2hlY2twb2ludCwgcXVhbnRpemF0aW9uX2NvbmZpZz1xdWFudGl6YXRpb25fY29uZmlnKVxuXG5pbnB1dHMgPSB0b2tlbml6ZXIuZW5jb2RlKFwiZGVmIHByaW50X2hlbGxvX3dvcmxkKCk6XCIsIHJldHVybl90ZW5zb3JzPVwicHRcIikudG8oXCJjdWRhXCIpXG5vdXRwdXRzID0gbW9kZWwuZ2VuZXJhdGUoaW5wdXRzKVxucHJpbnQodG9rZW5pemVyLmRlY29kZShvdXRwdXRzWzBdKSlcbmBgYFxuXG5gYGBcblxuPj4+IHByaW50KGZcIk1lbW9yeSBmb290cHJpbnQ6IHttb2RlbC5nZXRfbWVtb3J5X2Zvb3RwcmludCgpIC8gMWU2Oi4yZn0gTUJcIilcbiMgbG9hZF9pbl84Yml0XG5NZW1vcnkgZm9vdHByaW50OiA3NjcwLjUyIE1CXG4jIGxvYWRfaW5fNGJpdFxuPj4+IHByaW50KGZcIk1lbW9yeSBmb290cHJpbnQ6IHttb2RlbC5nZXRfbWVtb3J5X2Zvb3RwcmludCgpIC8gMWU2Oi4yZn0gTUJcIilcbk1lbW9yeSBmb290cHJpbnQ6IDQxOTcuNjQgTUJcbmBgYFxuXG4jIyAqKlRyYWluaW5nLCBUZXN0aW5nLCBhbmQgRXZhbHVhdGlvbiBEYXRhc2V0czoqKlxuXG4jIyMgKipUcmFpbmluZyBEYXRhc2V0OioqXG5cbioqRGF0YSBNb2RhbGl0eToqKiBUZXh0IFxuXG4qKkxpbms6KiogVW5kaXNjbG9zZWRcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgU3ludGhldGljLCBBdXRvbWF0ZWRcblxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKlByb3BlcnRpZXM6KiogXG5cbiogUXVhbnRpdHk6IFN0YXJDb2RlcjItN0Igd2FzIHRyYWluZWQgb24gYSBwcm9jZXNzZWQgc3Vic2V0IG9mIHRoZSBkYXRhc2V0IHRvdGFsaW5nIGFwcHJveGltYXRlbHkgMy4zIHRyaWxsaW9uIHRva2Vucy4gVGhlIGNvbXBsZXRlLCBwcmUtcHJvY2Vzc2VkIFN0YWNrIHYyIGRhdGFzZXQgY29udGFpbnMgb3ZlciA2N1RCIG9mIGRhdGEuICBcbiogRGF0YXNldCBEZXNjcmlwdGlvbnM6IFRoZSBTdGFjayB2MiBpcyBhIHZlcnkgbGFyZ2UgZGF0YXNldCBvZiBzb3VyY2UgY29kZSBmcm9tIG92ZXIgNjAwIHByb2dyYW1taW5nIGxhbmd1YWdlcywgc3VwcGxlbWVudGVkIHdpdGggdGV4dCBmcm9tIEdpdEh1YiBJc3N1ZXMsIFB1bGwgUmVxdWVzdHMsIGFuZCBLYWdnbGUgTm90ZWJvb2tzLiBBIGtleSBmZWF0dXJlIG9mIHRoZSBkYXRhc2V0IGlzIHRoYXQgaXQgaGFzIGJlZW4gZmlsdGVyZWQgdG8gb25seSBpbmNsdWRlIGNvbnRlbnQgZnJvbSByZXBvc2l0b3JpZXMgd2l0aCBwZXJtaXNzaXZlIGxpY2Vuc2VzLiBJdCBhbHNvIHVuZGVyd2VudCBhbiBleHRlbnNpdmUgUElJIChQZXJzb25hbGx5IElkZW50aWZpYWJsZSBJbmZvcm1hdGlvbikgcmVkYWN0aW9uIHByb2Nlc3MgdG8gcmVtb3ZlIHNlbnNpdGl2ZSBkYXRhLlxuXG4jIyMgKipUZXN0aW5nIERhdGFzZXQ6KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKlByb3BlcnRpZXM6KiogXG5cblF1YW50aXR5OiBUaGUgYmVuY2htYXJrcyBjb25zaXN0IG9mIGEgdmFyaWVkIG51bWJlciBvZiBwcm9ibGVtcyAoZS5nLiwgSHVtYW5FdmFsOiAxNjQgcHJvYmxlbXM7IE1CUFA6IFxcfjQwMCB0ZXN0IHByb2JsZW1zOyBEUy0xMDAwOiAxLDAwMCBwcm9ibGVtcykuXG5cbkRhdGFzZXQgRGVzY3JpcHRpb25zOiBUaGlzIGlzIGEgY29sbGVjdGlvbiBvZiBldmFsdWF0aW9uIHN1aXRlcywgbm90IGEgc2luZ2xlIGRhdGFzZXQuIFRoZXkgYXJlIGRlc2lnbmVkIHRvIG1lYXN1cmUgdGhlIG1vZGVsJ3MgcGVyZm9ybWFuY2Ugb24gc3BlY2lmaWMgZG93bnN0cmVhbSB0YXNrczpcblxuKiBIdW1hbkV2YWwvTUJQUDogVGVzdCBQeXRob24gY29kZSBnZW5lcmF0aW9uIGZyb20gbmF0dXJhbCBsYW5ndWFnZSBkb2NzdHJpbmdzLiAgXG4qIERTLTEwMDA6IFRlc3RzIGNvZGUgZ2VuZXJhdGlvbiBmb3IgZGF0YSBzY2llbmNlIHRhc2tzIChlLmcuLCB1c2luZyBQYW5kYXMsIE51bVB5KS4gIFxuKiBDcnV4RXZhbDogVGVzdHMgdGhlIG1vZGVsJ3MgYWJpbGl0eSB0byBwcmVkaWN0IHRoZSBvdXRwdXQgb2YgYSBnaXZlbiBjb2RlIHNuaXBwZXQuIFRoZSBwcmltYXJ5IGdvYWwgaXMgdG8gYXNzZXNzIHRoZSBmdW5jdGlvbmFsIGNvcnJlY3RuZXNzIGFuZCBsb2dpY2FsIHJlYXNvbmluZyBjYXBhYmlsaXRpZXMgb2YgdGhlIG1vZGVsLlxuXG4jIyMgKipFdmFsdWF0aW9uIERhdGFzZXQ6KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiwgU3ludGhldGljXG5cbioqTGFiZWxpbmcgTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkXG5cbioqUHJvcGVydGllczoqKiBcblxuUXVhbnRpdHk6IFRoZSBiZW5jaG1hcmtzIGNvbnNpc3Qgb2YgYSB2YXJpZWQgbnVtYmVyIG9mIHByb2JsZW1zIChlLmcuLCBIdW1hbkV2YWw6IDE2NCBwcm9ibGVtczsgTUJQUDogXFx+NDAwIHRlc3QgcHJvYmxlbXM7IERTLTEwMDA6IDEsMDAwIHByb2JsZW1zKS5cblxuRGF0YXNldCBEZXNjcmlwdGlvbnM6IFRoaXMgaXMgYSBjb2xsZWN0aW9uIG9mIGV2YWx1YXRpb24gc3VpdGVzIGRlc2lnbmVkIHRvIG1lYXN1cmUgdGhlIG1vZGVsJ3MgcGVyZm9ybWFuY2Ugb24gc3BlY2lmaWMgZG93bnN0cmVhbSB0YXNrczpcblxuKiBIdW1hbkV2YWwvTUJQUDogVGVzdCBQeXRob24gY29kZSBnZW5lcmF0aW9uIGZyb20gbmF0dXJhbCBsYW5ndWFnZSBkb2NzdHJpbmdzLiAgXG4qIERTLTEwMDA6IFRlc3RzIGNvZGUgZ2VuZXJhdGlvbiBmb3IgZGF0YSBzY2llbmNlIHRhc2tzIChlLmcuLCB1c2luZyBQYW5kYXMsIE51bVB5KS4gIFxuKiBDcnV4RXZhbDogVGVzdHMgdGhlIG1vZGVsJ3MgYWJpbGl0eSB0byBwcmVkaWN0IHRoZSBvdXRwdXQgb2YgYSBnaXZlbiBjb2RlIHNuaXBwZXQuIFRoZSBwcmltYXJ5IGdvYWwgaXMgdG8gYXNzZXNzIHRoZSBmdW5jdGlvbmFsIGNvcnJlY3RuZXNzIGFuZCBsb2dpY2FsIHJlYXNvbmluZyBjYXBhYmlsaXRpZXMgb2YgdGhlIG1vZGVsLiBcblxuIyMgKipUZWNobmljYWwgTGltaXRhdGlvbnMqKiBcblxuVGhlIG1vZGVsIGhhcyBiZWVuIHRyYWluZWQgb24gc291cmNlIGNvZGUgZnJvbSAxNyBwcm9ncmFtbWluZyBsYW5ndWFnZXMuIFRoZSBwcmVkb21pbmFudCBsYW5ndWFnZSBpbiBzb3VyY2UgaXMgRW5nbGlzaCBhbHRob3VnaCBvdGhlciBsYW5ndWFnZXMgYXJlIGFsc28gcHJlc2VudC4gQXMgc3VjaCB0aGUgbW9kZWwgaXMgY2FwYWJsZSBvZiBnZW5lcmF0aW5nIGNvZGUgc25pcHBldHMgcHJvdmlkZWQgc29tZSBjb250ZXh0IGJ1dCB0aGUgZ2VuZXJhdGVkIGNvZGUgaXMgbm90IGd1YXJhbnRlZWQgdG8gd29yayBhcyBpbnRlbmRlZC4gSXQgY2FuIGJlIGluZWZmaWNpZW50IGFuZCBjb250YWluIGJ1Z3Mgb3IgZXhwbG9pdHMuIFNlZSBbdGhlIHBhcGVyXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL3BhcGVycy8yNDAyLjE5MTczKSBmb3IgYW4gaW4tZGVwdGggZGlzY3Vzc2lvbiBvZiB0aGUgbW9kZWwgbGltaXRhdGlvbnMuIFxuXG4jIyAqKkluZmVyZW5jZToqKlxuXG4qKkFjY2VsZXJhdGlvbiBFbmdpbmU6KiogdkxMTSwgVGVuc29yUlQgXG5cbioqVGVzdCBIYXJkd2FyZToqKiBcbiAgXG4gIEgxMDAgU1hNIDxicj4gXG4gIEgyMDAgU1hNIChCRjE2IFRQMikgPGJyPiBcbiAgXG5cbiMjICoqRXRoaWNhbCBDb25zaWRlcmF0aW9uczoqKlxuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgcHJvdmlkZWQgbW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cy4iLAogICAgImRpc3BsYXlOYW1lIjogIlN0YXJDb2RlcjIgN0IiLAogICAgImV4cGxhaW5hYmlsaXR5IjogIiIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtR0xHWi1VN0dBIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiaDIwMHgyLXRocm91Z2hwdXQtYmYxNi0yeXU3N2NyZ3pnIiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxNTQ3NzQ5Njk3MywKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9sbGFtYTItNzBiLmpwZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiTi9BIiwKICAgICJuYW1lIjogInN0YXJjb2RlcjItN2IiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiTi9BIiwKICAgICJwcml2YWN5IjogIiIsCiAgICAicHJvZHVjdE5hbWVzIjogWwogICAgICAgICJuaW0tZGV2IiwKICAgICAgICAibnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAicHVibGljRGF0YXNldFVzZWQiOiB7fSwKICAgICJwdWJsaXNoZXIiOiAiQmlnQ29kZSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAiIiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIlN0YXJDb2RlcjItN0IgbW9kZWwgaXMgYSA3QiBwYXJhbWV0ZXIgbW9kZWwgdHJhaW5lZCBvbiAxNyBwcm9ncmFtbWluZyBsYW5ndWFnZXMgZnJvbSBUaGUgU3RhY2sgdjIsIHdpdGggb3B0LW91dCByZXF1ZXN0cyBleGNsdWRlZC4gVGhlIG1vZGVsIHVzZXMgR3JvdXBlZCBRdWVyeSBBdHRlbnRpb24sIGEgY29udGV4dCB3aW5kb3cgb2YgMTYsMzg0IHRva2VucyB3aXRoIGEgc2xpZGluZyB3aW5kb3cgYXR0ZW50aW9uIG9mIDQsMDk2IHRva2Vucy4uLiIsCiAgICAidGVhbU5hbWUiOiAiYmlnY29kZSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMS0xN1QxODoxOToyMS4wNDdaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/bigcode/containers/starcoder2-7b optimizationProfiles: - profileId: nim/bigcode/starcoder2-7b:h100x1-throughput-bf16-wqtdmrjeda framework: TensorRT-LLM displayName: Starcoder2 7B H100x1 BF16 Throughput ngcMetadata: 0f40318708a05837c5517a80f06974ff2c353c11bc6e04eb10baabe4436a7522: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7ffe6beb932b6f649191382b440a2ae6a18a3a7c1a883a5c47cb0de89b812266 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:h100x2-throughput-bf16-pag8ayfq7a framework: TensorRT-LLM displayName: Starcoder2 7B H100x2 BF16 Throughput ngcMetadata: 4753e2649bd3f25d4742969ccea5bb7e6ac2e469ebe811d194565decbb7c91d7: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6de32383a825dc6ff1128099c218896c3fa72b897e3ea0cd559ef2133b20d6c2 number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 15GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:h100x2-latency-bf16-bcq-c0ggmw framework: TensorRT-LLM displayName: Starcoder2 7B H100x2 BF16 Latency ngcMetadata: 57280e7f84736bfd89a5fc38bc51f5ef6c0d92ed77ad66c60d897ccd7165ac98: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4f122733d53833b661fddc7ab39bb1b0c188779f2dd945241a7868b1e968dd1d number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 15GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:h200x1-throughput-bf16-yir1bzdhja framework: TensorRT-LLM displayName: Starcoder2 7B H200x1 BF16 Throughput ngcMetadata: 6f7097713b9a9c9e8553347ee7cf28f0c4c7c2bd913166dcb36c666ecc48dad1: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d1b221b1fd69a8f1b0dcd11b964dbf589518034edacf353953316bf9548f5de3 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:h200x2-latency-bf16-a8shrirgma framework: TensorRT-LLM displayName: Starcoder2 7B H200x2 BF16 Latency ngcMetadata: 70d88d7152538c95bc0dc059470e9f00656d8431c56ed11743d267c1dfccd433: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2758237c2bfa7e1f02183efb7432a82b677b8a29331fe65b97d8e09c2075b51e number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 15GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:h200x2-throughput-bf16-lspznbyceg framework: TensorRT-LLM displayName: Starcoder2 7B H200x2 BF16 Throughput ngcMetadata: e496963dfd535acf3104a4040e5d0b4a73ab564f0f1c583d3ad153a28200f266: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3e06b5f5b48d0b152e1a73bea3a346274e602f8d4ed0d3151ea215c3f9cbf8fc number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 15GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/bigcode/starcoder2-7b:hf-bb9afde framework: TensorRT-LLM displayName: Starcoder2 7B Generic NVIDIA GPUx1 ngcMetadata: 1d76bac39d2ca5f44c35735c615e4758bee6f6964c6db099577cb9000ecb6447: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' llm_engine: tensorrt_llm nim_workspace_hash_v1: 43ab4fbb30e1beedda3de8df4244c9fc44fb8fbd8ba0ac23b028abf822bbf637 pp: '1' tp: '1' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: COUNT value: 1 - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/bigcode/starcoder2-7b:hf-bb9afde framework: TensorRT-LLM displayName: Starcoder2 7B Generic NVIDIA GPUx2 ngcMetadata: ef596a550ec0d61b427e3f7ff26fd21d49b5b1caff72b5bc8f3a5affc2a1d7b9: model: bigcode/starcoder2-7b release: 1.14.1 tags: feat_lora: 'false' llm_engine: tensorrt_llm nim_workspace_hash_v1: 43ab4fbb30e1beedda3de8df4244c9fc44fb8fbd8ba0ac23b028abf822bbf637 pp: '1' tp: '2' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: COUNT value: 2 - key: NIM VERSION value: 1.14.1 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' labels: - bigCode - StarCoder - "Code Generation" - "Text Generation" - "Multilingual support" - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Mistral Instruct displayName: Mistral Instruct modelHubID: mistral-instruct category: Language type: NGC description: Efficient instruction-tuned model for broad text generation and instruction following. Compact size makes it easy to fine-tune for specialized use cases. modelVariants: - variantId: Mistral 7B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNC0wNi0xOFQyMzoyNToxMi41MjVaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjICoqTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zIE92ZXJ2aWV3KipcblxuIyMgKipEZXNjcmlwdGlvbjoqKlxuXG4qKk1pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuMyoqIGlzIGEgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgKExMTSkgdGhhdCBoYXMgYmVlbiBmaW5lLXR1bmVkIGZvciBpbnN0cnVjdGlvbi1iYXNlZCB0YXNrcy4gSXQgaXMgYW4gaW1wcm92ZWQgdmVyc2lvbiBvZiB0aGUgTWlzdHJhbC03Qi12MC4zIG1vZGVsIGFuZCBpcyBkZXNpZ25lZCB0byBiZSBlYXNpbHkgZmluZS10dW5lZCB0byBhY2hpZXZlIGNvbXBlbGxpbmcgcGVyZm9ybWFuY2UuIFxuXG5UaGlzIG1vZGVsIGlzIHJlYWR5IGZvciBjb21tZXJjaWFsL25vbi1jb21tZXJjaWFsIHVzZS5cblxuVGhpcyB2ZXJzaW9uIGludHJvZHVjZXMgc3VwcG9ydCBmb3IgR0IyMDAgTlZMNzIsIEdIMjAwIE5WTDIsIEIyMDAgYW5kIE5WRlA0LiBDVURBIHVwZGF0ZWQgdG8gdmVyc2lvbiAxMi45LiBGb3IgZGV0YWlsZWQgaW5mb3JtYXRpb24sIHJlZmVyIHRvIFJlbGVhc2UgW05vdGVzIGZvciBOVklESUEgTklNIGZvciBMTE1zIExMTSAxLjEyXShodHRwczovL2RvY3MubnZpZGlhLmNvbS9uaW0vbGFyZ2UtbGFuZ3VhZ2UtbW9kZWxzL2xhdGVzdC9yZWxlYXNlLW5vdGVzLmh0bWwpLiBcblxuIyMgKipUaGlyZC1QYXJ0eSBDb21tdW5pdHkgQ29uc2lkZXJhdGlvbioqXG5cblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5J3MgcmVxdWlyZW1lbnRzIGZvciB0aGlzIGFwcGxpY2F0aW9uIGFuZCB1c2UgY2FzZTsgc2VlIGxpbmsgdG8gTm9uLU5WSURJQSBcXFttaXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zXFxdICBcbihbaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9taXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21pc3RyYWxhaS9NaXN0cmFsLTdCLUluc3RydWN0LXYwLjMpKS4gXG5cbiMjICoqTGljZW5zZS9UZXJtcyBvZiBVc2U6KipcblxuKipHT1ZFUk5JTkcgVEVSTVM6KiogVGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCB0aGUgW1Byb2R1Y3QtU3BlY2lmaWMgVGVybXMgZm9yIE5WSURJQSBBSSBQcm9kdWN0c10oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvcHJvZHVjdC1zcGVjaWZpYy10ZXJtcy1mb3ItYWktcHJvZHVjdHMvKTsgYW5kIHRoZSB1c2Ugb2YgdGhlIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWFpLWZvdW5kYXRpb24tbW9kZWxzLWNvbW11bml0eS1saWNlbnNlLWFncmVlbWVudC8pLlxuXG4qKkFERElUSU9OQUwgSU5GT1JNQVRJT046KiogQXBhY2hlIDIuMCBMaWNlbnNlLlxuXG5Zb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBwcm92aWRlZCBtb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLlxuXG4jIyAqKkRlcGxveW1lbnQgR2VvZ3JhcGh5OioqXG5cbkdsb2JhbCBcblxuIyMgKipVc2UgQ2FzZToqKlxuXG5UaGlzIG1vZGVsIGlzIHByaW1hcmlseSBpbnRlbmRlZCBmb3IgQUkgZGV2ZWxvcGVycywgcmVzZWFyY2hlcnMsIGFuZCBidXNpbmVzc2VzIHNlZWtpbmcgYSBwb3dlcmZ1bCB5ZXQgZWZmaWNpZW50IGZvdW5kYXRpb25hbCBsYW5ndWFnZSBtb2RlbC5cblxuIyMjIEV4cGVjdGVkIHVzZXMgaW5jbHVkZTpcblxuKiBGaW5lLXR1bmluZyBmb3IgQ3VzdG9tIEFwcGxpY2F0aW9uczogRGV2ZWxvcGVycyBjYW4gdXNlIE1pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuMyBhcyBhIGJhc2UgdG8gdHJhaW4gc3BlY2lhbGl6ZWQgbW9kZWxzIGZvciB0YXNrcyBsaWtlIGNyZWF0aW5nIGN1c3RvbWVyIHNlcnZpY2UgY2hhdGJvdHMsIGNvbnRlbnQgc3VtbWFyaXphdGlvbiB0b29scywgY29kZSBnZW5lcmF0aW9uIGFzc2lzdGFudHMsIGFuZCBzZW50aW1lbnQgYW5hbHlzaXMgc3lzdGVtcy5cblxuKiBSZXNlYXJjaCBhbmQgRXhwZXJpbWVudGF0aW9uOiBSZXNlYXJjaGVycyBjYW4gbGV2ZXJhZ2UgdGhpcyBvcGVuLXNvdXJjZSBtb2RlbCB0byBzdHVkeSBsYW5ndWFnZSBtb2RlbCBiZWhhdmlvciwgZXhwbG9yZSBuZXcgdHJhaW5pbmcgdGVjaG5pcXVlcywgb3IgZXN0YWJsaXNoIHBlcmZvcm1hbmNlIGJlbmNobWFya3Mgb24gdmFyaW91cyBuYXR1cmFsIGxhbmd1YWdlIHByb2Nlc3NpbmcgdGFza3MuXG5cbiogUHJvdG90eXBpbmcgQUkgU29sdXRpb25zOiBUaGlzIG1vZGVsJ3MgZXhjZWxsZW50IGJhbGFuY2Ugb2YgaGlnaCBwZXJmb3JtYW5jZSBhbmQgcmVsYXRpdmVseSBsb3cgY29tcHV0YXRpb25hbCBjb3N0IG1ha2VzIGl0IGlkZWFsIGZvciBzdGFydHVwcyBhbmQgaW5kaXZpZHVhbCBkZXZlbG9wZXJzIHRvIHJhcGlkbHkgYnVpbGQgYW5kIHRlc3QgcHJvb2Ytb2YtY29uY2VwdCBBSSBmZWF0dXJlcyBiZWZvcmUgZGVwbG95aW5nIGxhcmdlci1zY2FsZSBzb2x1dGlvbnMuXG5cbiMjICoqUmVsZWFzZSBEYXRlOioqXG5cbkh1Z2dpbmdmYWNlIDA1LzIyLzIwMjQgdmlhICAgXG5baHR0cHM6Ly9odWdnaW5nZmFjZS5jby9taXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21pc3RyYWxhaS9NaXN0cmFsLTdCLUluc3RydWN0LXYwLjMpIFxuXG4jIyAqKlJlZmVyZW5jZShzKToqKiBcblxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWlzdHJhbGFpL01pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuM10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9taXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zKSBcblxuIyMgKipNb2RlbCBBcmNoaXRlY3R1cmU6KiogXG5cbkFyY2hpdGVjdHVyZSBUeXBlOiBUcmFuc2Zvcm1lciAgXG5OZXR3b3JrIEFyY2hpdGVjdHVyZTogTWlzdHJhbC03Qi12MC4zXG5cblRoaXMgbW9kZWwgd2FzIGRldmVsb3BlZCBiYXNlZCBvbiBNaXN0cmFsLTdCLXYwLjMgIFxuW2h0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vbWlzdHJhbGFpL01pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuM10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9taXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zKSAgXG5cbk51bWJlciBvZiBtb2RlbCBwYXJhbWV0ZXJzOiA3LjI1KjEwXjlcblxuIyMgKipJbnB1dDoqKlxuXG5JbnB1dCBUeXBlKHMpOiBUZXh0IFxuXG5JbnB1dCBGb3JtYXQ6IFN0cmluZyBcblxuSW5wdXQgUGFyYW1ldGVyczogT25lLURpbWVuc2lvbmFsICgxRClcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OlxuXG4qIFRva2VuczogVGhlIG1vZGVsIHByb2Nlc3NlcyB0ZXh0IGFzIGEgc2VxdWVuY2Ugb2YgdG9rZW5zLiBUaGUgaW5wdXQgc3RyaW5nIGlzIGNvbnZlcnRlZCBpbnRvIGEgc2VxdWVuY2Ugb2YgaW50ZWdlciB0b2tlbiBJRHMgYnkgYSB0b2tlbml6ZXIuIFRoZSB2b2NhYnVsYXJ5IHNpemUgaXMgMzIsNzY4IHRva2Vucy4gIFxuICAgIFxuKiBTaXplIGFuZCBMZW5ndGggTGltaXRzOiBUaGUgbWF4aW11bSBpbnB1dCBzZXF1ZW5jZSBsZW5ndGggc3VwcG9ydGVkIGJ5IHRoZSBtb2RlbCBpcyAzMiw3NjggdG9rZW5zLiAgXG4gICAgXG4qIFByZS1Qcm9jZXNzaW5nIE5lZWRlZDogWWVzLiBSYXcgaW5wdXQgdGV4dCBtdXN0IGJlIHRva2VuaXplZC4gRm9yIGNoYXQgb3IgaW5zdHJ1Y3Rpb24tZm9sbG93aW5nIHRhc2tzLCB0aGUgaW5wdXQgbXVzdCBiZSBmb3JtYXR0ZWQgYWNjb3JkaW5nIHRvIHRoZSBtb2RlbCdzIHNwZWNpZmljIGNoYXQgdGVtcGxhdGUsIHdoaWNoIHR5cGljYWxseSBpbnZvbHZlcyB3cmFwcGluZyB1c2VyIHByb21wdHMgaW4gXFxbSU5TVFxcXSBhbmQgXFxbL0lOU1RcXF0gdGFncy5cblxuIFxuXG4jIyAqKk91dHB1dDoqKlxuXG5PdXRwdXQgVHlwZShzKTogVGV4dCBcblxuT3V0cHV0IEZvcm1hdDogU3RyaW5nXG5cbk91dHB1dCBQYXJhbWV0ZXJzOiBPbmUtRGltZW5zaW9uYWwgKDFEKVxuXG5PdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0OiBcblxuKiBUb2tlbnM6IFRoZSBtb2RlbCBnZW5lcmF0ZXMgYSBzZXF1ZW5jZSBvZiB0b2tlbiBJRHMgZnJvbSBpdHMgdm9jYWJ1bGFyeSBvZiAzMiw3NjggdG9rZW5zLiAgXG4gICAgXG4qIFBvc3QtUHJvY2Vzc2luZyBOZWVkZWQ6IFllcy4gVGhlIGdlbmVyYXRlZCBzZXF1ZW5jZSBvZiB0b2tlbiBJRHMgbXVzdCBiZSBkZWNvZGVkIGJ5IHRoZSB0b2tlbml6ZXIgdG8gYmUgY29udmVydGVkIGludG8gYSBodW1hbi1yZWFkYWJsZSBzdHJpbmcuICBcbiogTGVuZ3RoOiBUaGUgb3V0cHV0IGxlbmd0aCBpcyB2YXJpYWJsZSBhbmQgaXMgY29udHJvbGxlZCBieSBnZW5lcmF0aW9uIHBhcmFtZXRlcnMuIEdlbmVyYXRpb24gc3RvcHMgd2hlbiBhbiBlbmQtb2Ytc2VxdWVuY2UgKEVPUykgdG9rZW4gaXMgcHJvZHVjZWQgb3IgdGhlIG1heGltdW0gbGVuZ3RoIGlzIHJlYWNoZWQuXG5cbk91ciBBSSBtb2RlbHMgYXJlIGRlc2lnbmVkIGFuZC9vciBvcHRpbWl6ZWQgdG8gcnVuIG9uIE5WSURJQSBHUFUtYWNjZWxlcmF0ZWQgc3lzdGVtcy4gQnkgbGV2ZXJhZ2luZyBOVklESUEncyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuXG5cbiMjICoqU29mdHdhcmUgSW50ZWdyYXRpb246KipcblxuUnVudGltZSBFbmdpbmU6IHZMTE0sIFRlbnNvclJUXG5cblN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OlxuXG5OVklESUEgQW1wZXJlICBcbk5WSURJQSBCbGFja3dlbGwgIFxuTlZJRElBIEhvcHBlciAgXG5OVklESUEgTG92ZWxhY2UgXG5cblByZWZlcnJlZCBPcGVyYXRpbmcgU3lzdGVtKHMpOlxuXG5MaW51eCAgIFxuV2luZG93c1xuXG5UaGUgaW50ZWdyYXRpb24gb2YgZm91bmRhdGlvbiBhbmQgZmluZS10dW5lZCBtb2RlbHMgaW50byBBSSBzeXN0ZW1zIHJlcXVpcmVzIGFkZGl0aW9uYWwgdGVzdGluZyB1c2luZyB1c2UtY2FzZS1zcGVjaWZpYyBkYXRhIHRvIGVuc3VyZSBzYWZlIGFuZCBlZmZlY3RpdmUgZGVwbG95bWVudC4gRm9sbG93aW5nIHRoZSBWLW1vZGVsIG1ldGhvZG9sb2d5LCBpdGVyYXRpdmUgdGVzdGluZyBhbmQgdmFsaWRhdGlvbiBhdCBib3RoIHVuaXQgYW5kIHN5c3RlbSBsZXZlbHMgYXJlIGVzc2VudGlhbCB0byBtaXRpZ2F0ZSByaXNrcywgbWVldCB0ZWNobmljYWwgYW5kIGZ1bmN0aW9uYWwgcmVxdWlyZW1lbnRzLCBhbmQgZW5zdXJlIGNvbXBsaWFuY2Ugd2l0aCBzYWZldHkgYW5kIGV0aGljYWwgc3RhbmRhcmRzIGJlZm9yZSBkZXBsb3ltZW50LlxuXG4jIyAqKk1vZGVsIFZlcnNpb24ocyk6KipcblxuTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zXG5cbiMjICoqVXNhZ2UqKlxuXG4qKkluc3RydWN0IGZvbGxvd2luZyoqXG5cbmBgYFxuZnJvbSBtaXN0cmFsX2luZmVyZW5jZS50cmFuc2Zvcm1lciBpbXBvcnQgVHJhbnNmb3JtZXJcbmZyb20gbWlzdHJhbF9pbmZlcmVuY2UuZ2VuZXJhdGUgaW1wb3J0IGdlbmVyYXRlXG5cbmZyb20gbWlzdHJhbF9jb21tb24udG9rZW5zLnRva2VuaXplcnMubWlzdHJhbCBpbXBvcnQgTWlzdHJhbFRva2VuaXplclxuZnJvbSBtaXN0cmFsX2NvbW1vbi5wcm90b2NvbC5pbnN0cnVjdC5tZXNzYWdlcyBpbXBvcnQgVXNlck1lc3NhZ2VcbmZyb20gbWlzdHJhbF9jb21tb24ucHJvdG9jb2wuaW5zdHJ1Y3QucmVxdWVzdCBpbXBvcnQgQ2hhdENvbXBsZXRpb25SZXF1ZXN0XG5cblxudG9rZW5pemVyID0gTWlzdHJhbFRva2VuaXplci5mcm9tX2ZpbGUoZlwie21pc3RyYWxfbW9kZWxzX3BhdGh9L3Rva2VuaXplci5tb2RlbC52M1wiKVxubW9kZWwgPSBUcmFuc2Zvcm1lci5mcm9tX2ZvbGRlcihtaXN0cmFsX21vZGVsc19wYXRoKVxuXG5jb21wbGV0aW9uX3JlcXVlc3QgPSBDaGF0Q29tcGxldGlvblJlcXVlc3QobWVzc2FnZXM9W1VzZXJNZXNzYWdlKGNvbnRlbnQ9XCJFeHBsYWluIE1hY2hpbmUgTGVhcm5pbmcgdG8gbWUgaW4gYSBudXRzaGVsbC5cIildKVxuXG50b2tlbnMgPSB0b2tlbml6ZXIuZW5jb2RlX2NoYXRfY29tcGxldGlvbihjb21wbGV0aW9uX3JlcXVlc3QpLnRva2Vuc1xuXG5vdXRfdG9rZW5zLCBfID0gZ2VuZXJhdGUoW3Rva2Vuc10sIG1vZGVsLCBtYXhfdG9rZW5zPTY0LCB0ZW1wZXJhdHVyZT0wLjAsIGVvc19pZD10b2tlbml6ZXIuaW5zdHJ1Y3RfdG9rZW5pemVyLnRva2VuaXplci5lb3NfaWQpXG5yZXN1bHQgPSB0b2tlbml6ZXIuaW5zdHJ1Y3RfdG9rZW5pemVyLnRva2VuaXplci5kZWNvZGUob3V0X3Rva2Vuc1swXSlcblxucHJpbnQocmVzdWx0KVxuYGBgXG5cbioqRnVuY3Rpb24gY2FsbGluZyoqXG5cbmBgYFxuZnJvbSBtaXN0cmFsX2NvbW1vbi5wcm90b2NvbC5pbnN0cnVjdC50b29sX2NhbGxzIGltcG9ydCBGdW5jdGlvbiwgVG9vbFxuZnJvbSBtaXN0cmFsX2luZmVyZW5jZS50cmFuc2Zvcm1lciBpbXBvcnQgVHJhbnNmb3JtZXJcbmZyb20gbWlzdHJhbF9pbmZlcmVuY2UuZ2VuZXJhdGUgaW1wb3J0IGdlbmVyYXRlXG5cbmZyb20gbWlzdHJhbF9jb21tb24udG9rZW5zLnRva2VuaXplcnMubWlzdHJhbCBpbXBvcnQgTWlzdHJhbFRva2VuaXplclxuZnJvbSBtaXN0cmFsX2NvbW1vbi5wcm90b2NvbC5pbnN0cnVjdC5tZXNzYWdlcyBpbXBvcnQgVXNlck1lc3NhZ2VcbmZyb20gbWlzdHJhbF9jb21tb24ucHJvdG9jb2wuaW5zdHJ1Y3QucmVxdWVzdCBpbXBvcnQgQ2hhdENvbXBsZXRpb25SZXF1ZXN0XG5cblxudG9rZW5pemVyID0gTWlzdHJhbFRva2VuaXplci5mcm9tX2ZpbGUoZlwie21pc3RyYWxfbW9kZWxzX3BhdGh9L3Rva2VuaXplci5tb2RlbC52M1wiKVxubW9kZWwgPSBUcmFuc2Zvcm1lci5mcm9tX2ZvbGRlcihtaXN0cmFsX21vZGVsc19wYXRoKVxuXG5jb21wbGV0aW9uX3JlcXVlc3QgPSBDaGF0Q29tcGxldGlvblJlcXVlc3QoXG4gICAgdG9vbHM9W1xuICAgICAgICBUb29sKFxuICAgICAgICAgICAgZnVuY3Rpb249RnVuY3Rpb24oXG4gICAgICAgICAgICAgICAgbmFtZT1cImdldF9jdXJyZW50X3dlYXRoZXJcIixcbiAgICAgICAgICAgICAgICBkZXNjcmlwdGlvbj1cIkdldCB0aGUgY3VycmVudCB3ZWF0aGVyXCIsXG4gICAgICAgICAgICAgICAgcGFyYW1ldGVycz17XG4gICAgICAgICAgICAgICAgICAgIFwidHlwZVwiOiBcIm9iamVjdFwiLFxuICAgICAgICAgICAgICAgICAgICBcInByb3BlcnRpZXNcIjoge1xuICAgICAgICAgICAgICAgICAgICAgICAgXCJsb2NhdGlvblwiOiB7XG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJ0eXBlXCI6IFwic3RyaW5nXCIsXG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJkZXNjcmlwdGlvblwiOiBcIlRoZSBjaXR5IGFuZCBzdGF0ZSwgZS5nLiBTYW4gRnJhbmNpc2NvLCBDQVwiLFxuICAgICAgICAgICAgICAgICAgICAgICAgfSxcbiAgICAgICAgICAgICAgICAgICAgICAgIFwiZm9ybWF0XCI6IHtcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcInR5cGVcIjogXCJzdHJpbmdcIixcbiAgICAgICAgICAgICAgICAgICAgICAgICAgICBcImVudW1cIjogW1wiY2Vsc2l1c1wiLCBcImZhaHJlbmhlaXRcIl0sXG4gICAgICAgICAgICAgICAgICAgICAgICAgICAgXCJkZXNjcmlwdGlvblwiOiBcIlRoZSB0ZW1wZXJhdHVyZSB1bml0IHRvIHVzZS4gSW5mZXIgdGhpcyBmcm9tIHRoZSB1c2VycyBsb2NhdGlvbi5cIixcbiAgICAgICAgICAgICAgICAgICAgICAgIH0sXG4gICAgICAgICAgICAgICAgICAgIH0sXG4gICAgICAgICAgICAgICAgICAgIFwicmVxdWlyZWRcIjogW1wibG9jYXRpb25cIiwgXCJmb3JtYXRcIl0sXG4gICAgICAgICAgICAgICAgfSxcbiAgICAgICAgICAgIClcbiAgICAgICAgKVxuICAgIF0sXG4gICAgbWVzc2FnZXM9W1xuICAgICAgICBVc2VyTWVzc2FnZShjb250ZW50PVwiV2hhdCdzIHRoZSB3ZWF0aGVyIGxpa2UgdG9kYXkgaW4gUGFyaXM/XCIpLFxuICAgICAgICBdLFxuKVxuXG50b2tlbnMgPSB0b2tlbml6ZXIuZW5jb2RlX2NoYXRfY29tcGxldGlvbihjb21wbGV0aW9uX3JlcXVlc3QpLnRva2Vuc1xuXG5vdXRfdG9rZW5zLCBfID0gZ2VuZXJhdGUoW3Rva2Vuc10sIG1vZGVsLCBtYXhfdG9rZW5zPTY0LCB0ZW1wZXJhdHVyZT0wLjAsIGVvc19pZD10b2tlbml6ZXIuaW5zdHJ1Y3RfdG9rZW5pemVyLnRva2VuaXplci5lb3NfaWQpXG5yZXN1bHQgPSB0b2tlbml6ZXIuaW5zdHJ1Y3RfdG9rZW5pemVyLnRva2VuaXplci5kZWNvZGUob3V0X3Rva2Vuc1swXSlcblxucHJpbnQocmVzdWx0KVxuYGBgXG5cbioqR2VuZXJhdGUgd2l0aCB0cmFuc2Zvcm1lcnMqKlxuXG5gYGBcbmZyb20gdHJhbnNmb3JtZXJzIGltcG9ydCBwaXBlbGluZVxuXG5tZXNzYWdlcyA9IFtcbiAgICB7XCJyb2xlXCI6IFwic3lzdGVtXCIsIFwiY29udGVudFwiOiBcIllvdSBhcmUgYSBwaXJhdGUgY2hhdGJvdCB3aG8gYWx3YXlzIHJlc3BvbmRzIGluIHBpcmF0ZSBzcGVhayFcIn0sXG4gICAge1wicm9sZVwiOiBcInVzZXJcIiwgXCJjb250ZW50XCI6IFwiV2hvIGFyZSB5b3U/XCJ9LFxuXVxuY2hhdGJvdCA9IHBpcGVsaW5lKFwidGV4dC1nZW5lcmF0aW9uXCIsIG1vZGVsPVwibWlzdHJhbGFpL01pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuM1wiKVxuY2hhdGJvdChtZXNzYWdlcylcbmBgYFxuXG4qKkZ1bmN0aW9uIGNhbGxpbmcgd2l0aCB0cmFuc2Zvcm1lcnMqKlxuXG5UbyB1c2UgdGhpcyBleGFtcGxlLCB5b3UnbGwgbmVlZCB0cmFuc2Zvcm1lcnMgdmVyc2lvbiA0LjQyLjAgb3IgaGlnaGVyLiBQbGVhc2Ugc2VlIHRoZSBbZnVuY3Rpb24gY2FsbGluZyBndWlkZV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kb2NzL3RyYW5zZm9ybWVycy9tYWluL2NoYXRfdGVtcGxhdGluZyNhZHZhbmNlZC10b29sLXVzZS0tZnVuY3Rpb24tY2FsbGluZykgaW4gdGhlIHRyYW5zZm9ybWVycyBkb2NzIGZvciBtb3JlIGluZm9ybWF0aW9uLlxuXG5gYGBcbmZyb20gdHJhbnNmb3JtZXJzIGltcG9ydCBBdXRvTW9kZWxGb3JDYXVzYWxMTSwgQXV0b1Rva2VuaXplclxuaW1wb3J0IHRvcmNoXG5cbm1vZGVsX2lkID0gXCJtaXN0cmFsYWkvTWlzdHJhbC03Qi1JbnN0cnVjdC12MC4zXCJcbnRva2VuaXplciA9IEF1dG9Ub2tlbml6ZXIuZnJvbV9wcmV0cmFpbmVkKG1vZGVsX2lkKVxuXG5kZWYgZ2V0X2N1cnJlbnRfd2VhdGhlcihsb2NhdGlvbjogc3RyLCBmb3JtYXQ6IHN0cik6XG4gICAgXCJcIlwiXG4gICAgR2V0IHRoZSBjdXJyZW50IHdlYXRoZXJcblxuICAgIEFyZ3M6XG4gICAgICAgIGxvY2F0aW9uOiBUaGUgY2l0eSBhbmQgc3RhdGUsIGUuZy4gU2FuIEZyYW5jaXNjbywgQ0FcbiAgICAgICAgZm9ybWF0OiBUaGUgdGVtcGVyYXR1cmUgdW5pdCB0byB1c2UuIEluZmVyIHRoaXMgZnJvbSB0aGUgdXNlcnMgbG9jYXRpb24uIChjaG9pY2VzOiBbXCJjZWxzaXVzXCIsIFwiZmFocmVuaGVpdFwiXSlcbiAgICBcIlwiXCJcbiAgICBwYXNzXG5cbmNvbnZlcnNhdGlvbiA9IFt7XCJyb2xlXCI6IFwidXNlclwiLCBcImNvbnRlbnRcIjogXCJXaGF0J3MgdGhlIHdlYXRoZXIgbGlrZSBpbiBQYXJpcz9cIn1dXG50b29scyA9IFtnZXRfY3VycmVudF93ZWF0aGVyXVxuXG5cbiMgZm9ybWF0IGFuZCB0b2tlbml6ZSB0aGUgdG9vbCB1c2UgcHJvbXB0IFxuaW5wdXRzID0gdG9rZW5pemVyLmFwcGx5X2NoYXRfdGVtcGxhdGUoXG4gICAgICAgICAgICBjb252ZXJzYXRpb24sXG4gICAgICAgICAgICB0b29scz10b29scyxcbiAgICAgICAgICAgIGFkZF9nZW5lcmF0aW9uX3Byb21wdD1UcnVlLFxuICAgICAgICAgICAgcmV0dXJuX2RpY3Q9VHJ1ZSxcbiAgICAgICAgICAgIHJldHVybl90ZW5zb3JzPVwicHRcIixcbilcblxubW9kZWwgPSBBdXRvTW9kZWxGb3JDYXVzYWxMTS5mcm9tX3ByZXRyYWluZWQobW9kZWxfaWQsIHRvcmNoX2R0eXBlPXRvcmNoLmJmbG9hdDE2LCBkZXZpY2VfbWFwPVwiYXV0b1wiKVxuXG5pbnB1dHMudG8obW9kZWwuZGV2aWNlKVxub3V0cHV0cyA9IG1vZGVsLmdlbmVyYXRlKCoqaW5wdXRzLCBtYXhfbmV3X3Rva2Vucz0xMDAwKVxucHJpbnQodG9rZW5pemVyLmRlY29kZShvdXRwdXRzWzBdLCBza2lwX3NwZWNpYWxfdG9rZW5zPVRydWUpKVxuYGBgXG5cbiMjICoqVHJhaW5pbmcsIFRlc3RpbmcsIGFuZCBFdmFsdWF0aW9uIERhdGFzZXRzOioqXG5cbiMjIyAqKlRyYWluaW5nIERhdGFzZXQ6KipcblxuKipEYXRhIE1vZGFsaXR5OioqIFRleHQgXG5cbioqTGluazoqKiBVbmRpc2Nsb3NlZFxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogQXV0b21hdGVkLCBTeW50aGV0aWMsIEh1bWFuXG5cbioqUHJvcGVydGllczoqKiBUaGUgcHJlLXRyYWluaW5nIGRhdGEgaXMgYSBkaXZlcnNlIG1peCBvZiB0ZXh0IGFuZCBjb2RlIGZyb20gdGhlIHB1YmxpYyB3ZWIuIFRoZSBmaW5lLXR1bmluZyBkYXRhIGNvbnNpc3RzIG9mIGhpZ2gtcXVhbGl0eSBpbnN0cnVjdGlvbi1yZXNwb25zZSBwYWlycy5cblxuIyMjICoqVGVzdGluZyBEYXRhc2V0OioqXG5cbioqTGluazoqKiBVbmRpc2Nsb3NlZFxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBTeW50aGV0aWMsIEF1dG9tYXRlZFxuXG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZFxuXG4qKlByb3BlcnRpZXM6KiogXG5cbiogUXVhbnRpdHk6IFRoZSBudW1iZXIgb2YgZGF0YSBpdGVtcyB2YXJpZXMgc2lnbmlmaWNhbnRseSBwZXIgYmVuY2htYXJrIChlLmcuLCBNTUxVIGhhcyBcXH4xNS45ayBxdWVzdGlvbnMsIEhlbGxhU3dhZyBoYXMgXFx+MTBrIHNlbnRlbmNlcykuICBcbiogRGF0YXNldCBEZXNjcmlwdGlvbnM6IFRoZSBtb2RlbCBpcyB0ZXN0ZWQgYWdhaW5zdCBiZW5jaG1hcmtzIGRlc2lnbmVkIHRvIGV2YWx1YXRlIGEgd2lkZSByYW5nZSBvZiBjYXBhYmlsaXRpZXMsIGluY2x1ZGluZzogZ2VuZXJhbCBrbm93bGVkZ2UgYW5kIHJlYXNvbmluZyAoTU1MVSwgQVJDKSwgY29tbW9uc2Vuc2UgaW5mZXJlbmNlIChIZWxsYVN3YWcsIFdpbm9ncmFuZGUpLCB0cnV0aGZ1bG5lc3MgKFRydXRoZnVsUUEpLCBjb252ZXJzYXRpb25hbCBhYmlsaXR5IChNVC1CZW5jaCksIGFuZCBjb2RlIGdlbmVyYXRpb24gKEh1bWFuRXZhbCwgTUJQUCkuIFxuXG4jIyMgKipFdmFsdWF0aW9uIERhdGFzZXQ6KipcblxuKipMaW5rOioqIFVuZGlzY2xvc2VkXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIFN5bnRoZXRpYywgQXV0b21hdGVkXG5cbioqTGFiZWxpbmcgTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkXG5cbioqUHJvcGVydGllczoqKiBUaGUgbW9kZWwgaXMgZXZhbHVhdGVkIGFnYWluc3QgYmVuY2htYXJrcyBkZXNpZ25lZCB0byBtZWFzdXJlIGEgd2lkZSByYW5nZSBvZiBjYXBhYmlsaXRpZXMsIGluY2x1ZGluZzogZ2VuZXJhbCBrbm93bGVkZ2UgYW5kIHJlYXNvbmluZyAoTU1MVSksIHRydXRoZnVsbmVzcyAoVHJ1dGhmdWxRQSksIGNvbnZlcnNhdGlvbmFsIGFiaWxpdHkgKE1ULUJlbmNoKSwgYW5kIGNvZGUgZ2VuZXJhdGlvbiAoSHVtYW5FdmFsKS4gVGhlIHF1YW50aXR5IG9mIGRhdGEgdmFyaWVzIHNpZ25pZmljYW50bHkgcGVyIGJlbmNobWFyay5cblxuIyMgKipUZWNobmljYWwgTGltaXRhdGlvbnMqKiBcblxuVGhlIE1pc3RyYWwtN0ItSW5zdHJ1Y3QgbW9kZWwgaXMgYSBxdWljayBkZW1vbnN0cmF0aW9uIHRoYXQgdGhlIGJhc2UgbW9kZWwgY2FuIGJlIGVhc2lseSBmaW5lLXR1bmVkIHRvIGFjaGlldmUgY29tcGVsbGluZyBwZXJmb3JtYW5jZS4gSXQgZG9lcyBub3QgaGF2ZSBhbnkgbW9kZXJhdGlvbiBtZWNoYW5pc21zLiBXZSdyZSBsb29raW5nIGZvcndhcmQgdG8gZW5nYWdpbmcgd2l0aCB0aGUgY29tbXVuaXR5IG9uIHdheXMgdG8gbGV2ZXJhZ2UgZ3VhcmRyYWlscywgYWxsb3dpbmcgZm9yIGRlcGxveW1lbnQgaW4gZW52aXJvbm1lbnRzIHJlcXVpcmluZyBtb2RlcmF0ZWQgb3V0cHV0cy4gXG5cbiMjICoqSW5mZXJlbmNlOioqXG5cbioqQWNjZWxlcmF0aW9uIEVuZ2luZToqKiB2TExNLCBUZW5zb3JSVCBcblxuKipUZXN0IEhhcmR3YXJlOioqIFxuIFxuKiBCMjAwIFNYTSAgIFxuKiBIMjAwIFNYTSAgXG4qIEgxMDAgU1hNICBcbiogQTEwMCBTWE0gODBHQiAgXG4qIEExMDAgU1hNIDQwR0IgIFxuKiBMNDBTIFBDSWUgIFxuKiBBMTBHICBcbiogSDEwMCBOVkwgIFxuKiBIMjAwIE5WTCAgXG4qIEdIMjAwIDk2R0JcbiogR0IyMDAgTlZMNzJcbiogR0gyMDAgTlZMMiAgIFxuKiBSVFggNTA5MCAgXG4qIFJUWCA0MDkwICBcbiogUlRYIDYwMDAgQWRhXG5cbiMjICoqRGVwbG95bWVudCBEZXRhaWxzOioqXG5cblZpc2l0IHRoZSBbTklNIENvbnRhaW5lciBMTE1dKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25pbS9sYXJnZS1sYW5ndWFnZS1tb2RlbHMvbGF0ZXN0L2ludHJvZHVjdGlvbi5odG1sKSBwYWdlIGZvciByZWxlYXNlIGRvY3VtZW50YXRpb24sIGRlcGxveW1lbnQgZ3VpZGVzLCBhbmQgbW9yZS5cblxuIyMgR2V0IEhlbHBcblxuIyMgKipFbnRlcnByaXNlIFN1cHBvcnQqKlxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciBbc3VibWl0IGEgdGlja2V0XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2RhdGEtY2VudGVyL3Byb2R1Y3RzL2FpLWVudGVycHJpc2Utc3VpdGUvc3VwcG9ydC8pLlxuXG5PdXIgQUkgbW9kZWxzIGFyZSBkZXNpZ25lZCBhbmQvb3Igb3B0aW1pemVkIHRvIHJ1biBvbiBOVklESUEgR1BVLWFjY2VsZXJhdGVkIHN5c3RlbXMuIEJ5IGxldmVyYWdpbmcgTlZJRElBXHUyMDE5cyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuXG5cbiMjICoqRXRoaWNhbCBDb25zaWRlcmF0aW9uczoqKlxuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKioiLAogICAgImRpc3BsYXlOYW1lIjogIk1pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuMyIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIkJ1bGsgQnVpbGQiLAogICAgICAgICJNaXN0cmFsIiwKICAgICAgICAiTklNIiwKICAgICAgICAiTlNQRUNULVlEQVctRk1ERCIsCiAgICAgICAgIm1pc3RyYWwtN2ItaW5zdHJ1Y3QtdjAtMyIsCiAgICAgICAgIm52YWllOm1vZGVsOm52YWllX3N1cHBvcnRlZCIsCiAgICAgICAgIm52aWRpYV9uaW06bW9kZWw6bmltbWNyb19udmlkaWFfbmltIiwKICAgICAgICAicHJvZHVjdE5hbWVzOm5pbS1kZXYiLAogICAgICAgICJwcm9kdWN0TmFtZXM6bnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAibGF0ZXN0VmVyc2lvbklkU3RyIjogImw0MHN4Mi1sYXRlbmN5LWJmMTYtLWRvb3VjeDh4dyIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMTQ4NjE5Mzc2OTMsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvbWlzdHJhbC03Yi1pbnN0cnVjdC5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIk4vQSIsCiAgICAibmFtZSI6ICJtaXN0cmFsLTdiLWluc3RydWN0LXYwLTMiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiTi9BIiwKICAgICJwcml2YWN5IjogIiIsCiAgICAicHJvZHVjdE5hbWVzIjogWwogICAgICAgICJuaW0tZGV2IiwKICAgICAgICAibnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAicHVibGljRGF0YXNldFVzZWQiOiB7fSwKICAgICJwdWJsaXNoZXIiOiAiTWlzdHJhbCBBSSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAiIiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIk1pc3RyYWwtN0ItSW5zdHJ1Y3QtdjAuMyBpcyBhIGxhbmd1YWdlIG1vZGVsIHRoYXQgY2FuIGZvbGxvdyBpbnN0cnVjdGlvbnMsIGNvbXBsZXRlIHJlcXVlc3RzLCBhbmQgZ2VuZXJhdGUgY3JlYXRpdmUgdGV4dCBmb3JtYXRzIiwKICAgICJ0ZWFtTmFtZSI6ICJtaXN0cmFsYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDgtMjlUMTM6MzQ6MzkuODYzWiIKfQ== displayName: Mistral 7B Instruct source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/mistralai/containers/mistral-7b-instruct-v0.3 optimizationProfiles: - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200_NVLx1 BF16 Throughput ngcMetadata: 090aed9ae0f4312f525a15003626f36dd30aded5cabb5bfd580cfb88510f7175: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 713cc9e4be3d70c5a99ac45e46c5cd2cb271b5c16228561f1daf992f8feac8ff number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:gb200x2-latency-fp8-6ewdxacbyg framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GB200x2 FP8 Latency ngcMetadata: 0c430e8114b7d75876e040eb9e57f94f8780339c06d2afd7d52b8b520fe7d002: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 783069b3e78233c4649dfbd4031e5e32109f7eda1e54e623f39afa6771f69812 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:l40sx2-latency-fp8-werjmjtilg framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 L40Sx2 FP8 Latency ngcMetadata: 0dd2f4179304094d417e6326812f71bf5583853f655c71d2992893485208b6c4: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f8c9fdd309012b470e249367853869bb7c38c8adf82866e2e1f02b6ffabc6429 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__2 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200_NVLx2 BF16 Latency ngcMetadata: 1c8d8380b88e5e0b9dfa9bd7d9808e7b44533516e015e085121a17bec9f2803a: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9a8267f26d4614a846205cc91d2282acd830762361507abc23e58dfe78cd412c number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h200x2-latency-fp8-nnktn87ayw framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200x2 FP8 Latency ngcMetadata: 1d71ecae305c2a01b823eac3cac374e0cf882795349b7c9aa045363c82f331a3: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6edfcc1e5567c57e834b36011decd5d2efb559be351273b2ad7c8768bae66e39 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__3 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 RTX6000_BLACKWELL_SVx1 BF16 Latency ngcMetadata: 21d116fd5db9b38ae613c9ec2117e796e0aeec6d8f24e92928ca1171b5f0db8a: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c78a84fee0362ed61ba62a668240cb6619c459e8c105ba274e13c186512f846d number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h200x1-throughput-bf16-fii9d12dng framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200x1 BF16 Throughput ngcMetadata: 240f8bb29f20bd7b6f3a76367e82c2182d6f626ac3ac800daac124d6cdce1be6: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9190e11b1ecbdeb46a92c026ca480103519885a8f07638f6d4a21d27a9118141 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__4 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A100_SXM4_40GBx2 BF16 Latency ngcMetadata: 31f3565f323b25fb739b4319a054db75e52ad21e1e3adb93de0b7f932de6e954: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b84730aefe89d65c679b93ea096271ba583373eca30f081c680bed7dcff8f7c1 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 2 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h100x1-throughput-bf16-p8aaj1ui3a framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100x1 BF16 Throughput ngcMetadata: 37fe5e59120c01002604cd395d38f91f3c71808c9a76060d772ee8625db8a9aa: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 43b0efb1c318ab00e8740ac496ec18fd55db1d3f50a9c9470408fd5b647ccb0e number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__5 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_144GBx1 BF16 Throughput ngcMetadata: 3822e73f5b87aab36b8fa7f67f06b027ee79f259d4a6f6149d6e6e8834e15694: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 99355664e85deab8cef6bcda9b64b62eae3e6cb4fb72654992701318971d9cab number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__6 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_144GBx1 BF16 Latency ngcMetadata: 3929f189d9fe09ced84378d555047f329e9b5d22ea05a84dfc27bf4e423ab2ab: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a01faf2c27412adcdcc908764085b24d58398d230a42ecc86b4d0241886d55b6 number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__7 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_144GBx1 FP8 Throughput ngcMetadata: 3d2e4a566abec5fdab7016cf1ee4b9f0a28c0bbaf1ab5ba1fbcb739b9fbbfab6: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: dcbbb88340365f3a3ce5006101441492476ef83235d14fb9d2eaf245868f6e51 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:l40sx1-throughput-bf16-wgortubrfa framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 L40Sx1 BF16 Throughput ngcMetadata: 3d97e245329239baeda4299616d3379ddbea98f0f30a9fb6a0f97ff3bb593593: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 59b129434dc4805de4e69fc1e786327abcad095b67e099df18a0741700fc3562 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:b200x2-latency-bf16-k0zyvwltfq framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 B200x2 BF16 Latency ngcMetadata: 4369fb715f1d8a01cec62d750cbea038af0b5f5f032a372236fe6cb7ecaad891: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b41d026216b5cc343dc386982bc593595899581dd03e2e608bc13a7d7fe1fb71 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__8 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100_NVLx1 FP8 Throughput ngcMetadata: 4c9a845c4a8037390a5d87a8e2db4a9ef8c7cc5c5e613960b771adce3e548deb: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 00ae490b209e488c85835da5990d77b81c03bd111838c6ab188f5b3c1084f5f0 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:gb200x2-latency-bf16-wkgtx84w0q framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GB200x2 BF16 Latency ngcMetadata: 514f55258d4cffc08411144a8709add1d6dfda7563894feee671bad11a2be79c: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 054261eb6e99db9b73dd8ff0146b8748e4676c27344512bb070ffd471c54002d number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__9 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100_NVLx2 FP8 Latency ngcMetadata: 5165a3e3a29e9d6717869d3960133151f93437c8c34a297c2b6080763bfdcf32: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 20bd7371c735a556fea27dd89285a4bc2bb8cc5630c912da7ba9bdfd4fe0f149 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:b200x1-throughput-bf16-bzgxd7omcg framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 B200x1 BF16 Throughput ngcMetadata: 5a9eef29a1519f40178baec3444a0133990c5ed49ebd6e0ee5de5391f403c25f: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 99677dd60c3849da7d5daab13e7094c8f15c1ed0b324691dcfeb07c340748155 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:b200x1-throughput-fp8-1kujysl0bw framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 B200x1 FP8 Throughput ngcMetadata: 61a13f62e79b27cd7c69c32477b58857196ccc914a1b9f526fb9715238ceaddd: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f9ef3850321d85a46a3267f358c73bc62479d5fd3bd077bfbaa54968926284ab number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__10 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_144GBx1 FP8 Latency ngcMetadata: 6bdad363d842f0dc7b89c0bcdbfce49ab7ff3c77a7f1aaf741e10b5a8cfc7b65: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 05684b1b6aeb72f02bd8422d6f4bd2c193e2409465575f3b01fd7fe0ca606056 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__11 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_480GBx1 BF16 Latency ngcMetadata: 6e083975f86a7bd245f26d412ca4c0d99bed4a05e85eb516c7bf23d4a8dbc635: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 01c793b12ef404fe8d3d97f17a5851e07af0ce3e1ed7028940203e38020cff5b number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__12 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 RTX6000_BLACKWELL_SVx1 FP8 Throughput ngcMetadata: 6f9107642dc7198eb0084ba462da560fe696b28a74dc9bd5747f58b2229c0833: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 60a40aa9dddaddacb1f4f7ebbb536b33494d4a252b563fb321152125c6e5be1d number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:a10gx1-throughput-bf16-dbarntjrxg framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A10Gx1 BF16 Throughput ngcMetadata: 8aff3c4c1c985c1ab4bd362202c194479652465f22c634e79fead9f935d9f308: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e936f5f6f910166d5a160a10cd1a565e15bac32bd77cdf527f23a97e9a792622 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 1 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:a100x1-throughput-bf16-ug2ytdn9rq framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A100x1 BF16 Throughput ngcMetadata: 8d844ff4c978b716fb1b3044d4663305081e95fe9e3281ccbc60ebd243137939: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 52c07121ddb1886588c745606458ef1289c479b94c2e1d77b8260c89cb5e40ce number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__13 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200_NVLx1 FP8 Throughput ngcMetadata: 8e60a02116ccc9ed3587946a5b2ad0c431826d89e36be714dfa92044e84579de: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e395395c3d17874ecbc16978f25f851e3a8e4b08e6f107f8d1e00dc1f485aad2 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__14 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100_NVLx1 BF16 Throughput ngcMetadata: 8f1c5ed6338e2517b1db9987ca4a9cab78ad17acca14801eb301cd52fb60a4e2: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7b2c3bc5c67da0408b365dcde48b64e5ac4c4b316e7061e4da026d8ebfa23c60 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__15 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_480GBx1 BF16 Throughput ngcMetadata: a049a483413cc9fcf09502fb199582de0948a105c7d58ed41023f74fcf46a84a: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6fd41902191734a0e6c6105beef1c9eaec18a21786868ec1f5cf9876f924709f number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h200x2-latency-bf16-utfzkvbx7q framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200x2 BF16 Latency ngcMetadata: a2bd430ddfc5a8063daef926241911c1db8503f6b24034483213620ea0d6534c: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: fb34a1eb2c580f06657b13b17ed3fdcebd849fce79f29c090d58c8798bf18df0 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h100x1-throughput-fp8-3zk3rahgzq framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100x1 FP8 Throughput ngcMetadata: a91be3d64f314c006fa8f85baacd7a54eda8be911ac8ab66cca6b02044de16a8: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6f2d35f77b6e720ee0f8c950a138b31d739efd3c69094c0d830c7a6e1657575b number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:l40sx1-throughput-fp8-kegtu7-f8w framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 L40Sx1 FP8 Throughput ngcMetadata: a9776f67cf10b8456cb9c6a3cc657310cf6b402b482f75294f89a832813e585d: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a002dbee023af5c15de8bd132e0ad771081f285acdb4196fc77df8e2d5025bf7 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:a10gx2-latency-bf16-ultpn-z0fa framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A10Gx2 BF16 Latency ngcMetadata: b75e85db64643ec2a6fe296828296b6fb2971998445181b3e92bb4edb7028f9c: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2d647a36531389075e6d579d0e030fcaeb428ec3056fdf12e56ad673c99c3e9d number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 2 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__16 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A100_SXM4_40GBx1 BF16 Throughput ngcMetadata: c30c03b6c527e5bbc13c9024db7888bd3ef1f81f5437dd5eeb639963e7f956c0: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 1b85347f49cd97c7a43491a4065364128a860973559d1fbb418436cf1d22071f number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 1 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__17 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_480GBx1 FP8 Latency ngcMetadata: c5440e61e502d2bde9d8182735ec4b3cb5dc07386768b22e3fd11afb8f9123e1: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c1481c7a0c16fafd6097a18868e47f96bdb3e9bfef14223ed63d4c58b0b41046 number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__18 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 RTX6000_BLACKWELL_SVx1 FP8 Latency ngcMetadata: c6298bc319a27d0b8ce68b6ff2ee478f4503a532f85281db4e58e09bdc1e828d: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: bb8fc0519d6e093698164f6283010687e2acf7b28c240faeebcb9f6d04f3bdfd number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:a100x2-latency-bf16-eao98qqyaq framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 A100x2 BF16 Latency ngcMetadata: cffacd84594ea7bf5f03f8eaaa107d0e6078dadf84c2b8919c53ecc44ec0a418: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 31efbfeecc0071b15073a663036ed7854fe34edad643248b0b33f1648d396528 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:gb200x1-throughput-bf16-b7lzpmozrg framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GB200x1 BF16 Throughput ngcMetadata: d3e771cdfdccfc6685afb1749f581cbd723b3f4a7180453c366e49fe02201035: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 36332f865d9e636409ef1d780e1e129a7958c56612e251e991090198a71ecca2 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h100x2-latency-fp8-ubwp9icmag framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100x2 FP8 Latency ngcMetadata: d4d4737e0a2b76a1409c12d66a70924643f1bfca7448ca7bb9deb7a25f449470: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 5a148e8d8559629ab65b636a3344bd0a6c9d5ea1e7974bcdc5eb9273bc0c3aec number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:b200x2-latency-fp8-dmol-yoeqa framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 B200x2 FP8 Latency ngcMetadata: d772d81834faf0d0f3021ff92ea6893131a28c7b1eacedff9586b5304c768e16: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d21056b60d5e01083565a8671683b54e86879aa36a36475318838deec4613666 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__19 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GH200_480GBx1 FP8 Throughput ngcMetadata: e2392b25430a3f1fcec000a51661f633d36450438db8b09765dffaced7fac7e7: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 5ae57ff46795ac07b5bb351fafc5f767a4c62e864a2c283d982e92c8d82273e8 number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__20 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 RTX6000_BLACKWELL_SVx1 BF16 Throughput ngcMetadata: e2698f06fe02b17f4ac157fb39bd9ae75282d96e0a618c96ca9472a04bd3679b: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e8b647653354c51429e61400d7e38ea59531989d0808b570fa5755b7d6bfe130 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__21 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200_NVLx2 FP8 Latency ngcMetadata: e7014f30a669dca5d114ee37df6385a5453b02a23614832ef7bdb0e7f1622d11: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 43c16ff7a8e64039006342b0ba5d0067d7b3e49f7a913f06e67128585266aa67 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:l40sx2-latency-bf16--dooucx8xw framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 L40Sx2 BF16 Latency ngcMetadata: e93d09fc66b8e716a8370d431143b6d5efa1ab47a3aed691907d3c3d8d85bd4d: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ee18ec1b20cc3bbaff5d95b5e157c2d8ab9dc856df258de26b73ff6ec8e9f98d number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h100x2-latency-bf16-y5oxwbaufw framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100x2 BF16 Latency ngcMetadata: f01bf801094b032f87027566ae9036ac0489547a3a650a93bf7af4e12d7975c8: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 87eccccb3d5001d66e004f0e0bd2e26e245774007035b6d3c9a01f120c5d5f02 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 14GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:gb200x1-throughput-fp8-ndgj2enqyq framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 GB200x1 FP8 Throughput ngcMetadata: f76535fba1856c95ce15f11a3228fcb0469242f4921644d94fa682220c518c3f: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c0ef6863d68dbd3c3fdb7f3a0e8f2da9daf77c94757f228736a335de4a1ae628 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:hf-0d4b76e-tool_calling-bf16__22 framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H100_NVLx2 BF16 Latency ngcMetadata: f97a97adc7e9ca1ae225535ac8949af0f306846b429f079946fcc43cf0346f20: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 620affc99411e713b97069819f83de5bb626bf16dcb1d064492ad50dfc9641b7 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 28GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mistral-7b-instruct-v0-3:h200x1-throughput-fp8-ez1figc57w framework: TensorRT-LLM displayName: Mistral 7B Instruct V0.3 H200x1 FP8 Throughput ngcMetadata: fd130b01c59445a3967c804d57077fd77a3b2f76048603516402320f809f88ad: model: mistralai/mistral-7b-instruct-v0.3 release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f830f542f5a36acc42ddf3d7f7823662ed361c4e8e0ee0007cfe70da3df2fb9f number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM labels: - Mistral - Instruct - Large Language Model - TensorRT-LLM - Language Generation - NeMo - NVIDIA Validated config: architectures: - Other modelType: Mistral license: NVIDIA AI Foundation Models Community License - name: Mixtral Instruct displayName: Mixtral Instruct modelHubID: mixtral-instruct category: Language type: NGC description: Sparse Mixture-of-Experts model fine-tuned for instruction following with a 32K token context window. Matches or outperforms much larger dense models on standard benchmarks. modelVariants: - variantId: Mixtral 8x7B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNC0wNy0xM1QxODo1ODo0MC4wOTRaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyBNb2RlbCBPdmVydmlld1xuXG4jIyMgRGVzY3JpcHRpb25cblxuTWl4dHJhbCA4eDdCIEluc3RydWN0IGlzIGEgbGFuZ3VhZ2UgbW9kZWwgdGhhdCBjYW4gZm9sbG93IGluc3RydWN0aW9ucywgY29tcGxldGUgcmVxdWVzdHMsIGFuZCBnZW5lcmF0ZSBjcmVhdGl2ZSB0ZXh0IGZvcm1hdHMuIE1peHRyYWwgOHg3QiBhIGhpZ2gtcXVhbGl0eSBzcGFyc2UgbWl4dHVyZSBvZiBleHBlcnRzIG1vZGVsIChTTW9FKSB3aXRoIG9wZW4gd2VpZ2h0cy48YnI+XG5UaGlzIG1vZGVsIGhhcyBiZWVuIG9wdGltaXplZCB0aHJvdWdoIHN1cGVydmlzZWQgZmluZS10dW5pbmcgYW5kIGRpcmVjdCBwcmVmZXJlbmNlIG9wdGltaXphdGlvbiAoRFBPKSBmb3IgY2FyZWZ1bCBpbnN0cnVjdGlvbiBmb2xsb3dpbmcuIE9uIE1ULUJlbmNoLCBpdCByZWFjaGVzIGEgc2NvcmUgb2YgOC4zMCwgIHdpdGggYSBwZXJmb3JtYW5jZSBjb21wYXJhYmxlIHRvIEdQVDMuNS48YnI+XG5cbkxpY2Vuc2VkIHVuZGVyIEFwYWNoZSAyLjAuIE1peHRyYWwgb3V0cGVyZm9ybXMgTGxhbWEgMiA3MEIgb24gbW9zdCBiZW5jaG1hcmtzIHdpdGggNnggZmFzdGVyIGluZmVyZW5jZS4gSW4gcGFydGljdWxhciwgaXQgbWF0Y2hlcyBvciBvdXRwZXJmb3JtcyBHUFQzLjUgb24gbW9zdCBzdGFuZGFyZCBiZW5jaG1hcmtzLjxicj5cbk1peHRyYWwgaGFzIHRoZSBmb2xsb3dpbmcgY2FwYWJpbGl0aWVzLlxuKiBJdCBncmFjZWZ1bGx5IGhhbmRsZXMgYSBjb250ZXh0IG9mIDMyayB0b2tlbnMuXG4qIEl0IGhhbmRsZXMgRW5nbGlzaCwgRnJlbmNoLCBJdGFsaWFuLCBHZXJtYW4gYW5kIFNwYW5pc2guXG4qIEl0IHNob3dzIHN0cm9uZyBwZXJmb3JtYW5jZSBpbiBjb2RlIGdlbmVyYXRpb24uXG4qIEl0IGNhbiBiZSBmaW5ldHVuZWQgaW50byBhbiBpbnN0cnVjdGlvbi1mb2xsb3dpbmcgbW9kZWwgdGhhdCBhY2hpZXZlcyBhIHNjb3JlIG9mIDguMyBvbiBNVC1CZW5jaC5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBjb21tZXJpY2lhbCB1c2UuIFxuXG4jIyMgVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb24gXG5UaGlzIG1vZGVsIGlzIG5vdCBvd25lZCBvciBkZXZlbG9wZWQgYnkgTlZJRElBLiBUaGlzIG1vZGVsIGhhcyBiZWVuIGRldmVsb3BlZCBhbmQgYnVpbHQgdG8gYSB0aGlyZC1wYXJ0eVx1MjAxOXMgcmVxdWlyZW1lbnRzIGZvciB0aGlzIGFwcGxpY2F0aW9uIGFuZCB1c2UgY2FzZTsgc2VlIGxpbmsgdG8gdGhlIFtNaXh0cmFsIDh4N0ItSW5zdHJ1Y3QtdjAuMSBNb2RlbCBDYXJkXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21pc3RyYWxhaS9NaXh0cmFsLTh4N0ItSW5zdHJ1Y3QtdjAuMSkuXG5cbiMjIyBHb3Zlcm5pbmcgVGVybXNcbl9Ob3RlOiBUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LykgYW5kIHRoZSBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cy8pOyBhbmQgdGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIENvbW11bml0eSBNb2RlbCBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pLiBBRERJVElPTkFMIElORk9STUFUSU9OOiBbQXBhY2hlIExpY2Vuc2UgMi4wXShodHRwczovL2Nob29zZWFsaWNlbnNlLmNvbS9saWNlbnNlcy9hcGFjaGUtMi4wLykuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqXG5cbiMjIyBHZXR0aW5nIFN0YXJ0ZWRcbltRdWljayBTdGFydCBHdWlkZV0oaHR0cHM6Ly9kb2NzLm52aWRpYS5jb20vbmltL2xhcmdlLWxhbmd1YWdlLW1vZGVscy9sYXRlc3QvZ2V0dGluZy1zdGFydGVkLmh0bWwgKVxuXG4jIyMgUmVmZXJlbmNlcyhzKTpcblxuKiBbTWl4dHJhbCBvZiBleHBlcnRzIHwgTWlzdHJhbCBBSSB8IE9wZW4gc291cmNlIG1vZGVsc10oaHR0cHM6Ly9taXN0cmFsLmFpL25ld3MvbWl4dHJhbC1vZi1leHBlcnRzLykgPGJyPlxuXG4jIyBNb2RlbCBBcmNoaXRlY3R1cmVcblxuKipBcmNoaXRlY3R1cmUgVHlwZToqKiBUcmFuc2Zvcm1lciA8YnI+XG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIFNwYXJzZSBNaXh0dXJlIG9mIEdQVC1iYXNlZCBleHBlcnRzIDxicj5cbioqTW9kZWwgVmVyc2lvbjoqKiAwLjEgPGJyPlxuXG4jIyMgSW5wdXRcbi0gKipJbnB1dCBUeXBlOioqIFRleHRcbi0gKipJbnB1dCBGb3JtYXQ6KiogU3RyaW5nXG4tICoqSW5wdXQgUGFyYW1ldGVyczoqKiBJbnB1dCBTZXF1ZW5jZSBMZW5ndGggKFRva2VucykgPSA4MTkyIFxuXG4jIyMgT3V0cHV0XG4tICoqT3V0cHV0IFR5cGU6KiogVGV4dFxuLSAqKk91dHB1dCBGb3JtYXQ6KiogU3RyaW5nXG4tICoqT3V0cHV0IFBhcmFtZXRlcnM6KiogT3V0cHV0IFNlcXVlbmNlIExlbmd0aCAoVG9rZW5zKSA9IDgxOTIgXG5cbiMjIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvbjpcblxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgUGxhdGZvcm0ocyk6KiogTlZJRElBIEFtcGVyZSwgTlZJRElBIEhvcHBlciwgTlZJRElBIExvdmVsYWNlLCBOVklESUEgVHVyaW5nIDxicj5cbioqU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6KiogTGludXggPGJyPlxuXG4jIyBUcmFpbmluZyBEYXRhXG5cblRyYWluaW5nIGFuZCB0dW5pbmcgZGF0YSBoYXMgbm90IGJlZW4gZGlzY2xvc2VkIGZvciBNaXh0cmFsLTh4N0ItSW5zdHJ1Y3QtdjAuMSBtb2RlbC5cblxuIyMgRXZhbHVhdGlvbiBEYXRhXG5PZmZpY2lhbCBldmFsdWF0aW9uIGRhdGEgaGFzIG5vdCBiZWVuIHB1Ymxpc2hlZCBmb3IgTWl4dHJhbC04eDdCLUluc3RydWN0LXYwLjEgbW9kZWwuXG5cbiMjIEluZmVyZW5jZVxuXG4qKkVuZ2luZToqKiBbVHJpdG9uXShodHRwczovL2RldmVsb3Blci5udmlkaWEuY29tL3RyaXRvbi1pbmZlcmVuY2Utc2VydmVyKSA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogSDEwMCwgQTEwMCA4MEdCIDxicj5cblxuIyMgR2V0IEhlbHA6IEVudGVycHJpc2UgU3VwcG9ydFxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciBbc3VibWl0IGEgdGlja2V0XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2RhdGEtY2VudGVyL3Byb2R1Y3RzL2FpLWVudGVycHJpc2Utc3VpdGUvc3VwcG9ydC8pLlxuXG4jIyBOVklESUEgQUkgRW50ZXJwcmlzZSBEb2N1bWVudGF0aW9uXG5WaXNpdCB0aGUgW05WSURJQSBBSSBFbnRlcnByaXNlIERvY3VtZW50YXRpb24gSHViXShodHRwczovL2RvY3MubnZpZGlhLmNvbS9haS1lbnRlcnByaXNlLykgZm9yIHJlbGVhc2UgZG9jdW1lbnRhdGlvbiwgZGVwbG95bWVudCBndWlkZXMgYW5kIG1vcmUuIiwKICAgICJkaXNwbGF5TmFtZSI6ICJNaXh0cmFsLTh4N0ItSW5zdHJ1Y3QtdjAuMSIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIkJ1bGsgQnVpbGQiLAogICAgICAgICJOU1BFQ1QtNFM4MC1OMUE3IiwKICAgICAgICAiTlNQRUNULUJFMDgtMTRNViIsCiAgICAgICAgIm1peHRyYWwtOHg3Yi1pbnN0cnVjdC12MC0xIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiaGYtYTYwODMyYy0wNTA4LXRvb2wtdXNlLXYyIiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiA5MzQwODExNDI2OCwKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9taXh0cmFsLTh4N2ItaW5zdHJ1Y3QuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJOL0EiLAogICAgIm5hbWUiOiAibWl4dHJhbC04eDdiLWluc3RydWN0LXYwMSIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJOL0EiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJNaXN0cmFsIEFJIiwKICAgICJzYWZldHlBbmRTZWN1cml0eSI6ICIiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiTWl4dHJhbCA4eDdCIEluc3RydWN0IGlzIGEgbGFuZ3VhZ2UgbW9kZWwgdGhhdCBjYW4gZm9sbG93IGluc3RydWN0aW9ucywgY29tcGxldGUgcmVxdWVzdHMsIGFuZCBnZW5lcmF0ZSBjcmVhdGl2ZSB0ZXh0IGZvcm1hdHMuIiwKICAgICJ0ZWFtTmFtZSI6ICJtaXN0cmFsYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDYtMDNUMTc6MzM6MzMuMDMyWiIKfQ== displayName: Mixtral 8x7B Instruct source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/mistralai/containers/mixtral-8x7b-instruct-v01 optimizationProfiles: - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:a100x2-throughput-bf16-s69xvudfza framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 A100x2 BF16 Throughput ngcMetadata: 0db3b5e8468c9debf30bcf41cbfea084adc59000885efd6fdcb3bbb902651bd6: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h100x2-throughput-bf16-zwhl2fsi5a framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100x2 BF16 Throughput ngcMetadata: 1617d074ce252f66e96d5f0e331fa5c6cc0a0330519e56b5c66c60eb7d7bf4f9: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100_NVLx4 BF16 Latency ngcMetadata: 28552abdb2c491d46065d52ca1dc1265b99ba95a5bf8daaee4c5de12511a3b4f: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 4 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:l40sx4-throughput-fp8-hbavqk65yw framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 L40Sx4 FP8 Throughput ngcMetadata: 3d0e5989f2fbc23e7d4504cd69269c9636deb61d0efc12225d3d59d54afea297: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: fp8 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 45GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h200x1-throughput-bf16-00qqbltmrg framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H200x1 BF16 Throughput ngcMetadata: 434e8d336fa23cbe151748d32b71e196d69f20d319ee8b59852a1ca31a48d311: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:b200x2-latency-fp8-pwnesuqgxg framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 B200x2 FP8 Latency ngcMetadata: 4950d30811e1e426e97cda69e6c03a8a4819db8aa4abf34722ced4542a1f6b52: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__2 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100_NVLx1 FP8 Throughput ngcMetadata: 5811750e70b7e9f340f4d670c72fcbd5282e254aeb31f62fd4f937cfb9361007: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h200x2-latency-bf16-uh6awyzpta framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H200x2 BF16 Latency ngcMetadata: 6832a9395f54086162fd7b1c6cfaae17c7d1e535a60e2b7675504c9fc7b57689: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__3 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 A100_SXM4_40GBx4 BF16 Throughput ngcMetadata: 6c29727e6e3d48a900c348c1fab181dc40bc926be07b06ca5b8eae42a6bc9901: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 4 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h100x2-latency-fp8-4-l0a-rlkq framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100x2 FP8 Latency ngcMetadata: 6c3f01dd2b2a56e3e83f70522e4195d3f2add70b28680082204bbb9d6150eb04: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h100x4-latency-bf16-axe5ogfgvq framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100x4 BF16 Latency ngcMetadata: 73f41fabbb60beb5b05ab21c8dcce5c277d99bcabec31abf46a0194d0dd18d04: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h100x1-throughput-fp8-j1x74k--ng framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100x1 FP8 Throughput ngcMetadata: 7b508014e846234db3cabe5c9f38568b4ee96694b60600a0b71c621dc70cacf3: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:l40sx4-latency-bf16-qavtgypi5w framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 L40Sx4 BF16 Latency ngcMetadata: 844ebe2b42df8de8ce66cbb6ecf43f90858ea7efc14ddf020cf1ae7450ae0c33: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__4 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 A100_SXM4_40GBx8 BF16 Latency ngcMetadata: 8a446393aaeb0065ee584748c7c03522389921a11ff2bd8cb5800e06a8644eb0: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 8 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:b200x1-throughput-fp8-ult1akfaqa framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 B200x1 FP8 Throughput ngcMetadata: 8b87146e39b0305ae1d73bc053564d1b4b4c565f81aa5abe3e84385544ca9b60: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:a10gx8-throughput-bf16-jxekvgjfha framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 A10Gx8 BF16 Throughput ngcMetadata: 935ec3ac922bf54106311dfc6b3214a1651a26033b4f5007b6351fffb4058b7a: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '8' pp: '1' precision: bf16 profile: throughput tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 8 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 90GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__5 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100_NVLx2 FP8 Latency ngcMetadata: a00ce1e782317cd19ed192dcb0ce26ab8b0c1da8928c33de8893897888ff7580: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:b200x1-throughput-bf16-ftwmzofxbq framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 B200x1 BF16 Throughput ngcMetadata: a4c63a91bccf635b570ddb6d14eeb6e7d0acb2389712892b08d21fad2ceaee38: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:l40sx4-throughput-bf16-d9jierrahq framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 L40Sx4 BF16 Throughput ngcMetadata: ab8f2faec3bcafc32efaf05acada4df4d8a171a759b4fb5c44d2d9d43a348764: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__6 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H100_NVLx2 BF16 Throughput ngcMetadata: acd73fcee9d91ada305118080138fb3ca4d255adee3312acda38c4487daae476: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h200x1-throughput-fp8-skjppy5-iw framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H200x1 FP8 Throughput ngcMetadata: af876a179190d1832143f8b4f4a71f640f3df07b0503259cedee3e3a8363aa96: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:l40sx4-latency-fp8-vmkcxgu3fw framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 L40Sx4 FP8 Latency ngcMetadata: bdd0d3cd53fad1130259beea81ab5711fb98f2f1a020b5b26c3c82fd7d43c5af: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 45GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:a100x4-latency-bf16-yphkz2bivw framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 A100x4 BF16 Latency ngcMetadata: d73b7cf2f719d720329fc65fc255ae901bc3beebdc59be9815ede1a07948c1f7: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 4 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:h200x2-latency-fp8-skwo6uxqkq framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 H200x2 FP8 Latency ngcMetadata: e4f217a5fb016b570e34b8a8eb06051ccfef9534ba43da973bb7f678242eaa5f: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 44GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:b200x2-latency-bf16-qkpte3pb7w framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 B200x2 BF16 Latency ngcMetadata: f44768c625db71a327cf17e750d5e1a8e60171a8d8ef6b4c1c4b57fe74c9bf46: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 88GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__7 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 Generic NVIDIA GPUx8 BF16 ngcMetadata: 1d7b604f835f74791e6bfd843047fc00a5aef0f72954ca48ce963811fb6f3f09: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '8' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 8 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__8 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 Generic NVIDIA GPUx2 BF16 ngcMetadata: 375dc0ff86133c2a423fbe9ef46d8fdf12d6403b3caa3b8e70d7851a89fc90dd: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '2' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 2 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' - profileId: nim/mistralai/mixtral-8x7b-instruct-v01:hf-a60832c-0508-tool-use-v2__9 framework: TensorRT-LLM displayName: Mixtral 8x7b Instruct V0.1 Generic NVIDIA GPUx4 BF16 ngcMetadata: 54946b08b79ecf9e7f2d5c000234bf2cce19c8fee21b243c1a084b03897e8c95: model: mistralai/mixtral-8x7b-instruct-v0.1 release: 1.8.4 tags: feat_lora: 'false' llm_engine: tensorrt_llm pp: '1' precision: bf16 tp: '4' trtllm_buildable: 'true' modelFormat: trt-llm spec: - key: PRECISION value: BF16 - key: COUNT value: 4 - key: NIM VERSION value: 1.8.4 - key: DOWNLOAD SIZE value: 87GB - key: LLM ENGINE value: TENSORRT_LLM - key: TRTLLM BUILDABLE value: 'TRUE' labels: - Mistral - Instruct - Large Language Model - TensorRT-LLM - Language Generation - NeMo - NVIDIA Validated config: architectures: - Other modelType: mistral license: NVIDIA AI Foundation Models Community License - name: Deepseek R1 Distill Llama displayName: Deepseek R1 Distill Llama modelHubID: deepseek-r1-distill-llama category: Language type: NGC description: Distilled reasoning model excelling at math, science, and code tasks. Delivers state-of-the-art performance on complex reasoning benchmarks. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: Deepseek R1 Distill Llama 70b modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0wN1QwMDozMjo1OC4yNzBaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIqKk1vZGVsIE92ZXJ2aWV3KipcblxuIyMgRGVzY3JpcHRpb246XG5cbkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtNzBCIGlzIGEgZGlzdGlsbGVkIHZlcnNpb24gb2YgdGhlIERlZXBTZWVrLVIxIHNlcmllcywgYnVpbHQgdXBvbiB0aGUgTGxhbWEzLjMtNzBCLUluc3RydWN0IGFyY2hpdGVjdHVyZS4gVGhpcyBtb2RlbCBpcyBkZXNpZ25lZCB0byBkZWxpdmVyIGVmZmljaWVudCBwZXJmb3JtYW5jZSBmb3IgcmVhc29uaW5nLCBtYXRoLCBhbmQgY29kZSB0YXNrcyB3aGlsZSBtYWludGFpbmluZyBoaWdoIGFjY3VyYWN5LiBCeSBkaXN0aWxsaW5nIGtub3dsZWRnZSBmcm9tIHRoZSBsYXJnZXIgRGVlcFNlZWstUjEgbW9kZWwsIGl0IHByb3ZpZGVzIHN0YXRlLW9mLXRoZS1hcnQgcGVyZm9ybWFuY2Ugd2l0aCByZWR1Y2VkIGNvbXB1dGF0aW9uYWwgcmVxdWlyZW1lbnRzLlxuXG5UaGlzIG1vZGVsIGlzIHJlYWR5IGZvciBib3RoIHJlc2VhcmNoIGFuZCBjb21tZXJjaWFsIHVzZS5cbkZvciBtb3JlIGRldGFpbHMsIHZpc2l0IHRoZSBbRGVlcFNlZWsgd2Vic2l0ZV0oaHR0cHM6Ly93d3cuZGVlcHNlZWsuY29tLykuXG5cbiMjIFRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uXG5cblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFtEZWVwU2Vlay1SMSBNb2RlbCBDYXJkXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RlZXBzZWVrLWFpL0RlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtNzBCKS5cblxuIyMjIExpY2Vuc2UvVGVybXMgb2YgVXNlXG5cbkdPVkVSTklORyBURVJNUzogVGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzLyk7IGFuZCB0aGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQ29tbXVuaXR5IE1vZGVsIExpY2Vuc2VdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS4gQWRkaXRpb25hbCBJbmZvcm1hdGlvbjogW01JVCBMaWNlbnNlXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RhdGFzZXRzL2Nob29zZWFsaWNlbnNlL2xpY2Vuc2VzL2Jsb2IvbWFpbi9tYXJrZG93bi9taXQubWQpOyBbTWV0YSBMbGFtYSAzLjMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdC9ibG9iL21haW4vTElDRU5TRSkuIEJ1aWx0IHdpdGggTGxhbWEuXG5cbiMjIFJlZmVyZW5jZXM6XG5cbi0gW0RlZXBTZWVrIEdpdEh1YiBSZXBvc2l0b3J5XShodHRwczovL2dpdGh1Yi5jb20vZGVlcHNlZWstYWkvRGVlcFNlZWstVjMpXG4tIFtEZWVwU2Vlay1SMSBQYXBlcl0oaHR0cHM6Ly9hcnhpdi5vcmcvYWJzLzI1MDEuMTI5NDgpXG4tIFtIdWdnaW5nIEZhY2UgTW9kZWwgQ2FyZCBmb3IgRGVlcFNlZWstUjEtRGlzdGlsbC1MbGFtYS03MEJdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZGVlcHNlZWstYWkvRGVlcFNlZWstUjEtRGlzdGlsbC1MbGFtYS03MEIpXG5cbiMjIE1vZGVsIEFyY2hpdGVjdHVyZTpcblxuKipBcmNoaXRlY3R1cmUgVHlwZToqKiBEaXN0aWxsZWQgdmVyc2lvbiBvZiBNaXh0dXJlIG9mIEV4cGVydHMgKE1vRSkgPGJyPlxuKipCYXNlIE1vZGVsOioqIExsYW1hMy4zLTcwQi1JbnN0cnVjdFxuXG4jIyBJbnB1dDpcblxuKipJbnB1dCBUeXBlKHMpOioqIFRleHQgPGJyPlxuKipJbnB1dCBGb3JtYXQocyk6KiogU3RyaW5nIDxicj5cbioqSW5wdXQgUGFyYW1ldGVyczoqKiAoMUQpIDxicj5cbioqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OioqIDxicj5cbkRlZXBTZWVrIHJlY29tbWVuZHMgYWRoZXJpbmcgdG8gdGhlIGZvbGxvd2luZyBjb25maWd1cmF0aW9ucyB3aGVuIHV0aWxpemluZyB0aGUgRGVlcFNlZWstUjEgc2VyaWVzIG1vZGVscywgaW5jbHVkaW5nIGJlbmNobWFya2luZywgdG8gYWNoaWV2ZSB0aGUgZXhwZWN0ZWQgcGVyZm9ybWFuY2U6XG5cbjEuIFNldCB0aGUgdGVtcGVyYXR1cmUgd2l0aGluIHRoZSByYW5nZSBvZiAwLjUtMC43ICgwLjYgaXMgcmVjb21tZW5kZWQpIHRvIHByZXZlbnQgZW5kbGVzcyByZXBldGl0aW9ucyBvciBpbmNvaGVyZW50IG91dHB1dHMuXG4yLiAqKkF2b2lkIGFkZGluZyBhIHN5c3RlbSBwcm9tcHQ7IGFsbCBpbnN0cnVjdGlvbnMgc2hvdWxkIGJlIGNvbnRhaW5lZCB3aXRoaW4gdGhlIHVzZXIgcHJvbXB0LioqXG4zLiBGb3IgbWF0aGVtYXRpY2FsIHByb2JsZW1zLCBpdCBpcyBhZHZpc2FibGUgdG8gaW5jbHVkZSBhIGRpcmVjdGl2ZSBpbiB5b3VyIHByb21wdCBzdWNoIGFzOiBcIlBsZWFzZSByZWFzb24gc3RlcCBieSBzdGVwLCBhbmQgcHV0IHlvdXIgZmluYWwgYW5zd2VyIHdpdGhpbiBcXGJveGVke30uXCJcbjQuIFdoZW4gZXZhbHVhdGluZyBtb2RlbCBwZXJmb3JtYW5jZSwgaXQgaXMgcmVjb21tZW5kZWQgdG8gY29uZHVjdCBtdWx0aXBsZSB0ZXN0cyBhbmQgYXZlcmFnZSB0aGUgcmVzdWx0cy5cblxuIyMgT3V0cHV0OlxuXG4qKk91dHB1dCBUeXBlKHMpOioqIFRleHQgPGJyPlxuKipPdXRwdXQgRm9ybWF0OioqIFN0cmluZyA8YnI+XG4qKk91dHB1dCBQYXJhbWV0ZXJzOioqICgxRCkgPGJyPlxuXG4jIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvbjpcblxuKipSdW50aW1lIEVuZ2luZShzKToqKiBUZW5zb3JSVC1MTE0gPGJyPlxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eToqKiBOVklESUEgQW1wZXJlLCBOVklESUEgQmxhY2t3ZWxsLCBOVklESUEgSmV0c29uLCBOVklESUEgSG9wcGVyLCBOVklESUEgTG92ZWxhY2UsIE5WSURJQSBQYXNjYWwsIE5WSURJQSBUdXJpbmcsIGFuZCBOVklESUEgVm9sdGEgYXJjaGl0ZWN0dXJlcyA8YnI+XG4qKltQcmVmZXJyZWQvU3VwcG9ydGVkXSBPcGVyYXRpbmcgU3lzdGVtKHMpOioqIExpbnV4XG5cbiMjIE1vZGVsIFZlcnNpb24ocyk6XG5cbkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtNzBCXG5cbiMgVHJhaW5pbmcsIFRlc3RpbmcsIGFuZCBFdmFsdWF0aW9uIERhdGFzZXRzOlxuXG4jIyBUcmFpbmluZyBEYXRhc2V0OlxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWQgPGJyPlxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWQgPGJyPlxuXG4jIyBUZXN0aW5nIERhdGFzZXQ6XG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZCA8YnI+XG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZCA8YnI+XG5cbiMjIEV2YWx1YXRpb24gRGF0YXNldDpcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkIDxicj5cbioqTGFiZWxpbmcgTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkIDxicj5cblxuIyMgSW5mZXJlbmNlOlxuXG4qKkVuZ2luZToqKiBUZW5zb3JSVC1MTE0gPGJyPlxuKipUZXN0IEhhcmR3YXJlOioqIE5WSURJQSBIb3BwZXJcblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9uczpcblxuTlZJRElBIGJlbGlldmVzIFRydXN0d29ydGh5IEFJIGlzIGEgc2hhcmVkIHJlc3BvbnNpYmlsaXR5IGFuZCB3ZSBoYXZlIGVzdGFibGlzaGVkIHBvbGljaWVzIGFuZCBwcmFjdGljZXMgdG8gZW5hYmxlIGRldmVsb3BtZW50IGZvciBhIHdpZGUgYXJyYXkgb2YgQUkgYXBwbGljYXRpb25zLiBXaGVuIGRvd25sb2FkZWQgb3IgdXNlZCBpbiBhY2NvcmRhbmNlIHdpdGggb3VyIHRlcm1zIG9mIHNlcnZpY2UsIGRldmVsb3BlcnMgc2hvdWxkIHdvcmsgd2l0aCB0aGVpciBpbnRlcm5hbCBtb2RlbCB0ZWFtIHRvIGVuc3VyZSB0aGlzIG1vZGVsIG1lZXRzIHJlcXVpcmVtZW50cyBmb3IgdGhlIHJlbGV2YW50IGluZHVzdHJ5IGFuZCB1c2UgY2FzZSBhbmQgYWRkcmVzc2VzIHVuZm9yZXNlZW4gcHJvZHVjdCBtaXN1c2UuIFBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbiMjIE1vZGVsIExpbWl0YXRpb25zOlxuVGhlIGJhc2UgbW9kZWwgd2FzIHRyYWluZWQgb24gZGF0YSB0aGF0IGNvbnRhaW5zIHRveGljIGxhbmd1YWdlIGFuZCBzb2NpZXRhbCBiaWFzZXMgb3JpZ2luYWxseSBjcmF3bGVkIGZyb20gdGhlIGludGVybmV0LiBUaGVyZWZvcmUsIHRoZSBtb2RlbCBtYXkgYW1wbGlmeSB0aG9zZSBiaWFzZXMgYW5kIHJldHVybiB0b3hpYyByZXNwb25zZXMgZXNwZWNpYWxseSB3aGVuIHByb21wdGVkIHdpdGggdG94aWMgcHJvbXB0cy4gVGhlIG1vZGVsIG1heSBnZW5lcmF0ZSBhbnN3ZXJzIHRoYXQgbWF5IGJlIGluYWNjdXJhdGUsIG9taXQga2V5IGluZm9ybWF0aW9uLCBvciBpbmNsdWRlIGlycmVsZXZhbnQgb3IgcmVkdW5kYW50IHRleHQgcHJvZHVjaW5nIHNvY2lhbGx5IHVuYWNjZXB0YWJsZSBvciB1bmRlc2lyYWJsZSB0ZXh0LCBldmVuIGlmIHRoZSBwcm9tcHQgaXRzZWxmIGRvZXMgbm90IGluY2x1ZGUgYW55dGhpbmcgZXhwbGljaXRseSBvZmZlbnNpdmUuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqIiwKICAgICJkaXNwbGF5TmFtZSI6ICJEZWVwU2Vlay1SMS1EaXN0aWxsLUxsYW1hLTcwQiIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1SQUhXLTVMMFgiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJsNDBzeDQtdGhyb3VnaHB1dC1mcDgtNDZ1M2x2cDZqYSIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogNzM2MjM4NjQwOTUsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvZGVlcHNlZWstcjEtZGlzdGlsbC1sbGFtYS03MGIuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJOL0EiLAogICAgIm5hbWUiOiAiZGVlcHNlZWstcjEtZGlzdGlsbC1sbGFtYS03MGIiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiTi9BIiwKICAgICJwcml2YWN5IjogIiIsCiAgICAicHJvZHVjdE5hbWVzIjogWwogICAgICAgICJuaW0tZGV2IiwKICAgICAgICAibnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAicHVibGljRGF0YXNldFVzZWQiOiB7fSwKICAgICJwdWJsaXNoZXIiOiAiRGVlcFNlZWstQUkiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJEZWVwU2Vlay1SMS1EaXN0aWxsLUxsYW1hLTcwQiBpcyBhIGRpc3RpbGxlZCB2ZXJzaW9uIG9mIHRoZSBEZWVwU2Vlay1SMSBzZXJpZXMsIGJ1aWx0IHVwb24gdGhlIExsYW1hMy4zLTcwQi1JbnN0cnVjdCBhcmNoaXRlY3R1cmUuIFRoaXMgbW9kZWwgaXMgZGVzaWduZWQgdG8gZGVsaXZlciBlZmZpY2llbnQgcGVyZm9ybWFuY2UgZm9yIHJlYXNvbmluZywgbWF0aCwgYW5kIGNvZGUgdGFza3Mgd2hpbGUgbWFpbnRhaW5pbmcgaGlnaCBhY2N1cmFjeSIsCiAgICAidGVhbU5hbWUiOiAiZGVlcHNlZWstYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDItMjhUMDI6MTU6MTIuMDQ0WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/deepseek-ai/containers/deepseek-r1-distill-llama-70b optimizationProfiles: - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:l40sx4-throughput-fp8-46u3lvp6ja framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B L40Sx4 FP8 Throughput ngcMetadata: 23c28e4a1ad4d963c1504f1a33b45afb65bf61b64b20be1a8ea2c8816ea0fc36: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: fp8 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 4 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 69GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:h100x4-latency-fp8-k5tlofelyw framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B H100x4 FP8 Latency ngcMetadata: 4696d5c5b44b13bb5e864affcdcfa30ad229390285476315d9921fd0828bda5b: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 69GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:h100x8-latency-fp8-xz3eymtuzq framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B H100x8 FP8 Latency ngcMetadata: 91f2b7c9e719c0c380ba6c1d6c3e5cad61aaf807730de88fa3b6233a39edeeaa: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '8' pp: '1' precision: fp8 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 8 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 70GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:h100x2-throughput-fp8-8cx2penaia framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B H100x2 FP8 Throughput ngcMetadata: da94a5c34cf665e85813fa49f321f1e87ca12317722b5e65628cf3ed0371897b: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 69GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:h100x4-throughput-bf16-g31fj2uvrw framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B H100x4 BF16 Throughput ngcMetadata: e6b8fb8c4c76343b05b9051974593e5bd9110a868770d52e8eb0fe5a3b46dd67: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: throughput tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 4 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 138GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-70b:h100x8-latency-bf16-v8q6jmcd9g framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 70B H100x8 BF16 Latency ngcMetadata: f87605b6d8cfc0ca39fad21b4ec580219f3a3be42884d2c7caad9b8ae4b3c1c7: model: deepseek-r1-distill-llama-70b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '8' pp: '1' precision: bf16 profile: latency tp: '8' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 8 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 147GB - variantId: Deepseek R1 Distill Llama 8b modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0wN1QwMDozNjoyMS4yNTVaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIqKk1vZGVsIE92ZXJ2aWV3KipcblxuIyMgRGVzY3JpcHRpb246XG5cbkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtOEIgaXMgYSBkaXN0aWxsZWQgdmVyc2lvbiBvZiB0aGUgRGVlcFNlZWstUjEgc2VyaWVzLCBidWlsdCB1cG9uIHRoZSBMbGFtYTMuMS04Qi1JbnN0cnVjdCBhcmNoaXRlY3R1cmUuIFRoaXMgbW9kZWwgaXMgZGVzaWduZWQgdG8gZGVsaXZlciBlZmZpY2llbnQgcGVyZm9ybWFuY2UgZm9yIHJlYXNvbmluZywgbWF0aCwgYW5kIGNvZGUgdGFza3Mgd2hpbGUgbWFpbnRhaW5pbmcgaGlnaCBhY2N1cmFjeS4gQnkgZGlzdGlsbGluZyBrbm93bGVkZ2UgZnJvbSB0aGUgbGFyZ2VyIERlZXBTZWVrLVIxIG1vZGVsLCBpdCBwcm92aWRlcyBzdGF0ZS1vZi10aGUtYXJ0IHBlcmZvcm1hbmNlIHdpdGggcmVkdWNlZCBjb21wdXRhdGlvbmFsIHJlcXVpcmVtZW50cy5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgYm90aCByZXNlYXJjaCBhbmQgY29tbWVyY2lhbCB1c2UuXG5Gb3IgbW9yZSBkZXRhaWxzLCB2aXNpdCB0aGUgW0RlZXBTZWVrIHdlYnNpdGVdKGh0dHBzOi8vd3d3LmRlZXBzZWVrLmNvbS8pLlxuXG4jIyBUaGlyZC1QYXJ0eSBDb21tdW5pdHkgQ29uc2lkZXJhdGlvblxuXG5UaGlzIG1vZGVsIGlzIG5vdCBvd25lZCBvciBkZXZlbG9wZWQgYnkgTlZJRElBLiBUaGlzIG1vZGVsIGhhcyBiZWVuIGRldmVsb3BlZCBhbmQgYnVpbHQgdG8gYSB0aGlyZC1wYXJ0eVx1MjAxOXMgcmVxdWlyZW1lbnRzIGZvciB0aGlzIGFwcGxpY2F0aW9uIGFuZCB1c2UgY2FzZTsgc2VlIGxpbmsgdG8gTm9uLU5WSURJQSBbRGVlcFNlZWstUjEgTW9kZWwgQ2FyZF0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kZWVwc2Vlay1haS9EZWVwU2Vlay1SMS1EaXN0aWxsLUxsYW1hLThCKS5cblxuIyMjIExpY2Vuc2UvVGVybXMgb2YgVXNlXG5cbkdPVkVSTklORyBURVJNUzogVGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgQUkgUHJvZHVjdHNdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL3Byb2R1Y3Qtc3BlY2lmaWMtdGVybXMtZm9yLWFpLXByb2R1Y3RzLyk7IGFuZCB0aGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQ29tbXVuaXR5IE1vZGVsIExpY2Vuc2VdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS4gQWRkaXRpb25hbCBJbmZvcm1hdGlvbjogW01JVCBMaWNlbnNlXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RhdGFzZXRzL2Nob29zZWFsaWNlbnNlL2xpY2Vuc2VzL2Jsb2IvbWFpbi9tYXJrZG93bi9taXQubWQpOyBbTWV0YSBMbGFtYSAzLjMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL2h1Z2dpbmdmYWNlLmNvL21ldGEtbGxhbWEvTGxhbWEtMy4zLTcwQi1JbnN0cnVjdC9ibG9iL21haW4vTElDRU5TRSkuIEJ1aWx0IHdpdGggTGxhbWEuXG5cbiMjIFJlZmVyZW5jZXM6XG5cbi0gW0RlZXBTZWVrIEdpdEh1YiBSZXBvc2l0b3J5XShodHRwczovL2dpdGh1Yi5jb20vZGVlcHNlZWstYWkvRGVlcFNlZWstVjMpXG4tIFtEZWVwU2Vlay1SMSBQYXBlcl0oaHR0cHM6Ly9hcnhpdi5vcmcvYWJzLzI1MDEuMTI5NDgpXG4tIFtIdWdnaW5nIEZhY2UgTW9kZWwgQ2FyZCBmb3IgRGVlcFNlZWstUjEtRGlzdGlsbC1MbGFtYS04Ql0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kZWVwc2Vlay1haS9EZWVwU2Vlay1SMS1EaXN0aWxsLUxsYW1hLThCKVxuXG4jIyBNb2RlbCBBcmNoaXRlY3R1cmU6XG5cbioqQXJjaGl0ZWN0dXJlIFR5cGU6KiogRGlzdGlsbGVkIHZlcnNpb24gb2YgTWl4dHVyZSBvZiBFeHBlcnRzIChNb0UpIDxicj5cbioqQmFzZSBNb2RlbDoqKiBMbGFtYTMuMS04Qi1JbnN0cnVjdFxuXG4jIyBJbnB1dDpcblxuKipJbnB1dCBUeXBlKHMpOioqIFRleHQgPGJyPlxuKipJbnB1dCBGb3JtYXQocyk6KiogU3RyaW5nIDxicj5cbioqSW5wdXQgUGFyYW1ldGVyczoqKiAoMUQpIDxicj5cbioqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OioqIDxicj5cbkRlZXBTZWVrIHJlY29tbWVuZHMgYWRoZXJpbmcgdG8gdGhlIGZvbGxvd2luZyBjb25maWd1cmF0aW9ucyB3aGVuIHV0aWxpemluZyB0aGUgRGVlcFNlZWstUjEgc2VyaWVzIG1vZGVscywgaW5jbHVkaW5nIGJlbmNobWFya2luZywgdG8gYWNoaWV2ZSB0aGUgZXhwZWN0ZWQgcGVyZm9ybWFuY2U6XG5cbjEuIFNldCB0aGUgdGVtcGVyYXR1cmUgd2l0aGluIHRoZSByYW5nZSBvZiAwLjUtMC43ICgwLjYgaXMgcmVjb21tZW5kZWQpIHRvIHByZXZlbnQgZW5kbGVzcyByZXBldGl0aW9ucyBvciBpbmNvaGVyZW50IG91dHB1dHMuXG4yLiAqKkF2b2lkIGFkZGluZyBhIHN5c3RlbSBwcm9tcHQ7IGFsbCBpbnN0cnVjdGlvbnMgc2hvdWxkIGJlIGNvbnRhaW5lZCB3aXRoaW4gdGhlIHVzZXIgcHJvbXB0LioqXG4zLiBGb3IgbWF0aGVtYXRpY2FsIHByb2JsZW1zLCBpdCBpcyBhZHZpc2FibGUgdG8gaW5jbHVkZSBhIGRpcmVjdGl2ZSBpbiB5b3VyIHByb21wdCBzdWNoIGFzOiBcIlBsZWFzZSByZWFzb24gc3RlcCBieSBzdGVwLCBhbmQgcHV0IHlvdXIgZmluYWwgYW5zd2VyIHdpdGhpbiBcXGJveGVke30uXCJcbjQuIFdoZW4gZXZhbHVhdGluZyBtb2RlbCBwZXJmb3JtYW5jZSwgaXQgaXMgcmVjb21tZW5kZWQgdG8gY29uZHVjdCBtdWx0aXBsZSB0ZXN0cyBhbmQgYXZlcmFnZSB0aGUgcmVzdWx0cy5cblxuIyMgT3V0cHV0OlxuXG4qKk91dHB1dCBUeXBlKHMpOioqIFRleHQgPGJyPlxuKipPdXRwdXQgRm9ybWF0OioqIFN0cmluZyA8YnI+XG4qKk91dHB1dCBQYXJhbWV0ZXJzOioqICgxRCkgPGJyPlxuXG4jIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvbjpcblxuKipSdW50aW1lIEVuZ2luZShzKToqKiBUZW5zb3JSVC1MTE0gPGJyPlxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eToqKiBOVklESUEgQW1wZXJlLCBOVklESUEgQmxhY2t3ZWxsLCBOVklESUEgSmV0c29uLCBOVklESUEgSG9wcGVyLCBOVklESUEgTG92ZWxhY2UsIE5WSURJQSBQYXNjYWwsIE5WSURJQSBUdXJpbmcsIGFuZCBOVklESUEgVm9sdGEgYXJjaGl0ZWN0dXJlcyA8YnI+XG4qKltQcmVmZXJyZWQvU3VwcG9ydGVkXSBPcGVyYXRpbmcgU3lzdGVtKHMpOioqIExpbnV4XG5cbiMjIE1vZGVsIFZlcnNpb24ocyk6XG5cbkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtOEJcblxuIyBUcmFpbmluZywgVGVzdGluZywgYW5kIEV2YWx1YXRpb24gRGF0YXNldHM6XG5cbiMjIFRyYWluaW5nIERhdGFzZXQ6XG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZCA8YnI+XG4qKkxhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0OioqIEh5YnJpZDogSHVtYW4sIEF1dG9tYXRlZCA8YnI+XG5cbiMjIFRlc3RpbmcgRGF0YXNldDpcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkIDxicj5cbioqTGFiZWxpbmcgTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBIdW1hbiwgQXV0b21hdGVkIDxicj5cblxuIyMgRXZhbHVhdGlvbiBEYXRhc2V0OlxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWQgPGJyPlxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKiBIeWJyaWQ6IEh1bWFuLCBBdXRvbWF0ZWQgPGJyPlxuXG4jIyBJbmZlcmVuY2U6XG5cbioqRW5naW5lOioqIFRlbnNvclJULUxMTSA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogTlZJRElBIEhvcHBlclxuXG4jIyBFdGhpY2FsIENvbnNpZGVyYXRpb25zOlxuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuIyMgTW9kZWwgTGltaXRhdGlvbnM6XG5UaGUgYmFzZSBtb2RlbCB3YXMgdHJhaW5lZCBvbiBkYXRhIHRoYXQgY29udGFpbnMgdG94aWMgbGFuZ3VhZ2UgYW5kIHNvY2lldGFsIGJpYXNlcyBvcmlnaW5hbGx5IGNyYXdsZWQgZnJvbSB0aGUgaW50ZXJuZXQuIFRoZXJlZm9yZSwgdGhlIG1vZGVsIG1heSBhbXBsaWZ5IHRob3NlIGJpYXNlcyBhbmQgcmV0dXJuIHRveGljIHJlc3BvbnNlcyBlc3BlY2lhbGx5IHdoZW4gcHJvbXB0ZWQgd2l0aCB0b3hpYyBwcm9tcHRzLiBUaGUgbW9kZWwgbWF5IGdlbmVyYXRlIGFuc3dlcnMgdGhhdCBtYXkgYmUgaW5hY2N1cmF0ZSwgb21pdCBrZXkgaW5mb3JtYXRpb24sIG9yIGluY2x1ZGUgaXJyZWxldmFudCBvciByZWR1bmRhbnQgdGV4dCBwcm9kdWNpbmcgc29jaWFsbHkgdW5hY2NlcHRhYmxlIG9yIHVuZGVzaXJhYmxlIHRleHQsIGV2ZW4gaWYgdGhlIHByb21wdCBpdHNlbGYgZG9lcyBub3QgaW5jbHVkZSBhbnl0aGluZyBleHBsaWNpdGx5IG9mZmVuc2l2ZS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKioiLAogICAgImRpc3BsYXlOYW1lIjogIkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtOEIiLAogICAgImV4cGxhaW5hYmlsaXR5IjogIiIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtSDMxQy1QT0JQIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAicnVudGltZV9wYXJhbXNfcnR4X01TTDE2Mzg0IiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxNzYsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvZGVlcHNlZWstcjEtZGlzdGlsbC1sbGFtYS03MGIuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJOL0EiLAogICAgIm5hbWUiOiAiZGVlcHNlZWstcjEtZGlzdGlsbC1sbGFtYS04YiIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJOL0EiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJEZWVwU2Vlay1BSSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAiIiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIkRlZXBTZWVrLVIxLURpc3RpbGwtTGxhbWEtOEIgaXMgYSBkaXN0aWxsZWQgdmVyc2lvbiBvZiB0aGUgRGVlcFNlZWstUjEgc2VyaWVzLCBidWlsdCB1cG9uIHRoZSBMbGFtYTMuMS04Qi1JbnN0cnVjdCBhcmNoaXRlY3R1cmUuIFRoaXMgbW9kZWwgaXMgZGVzaWduZWQgdG8gZGVsaXZlciBlZmZpY2llbnQgcGVyZm9ybWFuY2UgZm9yIHJlYXNvbmluZywgbWF0aCwgYW5kIGNvZGUgdGFza3Mgd2hpbGUgbWFpbnRhaW5pbmcgaGlnaCBhY2N1cmFjeSIsCiAgICAidGVhbU5hbWUiOiAiZGVlcHNlZWstYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDItMjZUMjA6NTA6MDYuOTQ5WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/deepseek-ai/containers/deepseek-r1-distill-llama-8b optimizationProfiles: - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:l40sx1-throughput-fp8-vbqc0btoqg framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B L40Sx1 FP8 Throughput ngcMetadata: d968c663c710e56275088096bc0dcf823560aaf7dca910bfcb41f5056063ab02: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:h100x1-throughput-fp8-d9grrq-lka framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B H100x1 FP8 Throughput ngcMetadata: 0bdec027404c16d6ca96e159079082f9630a24a277ff519d0c8fea71007222ec: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:h100x2-latency-bf16-7ztok5r0dg framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B H100x2 BF16 Latency ngcMetadata: 0ce355335e6c3aec54e49ab53822e628fa1227091d0326da962bcc4f95b5f602: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:a10gx4-latency-bf16-aiejrysrlw framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B A10Gx4 BF16 Latency ngcMetadata: 1dfac8e12042573dc93536a393902478e1a6a46d1cd742cf0a4251c11f77e253: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '4' pp: '1' precision: bf16 profile: latency tp: '4' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 4 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 19GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:l40sx2-latency-fp8-fmuoxfbb0q framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B L40Sx2 FP8 Latency ngcMetadata: c2d4efce2d553c3aa78109b6d5dff0fd34b86bbb3b765aa8afdf12e9d13e8e83: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:h100x1-throughput-bf16-4jcstzx27q framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B H100x1 BF16 Throughput ngcMetadata: 4f6dba657c08280bdb419cbc1c60d265e82731b807ee2ae3c111cb9a91571aa1: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:h100x2-latency-fp8-q8xwzp22aa framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B H100x2 FP8 Latency ngcMetadata: 518edac01f731b63676743a1860fe21861d1399b19cb2e584de3d9a6a3ea6d8e: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 9GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:l40sx1-throughput-bf16-yvbnwvfzew framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B L40Sx1 BF16 Throughput ngcMetadata: 9bc8e8aa12847674fa2840b9c03cbdb0246d7f144a5257510fd53eacc2a9d62f: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:a100x1-throughput-bf16-iq9maz9nkw framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B A100x1 BF16 Throughput ngcMetadata: c959aa89b69ad9295ccc99a34546819d16bb0e2566a6cfed0985eecf37bcc14b: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 16GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:l40sx2-latency-bf16-tlmx3sgrdw framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B L40Sx2 BF16 Latency ngcMetadata: 20d6bb61a1ee5160c0baed3721f8b580525a0aaaaa3b1333e9a882d4c61b1ed7: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 17GB - profileId: nim/deepseek-ai/deepseek-r1-distill-llama-8b:a10gx2-throughput-bf16-uv8ptkf8-g framework: TensorRT-LLM displayName: Deepseek R1 Distill Llama 8B A10Gx2 BF16 Throughput ngcMetadata: edbb37d3ef94a5cc38919ab86694b835307c0668ca6d41ea746796b34ced78f1: model: deepseek-ai/deepseek-r1-distill-llama-8b release: 1.5.2 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: throughput tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 2 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.5.2 - key: DOWNLOAD SIZE value: 17GB labels: - Deepseek - Distill - Llama - Meta - Chat - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Llama 3.2 Instruct displayName: Llama 3.2 Instruct modelHubID: llama-3.2-instruct category: Language type: NGC description: Lightweight multilingual models optimized for dialogue, agentic retrieval, and summarization. Strong benchmark performance in a compact footprint. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3_2/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3_2/license/ modelVariants: - variantId: Llama 3.2 1B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0yNVQxNzo1NTo1Ni4wNDBaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyBNb2RlbCBJbmZvcm1hdGlvblxuXG5UaGUgTWV0YSBMbGFtYSAzLjIgY29sbGVjdGlvbiBvZiBtdWx0aWxpbmd1YWwgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzIChMTE1zKSBpcyBhIGNvbGxlY3Rpb24gb2YgcHJlLXRyYWluZWQgYW5kIGluc3RydWN0aW9uLXR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDFCIGFuZCAzQiBzaXplcyAodGV4dCBpbi90ZXh0IG91dCkuIFRoZSBMbGFtYSAzLjIgaW5zdHJ1Y3Rpb24tdHVuZWQgdGV4dCBvbmx5IG1vZGVscyBhcmUgb3B0aW1pemVkIGZvciBtdWx0aWxpbmd1YWwgZGlhbG9ndWUgdXNlIGNhc2VzLCBpbmNsdWRpbmcgYWdlbnRpYyByZXRyaWV2YWwgYW5kIHN1bW1hcml6YXRpb24gdGFza3MuIFRoZXkgb3V0cGVyZm9ybSBtYW55IG9mIHRoZSBhdmFpbGFibGUgb3BlbiBzb3VyY2UgYW5kIGNsb3NlZCBjaGF0IG1vZGVscyBvbiBjb21tb24gaW5kdXN0cnkgYmVuY2htYXJrcy4gXG5cbkxsYW1hIDMuMiBtb2RlbHMgYXJlIHJlYWR5IGZvciBjb21tZXJjaWFsIHVzZS5cblxuTW9kZWxzIGFyZSBhY2NlbGVyYXRlZCBieSBbVGVuc29yUlQtTExNXShodHRwczovL2dpdGh1Yi5jb20vTlZJRElBL1RlbnNvclJULUxMTSksIGEgbGlicmFyeSBmb3Igb3B0aW1pemluZyBMYXJnZSBMYW5ndWFnZSBNb2RlbCAoTExNKSBpbmZlcmVuY2Ugb24gTlZJRElBIEdQVXMuXG5cbioqTW9kZWxzIGluIHRoaXMgQ29sbGVjdGlvbjoqKiAgXG4tIExsYW1hLTMuMi0xQlxuLSBMbGFtYS0zLjItMUItSW5zdHJ1Y3Rcbi0gTGxhbWEtMy4yLTNCXG4tIExsYW1hLTMuMi0zQi1JbnN0cnVjdFxuXG4qKk1vZGVsIERldmVsb3BlcjoqKiBNZXRhXG5cbioqTW9kZWwgVmVyc2lvbjoqKiAzLjJcblxuKipNb2RlbCBSZWxlYXNlIERhdGU6KiogU2VwdGVtYmVyIDI1LCAyMDI0XG5cbioqVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb246KipcblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFtMbGFtYSAzLjIgTW9kZWwgQ2FyZF0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvbGxhbWEtbW9kZWxzL2Jsb2IvbWFpbi9tb2RlbHMvbGxhbWEzXzIvTU9ERUxfQ0FSRC5tZCkuXG5cbioqTGljZW5zZToqKiBVc2Ugb2YgTGxhbWEgMy4yIGlzIGdvdmVybmVkIGJ5IHRoZSBbTGxhbWEgMy4yIENvbW11bml0eSBMaWNlbnNlXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1tb2RlbHMvYmxvYi9tYWluL21vZGVscy9sbGFtYTNfMi9MSUNFTlNFKSAoYSBjdXN0b20sIGNvbW1lcmNpYWwgbGljZW5zZSBhZ3JlZW1lbnQpLlxuXG4qKk1vZGVsIEFyY2hpdGVjdHVyZToqKiBMbGFtYSAzLjIgaXMgYW4gYXV0by1yZWdyZXNzaXZlIGxhbmd1YWdlIG1vZGVsIHRoYXQgdXNlcyBhbiBvcHRpbWl6ZWQgdHJhbnNmb3JtZXIgYXJjaGl0ZWN0dXJlLiBUaGUgdHVuZWQgdmVyc2lvbnMgdXNlIHN1cGVydmlzZWQgZmluZS10dW5pbmcgKFNGVCkgYW5kIHJlaW5mb3JjZW1lbnQgbGVhcm5pbmcgd2l0aCBodW1hbiBmZWVkYmFjayAoUkxIRikgdG8gYWxpZ24gd2l0aCBodW1hbiBwcmVmZXJlbmNlcyBmb3IgaGVscGZ1bG5lc3MgYW5kIHNhZmV0eS4gXG5cbnwgIHwgVHJhaW5pbmcgRGF0YSB8IFBhcmFtcyB8IElucHV0IG1vZGFsaXRpZXMgfCBPdXRwdXQgbW9kYWxpdGllcyB8IENvbnRleHQgTGVuZ3RoIHwgR1FBIHwgU2hhcmVkIEVtYmVkZGluZ3MgfCBUb2tlbiBjb3VudCB8IEtub3dsZWRnZSBjdXRvZmYgfFxufCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8XG58IExsYW1hIDMuMiAodGV4dCBvbmx5KSAgfCBBIG5ldyBtaXggb2YgcHVibGljbHkgYXZhaWxhYmxlIG9ubGluZSBkYXRhLiB8IDFCICgxLjIzQikgfCBNdWx0aWxpbmd1YWwgVGV4dCB8IE11bHRpbGluZ3VhbCBUZXh0IGFuZCBjb2RlICB8IDEyOGsgfCBZZXMgfCBZZXMgfCBVcCB0byA5VCB0b2tlbnMgfCBEZWNlbWJlciAyMDIzIHxcbnwgIHwgIHwgM0IgKDMuMjFCKSB8IE11bHRpbGluZ3VhbCBUZXh0IHwgTXVsdGlsaW5ndWFsIFRleHQgYW5kIGNvZGUgIHwgIHwgIHwgIHwgIHwgIHxcblxuKipTdXBwb3J0ZWQgTGFuZ3VhZ2VzOioqIEVuZ2xpc2gsIEdlcm1hbiwgRnJlbmNoLCBJdGFsaWFuLCBQb3J0dWd1ZXNlLCBIaW5kaSwgU3BhbmlzaCwgYW5kIFRoYWkgYXJlIG9mZmljaWFsbHkgc3VwcG9ydGVkLiBMbGFtYSAzLjIgaGFzIGJlZW4gdHJhaW5lZCBvbiBhIGJyb2FkZXIgY29sbGVjdGlvbiBvZiBsYW5ndWFnZXMgdGhhbiB0aGVzZSA4IHN1cHBvcnRlZCBsYW5ndWFnZXMuIERldmVsb3BlcnMgbWF5IGZpbmUtdHVuZSBMbGFtYSAzLjIgbW9kZWxzIGZvciBsYW5ndWFnZXMgYmV5b25kIHRoZXNlIHN1cHBvcnRlZCBsYW5ndWFnZXMsIHByb3ZpZGVkIHRoZXkgY29tcGx5IHdpdGggdGhlIExsYW1hIDMuMiBDb21tdW5pdHkgTGljZW5zZSBhbmQgdGhlIEFjY2VwdGFibGUgVXNlIFBvbGljeS4gRGV2ZWxvcGVycyBhcmUgYWx3YXlzIGV4cGVjdGVkIHRvIGVuc3VyZSB0aGF0IHRoZWlyIGRlcGxveW1lbnRzLCBpbmNsdWRpbmcgdGhvc2UgdGhhdCBpbnZvbHZlIGFkZGl0aW9uYWwgbGFuZ3VhZ2VzLCBhcmUgY29tcGxldGVkIHNhZmVseSBhbmQgcmVzcG9uc2libHkuXG5cbioqTGxhbWEgMy4yIE1vZGVsIEZhbWlseToqKiBUb2tlbiBjb3VudHMgcmVmZXIgdG8gcHJlLXRyYWluaW5nIGRhdGEgb25seS4gQWxsIG1vZGVsIHZlcnNpb25zIHVzZSBHcm91cGVkLVF1ZXJ5IEF0dGVudGlvbiAoR1FBKSBmb3IgaW1wcm92ZWQgaW5mZXJlbmNlIHNjYWxhYmlsaXR5LlxuXG4qKlN0YXR1czoqKiBUaGlzIGlzIGEgc3RhdGljIG1vZGVsIHRyYWluZWQgb24gYW4gb2ZmbGluZSBkYXRhc2V0LiBGdXR1cmUgdmVyc2lvbnMgbWF5IGJlIHJlbGVhc2VkIHRoYXQgaW1wcm92ZSBtb2RlbCBjYXBhYmlsaXRpZXMgYW5kIHNhZmV0eS4gXG5cbioqRmVlZGJhY2s6KiogV2hlcmUgdG8gc2VuZCBxdWVzdGlvbnMgb3IgY29tbWVudHMgYWJvdXQgdGhlIG1vZGVsIEluc3RydWN0aW9ucyBvbiBob3cgdG8gcHJvdmlkZSBmZWVkYmFjayBvciBjb21tZW50cyBvbiB0aGUgbW9kZWwgY2FuIGJlIGZvdW5kIGluIHRoZSBtb2RlbCBbUkVBRE1FXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1tb2RlbHMvdHJlZS9tYWluL21vZGVscy9sbGFtYTNfMikuIEZvciBtb3JlIHRlY2huaWNhbCBpbmZvcm1hdGlvbiBhYm91dCBnZW5lcmF0aW9uIHBhcmFtZXRlcnMgYW5kIHJlY2lwZXMgZm9yIGhvdyB0byB1c2UgTGxhbWEgMy4yIGluIGFwcGxpY2F0aW9ucywgcGxlYXNlIGdvIFtoZXJlXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1yZWNpcGVzKS4gXG5cbiMjIEludGVuZGVkIFVzZVxuXG4qKkludGVuZGVkIFVzZSBDYXNlczoqKiBMbGFtYSAzLjIgaXMgaW50ZW5kZWQgZm9yIGNvbW1lcmNpYWwgYW5kIHJlc2VhcmNoIHVzZSBpbiBtdWx0aXBsZSBsYW5ndWFnZXMuIEluc3RydWN0aW9uIHR1bmVkIHRleHQgb25seSBtb2RlbHMgYXJlIGludGVuZGVkIGZvciBhc3Npc3RhbnQtbGlrZSBjaGF0IGFuZCBhZ2VudGljIGFwcGxpY2F0aW9ucyBsaWtlIGtub3dsZWRnZSByZXRyaWV2YWwgYW5kIHN1bW1hcml6YXRpb24sIG1vYmlsZSBBSSBwb3dlcmVkIHdyaXRpbmcgYXNzaXN0YW50cyBhbmQgcXVlcnkgYW5kIHByb21wdCByZXdyaXRpbmcuIFByZS10cmFpbmVkIG1vZGVscyBjYW4gYmUgYWRhcHRlZCBmb3IgYSB2YXJpZXR5IG9mIGFkZGl0aW9uYWwgbmF0dXJhbCBsYW5ndWFnZSBnZW5lcmF0aW9uIHRhc2tzLiBcblxuKipPdXQgb2YgU2NvcGU6KiogVXNlIGluIGFueSBtYW5uZXIgdGhhdCB2aW9sYXRlcyBhcHBsaWNhYmxlIGxhd3Mgb3IgcmVndWxhdGlvbnMgKGluY2x1ZGluZyB0cmFkZSBjb21wbGlhbmNlIGxhd3MpLiBVc2UgaW4gYW55IG90aGVyIHdheSB0aGF0IGlzIHByb2hpYml0ZWQgYnkgdGhlIEFjY2VwdGFibGUgVXNlIFBvbGljeSBhbmQgTGxhbWEgMy4yIENvbW11bml0eSBMaWNlbnNlLiBVc2UgaW4gbGFuZ3VhZ2VzIGJleW9uZCB0aG9zZSBleHBsaWNpdGx5IHJlZmVyZW5jZWQgYXMgc3VwcG9ydGVkIGluIHRoaXMgbW9kZWwgY2FyZC5cblxuIyMgU29mdHdhcmUgSW50ZWdyYXRpb25cblxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eToqKlxuLSBOVklESUEgQW1wZXJlXG4tIE5WSURJQSBIb3BwZXJcbi0gTlZJRElBIExvdmVsYWNlXG4tIE5WSURJQSBKZXRzb25cblxuKipTdXBwb3J0ZWQgT3BlcmF0aW5nIFN5c3RlbShzKToqKlxuLSBMaW51eCBcbi0gV2luZG93c1xuXG4jIyBIYXJkd2FyZSBhbmQgU29mdHdhcmVcblxuKipUcmFpbmluZyBGYWN0b3JzOioqIFdlIHVzZWQgY3VzdG9tIHRyYWluaW5nIGxpYnJhcmllcywgTWV0YSdzIGN1c3RvbSBidWlsdCBHUFUgY2x1c3RlciwgYW5kIHByb2R1Y3Rpb24gaW5mcmFzdHJ1Y3R1cmUgZm9yIHByZS10cmFpbmluZy4gRmluZS10dW5pbmcsIGFubm90YXRpb24sIGFuZCBldmFsdWF0aW9uIHdlcmUgYWxzbyBwZXJmb3JtZWQgb24gcHJvZHVjdGlvbiBpbmZyYXN0cnVjdHVyZS5cblxuKipUcmFpbmluZyBFbmVyZ3kgVXNlOioqIFRyYWluaW5nIHV0aWxpemVkIGEgY3VtdWxhdGl2ZSBvZiAqKjkxNmsqKiBHUFUgaG91cnMgb2YgY29tcHV0YXRpb24gb24gSDEwMC04MEdCIChURFAgb2YgNzAwVykgdHlwZSBoYXJkd2FyZSwgcGVyIHRoZSB0YWJsZSBiZWxvdy4gVHJhaW5pbmcgdGltZSBpcyB0aGUgdG90YWwgR1BVIHRpbWUgcmVxdWlyZWQgZm9yIHRyYWluaW5nIGVhY2ggbW9kZWwgYW5kIHBvd2VyIGNvbnN1bXB0aW9uIGlzIHRoZSBwZWFrIHBvd2VyIGNhcGFjaXR5IHBlciBHUFUgZGV2aWNlIHVzZWQsIGFkanVzdGVkIGZvciBwb3dlciB1c2FnZSBlZmZpY2llbmN5LiBcblxuIyMgXG5cbioqVHJhaW5pbmcgR3JlZW5ob3VzZSBHYXMgRW1pc3Npb25zOioqIEVzdGltYXRlZCB0b3RhbCBsb2NhdGlvbi1iYXNlZCBncmVlbmhvdXNlIGdhcyBlbWlzc2lvbnMgd2VyZSAqKjI0MCoqIHRvbnMgQ08yZXEgZm9yIHRyYWluaW5nLiBTaW5jZSAyMDIwLCBNZXRhIGhhcyBtYWludGFpbmVkIG5ldCB6ZXJvIGdyZWVuaG91c2UgZ2FzIGVtaXNzaW9ucyBpbiBpdHMgZ2xvYmFsIG9wZXJhdGlvbnMgYW5kIG1hdGNoZWQgMTAwJSBvZiBpdHMgZWxlY3RyaWNpdHkgdXNlIHdpdGggcmVuZXdhYmxlIGVuZXJneTsgdGhlcmVmb3JlLCB0aGUgdG90YWwgbWFya2V0LWJhc2VkIGdyZWVuaG91c2UgZ2FzIGVtaXNzaW9ucyBmb3IgdHJhaW5pbmcgd2VyZSAwIHRvbnMgQ08yZXEuXG5cbnwgIHwgVHJhaW5pbmcgVGltZSAoR1BVIGhvdXJzKSB8IExvZ2l0IEdlbmVyYXRpb24gVGltZSAoR1BVIEhvdXJzKSB8IFRyYWluaW5nIFBvd2VyIENvbnN1bXB0aW9uIChXKSB8IFRyYWluaW5nIExvY2F0aW9uLUJhc2VkIEdyZWVuaG91c2UgR2FzIEVtaXNzaW9ucyAodG9ucyBDTzJlcSkgfCBUcmFpbmluZyBNYXJrZXQtQmFzZWQgR3JlZW5ob3VzZSBHYXMgRW1pc3Npb25zICh0b25zIENPMmVxKSB8XG58IDotLS0tIHwgOi0tLTogfCAtLS0tLSB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8XG58IExsYW1hLTMuMi0xQiB8IDM3MGsgfCBcXC0gfCA3MDAgfCAxMDcgfCAwIHxcbnwgTGxhbWEtMy4yLTNCIHwgNDYwayB8IFxcLSB8IDcwMCB8IDEzMyB8IDAgfFxufCBUb3RhbCB8IDgzMGsgfCAgICAgICAgIDg2ayB8ICB8IDI0MCB8IDAgfFxuXG5UaGUgbWV0aG9kb2xvZ3kgdXNlZCB0byBkZXRlcm1pbmUgdHJhaW5pbmcgZW5lcmd5IHVzZSBhbmQgZ3JlZW5ob3VzZSBnYXMgZW1pc3Npb25zIGNhbiBiZSBmb3VuZCBbaGVyZV0oaHR0cHM6Ly9hcnhpdi5vcmcvcGRmLzIyMDQuMDUxNDkpLiBTaW5jZSBNZXRhIGlzIG9wZW5seSByZWxlYXNpbmcgdGhlc2UgbW9kZWxzLCB0aGUgdHJhaW5pbmcgZW5lcmd5IHVzZSBhbmQgZ3JlZW5ob3VzZSBnYXMgZW1pc3Npb25zIHdpbGwgbm90IGJlIGluY3VycmVkIGJ5IG90aGVycy5cblxuIyMgVHJhaW5pbmcgRGF0YVxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2Q6KiogVW5rbm93biAgXG4qKkxhYmVsaW5nIE1ldGhvZDoqKiBVbmtub3duXG5cbioqT3ZlcnZpZXc6KiogTGxhbWEgMy4yIHdhcyBwcmUtdHJhaW5lZCBvbiB1cCB0byA5IHRyaWxsaW9uIHRva2VucyBvZiBkYXRhIGZyb20gcHVibGljbHkgYXZhaWxhYmxlIHNvdXJjZXMuIEZvciB0aGUgMUIgYW5kIDNCIExsYW1hIDMuMiBtb2RlbHMsIHdlIGluY29ycG9yYXRlZCBsb2dpdHMgZnJvbSB0aGUgTGxhbWEgMy4xIDhCIGFuZCA3MEIgbW9kZWxzIGludG8gdGhlIHByZS10cmFpbmluZyBzdGFnZSBvZiB0aGUgbW9kZWwgZGV2ZWxvcG1lbnQsIHdoZXJlIG91dHB1dHMgKGxvZ2l0cykgZnJvbSB0aGVzZSBsYXJnZXIgbW9kZWxzIHdlcmUgdXNlZCBhcyB0b2tlbi1sZXZlbCB0YXJnZXRzLiBLbm93bGVkZ2UgZGlzdGlsbGF0aW9uIHdhcyB1c2VkIGFmdGVyIHBydW5pbmcgdG8gcmVjb3ZlciBwZXJmb3JtYW5jZS4gSW4gcG9zdC10cmFpbmluZyB3ZSB1c2VkIGEgc2ltaWxhciByZWNpcGUgYXMgTGxhbWEgMy4xIGFuZCBwcm9kdWNlZCBmaW5hbCBjaGF0IG1vZGVscyBieSBkb2luZyBzZXZlcmFsIHJvdW5kcyBvZiBhbGlnbm1lbnQgb24gdG9wIG9mIHRoZSBwcmUtdHJhaW5lZCBtb2RlbC4gRWFjaCByb3VuZCBpbnZvbHZlZCBTdXBlcnZpc2VkIEZpbmUtVHVuaW5nIChTRlQpLCBSZWplY3Rpb24gU2FtcGxpbmcgKFJTKSwgYW5kIERpcmVjdCBQcmVmZXJlbmNlIE9wdGltaXphdGlvbiAoRFBPKS5cblxuKipEYXRhIEZyZXNobmVzczoqKiBUaGUgcHJlLXRyYWluaW5nIGRhdGEgaGFzIGEgY3V0b2ZmIG9mIERlY2VtYmVyIDIwMjMuXG5cbiMjIEJlbmNobWFya3MgXFwtIEVuZ2xpc2ggVGV4dFxuXG5JbiB0aGlzIHNlY3Rpb24sIHdlIHJlcG9ydCB0aGUgcmVzdWx0cyBmb3IgTGxhbWEgMy4yIG1vZGVscyBvbiBzdGFuZGFyZCBhdXRvbWF0aWMgYmVuY2htYXJrcy4gRm9yIGFsbCB0aGVzZSBldmFsdWF0aW9ucywgd2UgdXNlZCBvdXIgaW50ZXJuYWwgZXZhbHVhdGlvbnMgbGlicmFyeS4gXG5cbiMjIyBCYXNlIFByZS10cmFpbmVkIE1vZGVscyBcblxufCBDYXRlZ29yeSB8IEJlbmNobWFyayB8IFxcIyBTaG90cyB8IE1ldHJpYyB8IExsYW1hLTMuMi0xQiB8IExsYW1hLTMuMi0zQiB8IExsYW1hLTMuMS04QiB8XG58IC0tLS0tIHwgLS0tLS0gfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHxcbnwgR2VuZXJhbCB8IE1NTFUgfCA1IHwgbWFjcm9cXF9hdmcvYWNjXFxfY2hhciB8IDMyLjIgfCA1OCB8IDY2LjcgfFxufCAgfCBBR0lFdmFsIEVuZ2xpc2ggfCAzLTUgfCBhdmVyYWdlL2FjY1xcX2NoYXIgfCAyMy4zIHwgMzkuMiB8IDQ3LjggfFxufCAgfCBBUkMtQ2hhbGxlbmdlIHwgMjUgfCBhY2NcXF9jaGFyIHwgMzIuOCB8IDY5LjEgfCA3OS43IHxcbnwgUmVhZGluZyBjb21wcmVoZW5zaW9uIHwgU1F1QUQgfCAxIHwgZW0gfCA0OS4yIHwgNjcuNyB8IDc3IHxcbnwgIHwgUXVBQyAoRjEpIHwgMSB8IGYxIHwgMzcuOSB8IDQyLjkgfCA0NC45IHxcbnwgIHwgRFJPUCAoRjEpIHwgMyB8IGYxIHwgMjguMCB8IDQ1LjIgfCA1OS41IHxcbnwgTG9uZyBDb250ZXh0IHwgTmVlZGxlIGluIEhheXN0YWNrIHwgMCB8IGVtIHwgOTYuOCB8IDEgfCAxIHxcblxuIyMjIEluc3RydWN0aW9uLVR1bmVkIE1vZGVsc1xuXG58IENhcGFiaWxpdHkgfCAgfCBCZW5jaG1hcmsgfCBcXCMgU2hvdHMgfCBNZXRyaWMgfCBMbGFtYS0zLjItMUItSW5zdHJ1Y3QgfCBMbGFtYS0zLjItM0ItSW5zdHJ1Y3QgfCBMbGFtYS0zLjEtOEItSW5zdHJ1Y3QgfFxufCA6LS0tOiB8IC0tLS0tIHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHxcbnwgR2VuZXJhbCB8ICB8IE1NTFUgfCA1IHwgbWFjcm9cXF9hdmcvYWNjIHwgNDkuMyB8IDYzLjQgfCA2OS40IHxcbnwgUmUtd3JpdGluZyB8ICB8IE9wZW4tcmV3cml0ZSBldmFsIHwgMCB8IG1pY3JvXFxfYXZnL3JvdWdlTCB8IDQxLjYgfCA0MC4xIHwgNDAuOSB8XG58IFN1bW1hcml6YXRpb24gfCAgfCBUTERSOSsgKHRlc3QpIHwgMSB8IHJvdWdlTCB8IDE2LjggfCAxOS4wIHwgMTcuMiB8XG58IEluc3RydWN0aW9uIGZvbGxvd2luZyB8ICB8IElGRXZhbCB8IDAgfCBBdmcoUHJvbXB0L0luc3RydWN0aW9uIGFjYyBMb29zZS9TdHJpY3QpIHwgNTkuNSB8IDc3LjQgfCA4MC40IHxcbnwgTWF0aCB8ICB8IEdTTThLIChDb1QpIHwgOCB8IGVtXFxfbWFqMUAxIHwgNDQuNCB8IDc3LjcgfCA4NC41IHxcbnwgIHwgIHwgTUFUSCAoQ29UKSB8IDAgfCBmaW5hbFxcX2VtIHwgMzAuNiB8IDQ4LjAgfCA1MS45IHxcbnwgUmVhc29uaW5nIHwgIHwgQVJDLUMgfCAwIHwgYWNjIHwgNTkuNCB8IDc4LjYgfCA4My40IHxcbnwgIHwgIHwgR1BRQSB8IDAgfCBhY2MgfCAyNy4yIHwgMzIuOCB8IDMyLjggfFxufCAgfCAgfCBIZWxsYXN3YWcgfCAwIHwgYWNjIHwgNDEuMiB8IDY5LjggfCA3OC43IHxcbnwgVG9vbCBVc2UgfCAgfCBCRkNMIFYyIHwgMCB8IGFjYyB8IDI1LjcgfCA2Ny4wIHwgNjcuMSB8XG58ICB8ICB8IE5leHVzIHwgMCB8IG1hY3JvXFxfYXZnL2FjYyB8IDEzLjUgfCAzNC4zIHwgMzguNSB8XG58IExvbmcgQ29udGV4dCB8ICB8IEluZmluaXRlQmVuY2gvRW4uUUEgfCAwIHwgbG9uZ2Jvb2tcXF9xYS9mMSB8IDIwLjMgfCAxOS44IHwgMjcuMyB8XG58ICB8ICB8IEluZmluaXRlQmVuY2gvRW4uTUMgfCAwIHwgbG9uZ2Jvb2tcXF9jaG9pY2UvYWNjIHwgMzguMCB8IDYzLjMgfCA3Mi4yIHxcbnwgIHwgIHwgTklIL011bHRpLW5lZWRsZSB8IDAgfCByZWNhbGwgfCA3NS4wIHwgODQuNyB8IDk4LjggfFxufCBNdWx0aWxpbmd1YWwgfCAgfCBNR1NNIChDb1QpIHwgMCB8IGVtIHwgMjQuNSB8IDU4LjIgfCA2OC45IHxcblxuIyMjIE11bHRpbGluZ3VhbCBCZW5jaG1hcmtzXG5cbnwgQ2F0ZWdvcnkgfCBCZW5jaG1hcmsgfCBMYW5ndWFnZSB8IExsYW1hLTMuMi0xQi1JbnN0cnVjdCB8IExsYW1hLTMuMi0zQi1JbnN0cnVjdCB8IExsYW1hLTMuMS04Qi1JbnN0cnVjdCB8XG58IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8XG58IEdlbmVyYWwgfCBNTUxVICg1LXNob3QsIG1hY3JvXFxfYXZnL2FjYykgfCBQb3J0dWd1ZXNlIHwgMzkuODIgfCA1NC40OCB8IDYyLjEyIHxcbnwgIHwgIHwgU3BhbmlzaCB8IDQxLjUyIHwgNTUuMDkgfCA2Mi40NSB8XG58ICB8ICB8IEl0YWxpYW4gfCAzOS43OSB8IDUzLjc3IHwgNjEuNjMgfFxufCAgfCAgfCBHZXJtYW4gfCAzOS4yMCB8IDUzLjI5IHwgNjAuNTkgfFxufCAgfCAgfCBGcmVuY2ggfCA0MC40NyB8IDU0LjU5IHwgNjIuMzQgfFxufCAgfCAgfCBIaW5kaSB8IDMzLjUxIHwgNDMuMzEgfCA1MC44OCB8XG58ICB8ICB8IFRoYWkgfCAzNC42NyB8IDQ0LjU0IHwgNTAuMzIgfFxuXG5cbiMjIFJlc3BvbnNpYmlsaXR5ICYgU2FmZXR5XG5cbkFzIHBhcnQgb2Ygb3VyIFJlc3BvbnNpYmxlIHJlbGVhc2UgYXBwcm9hY2gsIHdlIGZvbGxvd2VkIGEgdGhyZWUtcHJvbmdlZCBzdHJhdGVneSB0byBtYW5hZ2luZyB0cnVzdCAmIHNhZmV0eSByaXNrczpcblxuMS4gRW5hYmxlIGRldmVsb3BlcnMgdG8gZGVwbG95IGhlbHBmdWwsIHNhZmUgYW5kIGZsZXhpYmxlIGV4cGVyaWVuY2VzIGZvciB0aGVpciB0YXJnZXQgYXVkaWVuY2UgYW5kIGZvciB0aGUgdXNlIGNhc2VzIHN1cHBvcnRlZCBieSBMbGFtYSAgIFxuMi4gUHJvdGVjdCBkZXZlbG9wZXJzIGFnYWluc3QgYWR2ZXJzYXJpYWwgdXNlcnMgYWltaW5nIHRvIGV4cGxvaXQgTGxhbWEgY2FwYWJpbGl0aWVzIHRvIHBvdGVudGlhbGx5IGNhdXNlIGhhcm0gIFxuMy4gUHJvdmlkZSBwcm90ZWN0aW9ucyBmb3IgdGhlIGNvbW11bml0eSB0byBoZWxwIHByZXZlbnQgdGhlIG1pc3VzZSBvZiBvdXIgbW9kZWxzXG5cbiMjIyBSZXNwb25zaWJsZSBEZXBsb3ltZW50IFxuXG4qKkFwcHJvYWNoOioqIExsYW1hIGlzIGEgZm91bmRhdGlvbmFsIHRlY2hub2xvZ3kgZGVzaWduZWQgdG8gYmUgdXNlZCBpbiBhIHZhcmlldHkgb2YgdXNlIGNhc2VzLiBFeGFtcGxlcyBvbiBob3cgTWV0YVx1MjAxOXMgTGxhbWEgbW9kZWxzIGhhdmUgYmVlbiByZXNwb25zaWJseSBkZXBsb3llZCBjYW4gYmUgZm91bmQgaW4gb3VyIFtDb21tdW5pdHkgU3RvcmllcyB3ZWJwYWdlXShodHRwczovL2xsYW1hLm1ldGEuY29tL2NvbW11bml0eS1zdG9yaWVzLykuIE91ciBhcHByb2FjaCBpcyB0byBidWlsZCB0aGUgbW9zdCBoZWxwZnVsIG1vZGVscywgZW5hYmxpbmcgdGhlIHdvcmxkIHRvIGJlbmVmaXQgZnJvbSB0aGUgdGVjaG5vbG9neSBwb3dlciwgYnkgYWxpZ25pbmcgb3VyIG1vZGVsIHNhZmV0eSBmb3IgZ2VuZXJpYyB1c2UgY2FzZXMgYW5kIGFkZHJlc3NpbmcgYSBzdGFuZGFyZCBzZXQgb2YgaGFybXMuIERldmVsb3BlcnMgYXJlIHRoZW4gaW4gdGhlIGRyaXZlclx1MjAxOXMgc2VhdCB0byB0YWlsb3Igc2FmZXR5IGZvciB0aGVpciB1c2UgY2FzZXMsIGRlZmluaW5nIHRoZWlyIG93biBwb2xpY2llcyBhbmQgZGVwbG95aW5nIHRoZSBtb2RlbHMgd2l0aCB0aGUgbmVjZXNzYXJ5IHNhZmVndWFyZHMgaW4gdGhlaXIgTGxhbWEgc3lzdGVtcy4gTGxhbWEgMy4yIHdhcyBkZXZlbG9wZWQgZm9sbG93aW5nIHRoZSBiZXN0IHByYWN0aWNlcyBvdXRsaW5lZCBpbiBvdXIgW1Jlc3BvbnNpYmxlIFVzZSBHdWlkZV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9yZXNwb25zaWJsZS11c2UtZ3VpZGUvKS4gXG5cbiMjIyMgTGxhbWEgMy4yIEluc3RydWN0IFxuXG4qKk9iamVjdGl2ZToqKiBPdXIgbWFpbiBvYmplY3RpdmVzIGZvciBjb25kdWN0aW5nIHNhZmV0eSBmaW5lLXR1bmluZyBhcmUgdG8gcHJvdmlkZSB0aGUgcmVzZWFyY2ggY29tbXVuaXR5IHdpdGggYSB2YWx1YWJsZSByZXNvdXJjZSBmb3Igc3R1ZHlpbmcgdGhlIHJvYnVzdG5lc3Mgb2Ygc2FmZXR5IGZpbmUtdHVuaW5nLCBhcyB3ZWxsIGFzIHRvIG9mZmVyIGRldmVsb3BlcnMgYSByZWFkaWx5IGF2YWlsYWJsZSwgc2FmZSwgYW5kIHBvd2VyZnVsIG1vZGVsIGZvciB2YXJpb3VzIGFwcGxpY2F0aW9ucyB0byByZWR1Y2UgdGhlIGRldmVsb3BlciB3b3JrbG9hZCB0byBkZXBsb3kgc2FmZSBBSSBzeXN0ZW1zLiBXZSBpbXBsZW1lbnRlZCB0aGUgc2FtZSBzZXQgb2Ygc2FmZXR5IG1pdGlnYXRpb25zIGFzIGluIExsYW1hIDMsIGFuZCB5b3UgY2FuIGxlYXJuIG1vcmUgYWJvdXQgdGhlc2UgaW4gdGhlIExsYW1hIDMgW3BhcGVyXShodHRwczovL2FpLm1ldGEuY29tL3Jlc2VhcmNoL3B1YmxpY2F0aW9ucy90aGUtbGxhbWEtMy1oZXJkLW9mLW1vZGVscy8pLiBcblxuKipGaW5lLVR1bmluZyBEYXRhOioqIFdlIGVtcGxveSBhIG11bHRpLWZhY2V0ZWQgYXBwcm9hY2ggdG8gZGF0YSBjb2xsZWN0aW9uLCBjb21iaW5pbmcgaHVtYW4tZ2VuZXJhdGVkIGRhdGEgZnJvbSBvdXIgdmVuZG9ycyB3aXRoIHN5bnRoZXRpYyBkYXRhIHRvIG1pdGlnYXRlIHBvdGVudGlhbCBzYWZldHkgcmlza3MuIFdlXHUyMDE5dmUgZGV2ZWxvcGVkIG1hbnkgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgKExMTSktYmFzZWQgY2xhc3NpZmllcnMgdGhhdCBlbmFibGUgdXMgdG8gdGhvdWdodGZ1bGx5IHNlbGVjdCBoaWdoLXF1YWxpdHkgcHJvbXB0cyBhbmQgcmVzcG9uc2VzLCBlbmhhbmNpbmcgZGF0YSBxdWFsaXR5IGNvbnRyb2wuIFxuXG4qKlJlZnVzYWxzIGFuZCBUb25lOioqIEJ1aWxkaW5nIG9uIHRoZSB3b3JrIHdlIHN0YXJ0ZWQgd2l0aCBMbGFtYSAzLCB3ZSBwdXQgYSBncmVhdCBlbXBoYXNpcyBvbiBtb2RlbCByZWZ1c2FscyB0byBiZW5pZ24gcHJvbXB0cyBhcyB3ZWxsIGFzIHJlZnVzYWwgdG9uZS4gV2UgaW5jbHVkZWQgYm90aCBib3JkZXJsaW5lIGFuZCBhZHZlcnNhcmlhbCBwcm9tcHRzIGluIG91ciBzYWZldHkgZGF0YSBzdHJhdGVneSwgYW5kIG1vZGlmaWVkIG91ciBzYWZldHkgZGF0YSByZXNwb25zZXMgdG8gZm9sbG93IHRvbmUgZ3VpZGVsaW5lcy4gXG5cbiMjIyMgTGxhbWEgMy4yIFN5c3RlbXNcblxuKipTYWZldHkgYXMgYSBTeXN0ZW06KiogTGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzLCBpbmNsdWRpbmcgTGxhbWEgMy4yLCAqKmFyZSBub3QgZGVzaWduZWQgdG8gYmUgZGVwbG95ZWQgaW4gaXNvbGF0aW9uKiogYnV0IGluc3RlYWQgc2hvdWxkIGJlIGRlcGxveWVkIGFzIHBhcnQgb2YgYW4gb3ZlcmFsbCBBSSBzeXN0ZW0gd2l0aCBhZGRpdGlvbmFsIHNhZmV0eSBndWFyZHJhaWxzIGFzIHJlcXVpcmVkLiBEZXZlbG9wZXJzIGFyZSBleHBlY3RlZCB0byBkZXBsb3kgc3lzdGVtIHNhZmVndWFyZHMgd2hlbiBidWlsZGluZyBhZ2VudGljIHN5c3RlbXMuIFNhZmVndWFyZHMgYXJlIGtleSB0byBhY2hpZXZlIHRoZSByaWdodCBoZWxwZnVsbmVzcy1zYWZldHkgYWxpZ25tZW50IGFzIHdlbGwgYXMgbWl0aWdhdGluZyBzYWZldHkgYW5kIHNlY3VyaXR5IHJpc2tzIGluaGVyZW50IHRvIHRoZSBzeXN0ZW0gYW5kIGFueSBpbnRlZ3JhdGlvbiBvZiB0aGUgbW9kZWwgb3Igc3lzdGVtIHdpdGggZXh0ZXJuYWwgdG9vbHMuIEFzIHBhcnQgb2Ygb3VyIHJlc3BvbnNpYmxlIHJlbGVhc2UgYXBwcm9hY2gsIHdlIHByb3ZpZGUgdGhlIGNvbW11bml0eSB3aXRoIFtzYWZlZ3VhcmRzXShodHRwczovL2xsYW1hLm1ldGEuY29tL3RydXN0LWFuZC1zYWZldHkvKSB0aGF0IGRldmVsb3BlcnMgc2hvdWxkIGRlcGxveSB3aXRoIExsYW1hIG1vZGVscyBvciBvdGhlciBMTE1zLCBpbmNsdWRpbmcgTGxhbWEgR3VhcmQsIFByb21wdCBHdWFyZCBhbmQgQ29kZSBTaGllbGQuIEFsbCBvdXIgW3JlZmVyZW5jZSBpbXBsZW1lbnRhdGlvbnNdKGh0dHBzOi8vZ2l0aHViLmNvbS9tZXRhLWxsYW1hL2xsYW1hLWFnZW50aWMtc3lzdGVtKSBkZW1vcyBjb250YWluIHRoZXNlIHNhZmVndWFyZHMgYnkgZGVmYXVsdCBzbyBkZXZlbG9wZXJzIGNhbiBiZW5lZml0IGZyb20gc3lzdGVtLWxldmVsIHNhZmV0eSBvdXQtb2YtdGhlLWJveC4gXG5cbiMjIyBOZXcgQ2FwYWJpbGl0aWVzIGFuZCBVc2UgQ2FzZXNcblxuKipUZWNobm9sb2dpY2FsIEFkdmFuY2VtZW50OioqIExsYW1hIHJlbGVhc2VzIHVzdWFsbHkgaW50cm9kdWNlIG5ldyBjYXBhYmlsaXRpZXMgdGhhdCByZXF1aXJlIHNwZWNpZmljIGNvbnNpZGVyYXRpb25zIGluIGFkZGl0aW9uIHRvIHRoZSBiZXN0IHByYWN0aWNlcyB0aGF0IGdlbmVyYWxseSBhcHBseSBhY3Jvc3MgYWxsIEdlbmVyYXRpdmUgQUkgdXNlIGNhc2VzLiBGb3IgcHJpb3IgcmVsZWFzZSBjYXBhYmlsaXRpZXMgYWxzbyBzdXBwb3J0ZWQgYnkgTGxhbWEgMy4yLCBzZWUgW0xsYW1hIDMuMSBNb2RlbCBDYXJkXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1tb2RlbHMvYmxvYi9tYWluL21vZGVscy9sbGFtYTNfMS9NT0RFTF9DQVJELm1kKSwgYXMgdGhlIHNhbWUgY29uc2lkZXJhdGlvbnMgYXBwbHkgaGVyZSBhcyB3ZWxsLlxuXG4qKkNvbnN0cmFpbmVkIEVudmlyb25tZW50czoqKiBMbGFtYSAzLjIgMUIgYW5kIDNCIG1vZGVscyBhcmUgZXhwZWN0ZWQgdG8gYmUgZGVwbG95ZWQgaW4gaGlnaGx5IGNvbnN0cmFpbmVkIGVudmlyb25tZW50cywgc3VjaCBhcyBtb2JpbGUgZGV2aWNlcy4gTExNIFN5c3RlbXMgdXNpbmcgc21hbGxlciBtb2RlbHMgd2lsbCBoYXZlIGEgZGlmZmVyZW50IGFsaWdubWVudCBwcm9maWxlIGFuZCBzYWZldHkvaGVscGZ1bG5lc3MgdHJhZGVvZmYgdGhhbiBtb3JlIGNvbXBsZXgsIGxhcmdlciBzeXN0ZW1zLiBEZXZlbG9wZXJzIHNob3VsZCBlbnN1cmUgdGhlIHNhZmV0eSBvZiB0aGVpciBzeXN0ZW0gbWVldHMgdGhlIHJlcXVpcmVtZW50cyBvZiB0aGVpciB1c2UgY2FzZS4gV2UgcmVjb21tZW5kIHVzaW5nIGxpZ2h0ZXIgc3lzdGVtIHNhZmVndWFyZHMgZm9yIHN1Y2ggdXNlIGNhc2VzLCBsaWtlIExsYW1hIEd1YXJkIDMtMUIgb3IgaXRzIG1vYmlsZS1vcHRpbWl6ZWQgdmVyc2lvbi4gXG5cbiMjIyBFdmFsdWF0aW9uc1xuXG4qKlNjYWxlZCBFdmFsdWF0aW9uczoqKiBXZSBidWlsdCBkZWRpY2F0ZWQsIGFkdmVyc2FyaWFsIGV2YWx1YXRpb24gZGF0YXNldHMgYW5kIGV2YWx1YXRlZCBzeXN0ZW1zIGNvbXBvc2VkIG9mIExsYW1hIG1vZGVscyBhbmQgUHVycGxlIExsYW1hIHNhZmVndWFyZHMgdG8gZmlsdGVyIGlucHV0IHByb21wdCBhbmQgb3V0cHV0IHJlc3BvbnNlLiBJdCBpcyBpbXBvcnRhbnQgdG8gZXZhbHVhdGUgYXBwbGljYXRpb25zIGluIGNvbnRleHQsIGFuZCB3ZSByZWNvbW1lbmQgYnVpbGRpbmcgZGVkaWNhdGVkIGV2YWx1YXRpb24gZGF0YXNldCBmb3IgeW91ciB1c2UgY2FzZS5cblxuKipSZWQgVGVhbWluZzoqKiBXZSBjb25kdWN0ZWQgcmVjdXJyaW5nIHJlZCB0ZWFtaW5nIGV4ZXJjaXNlcyB3aXRoIHRoZSBnb2FsIG9mIGRpc2NvdmVyaW5nIHJpc2tzIHZpYSBhZHZlcnNhcmlhbCBwcm9tcHRpbmcgYW5kIHdlIHVzZWQgdGhlIGxlYXJuaW5ncyB0byBpbXByb3ZlIG91ciBiZW5jaG1hcmtzIGFuZCBzYWZldHkgdHVuaW5nIGRhdGFzZXRzLiBXZSBwYXJ0bmVyZWQgZWFybHkgd2l0aCBzdWJqZWN0LW1hdHRlciBleHBlcnRzIGluIGNyaXRpY2FsIHJpc2sgYXJlYXMgdG8gdW5kZXJzdGFuZCB0aGUgbmF0dXJlIG9mIHRoZXNlIHJlYWwtd29ybGQgaGFybXMgYW5kIGhvdyBzdWNoIG1vZGVscyBtYXkgbGVhZCB0byB1bmludGVuZGVkIGhhcm0gZm9yIHNvY2lldHkuIEJhc2VkIG9uIHRoZXNlIGNvbnZlcnNhdGlvbnMsIHdlIGRlcml2ZWQgYSBzZXQgb2YgYWR2ZXJzYXJpYWwgZ29hbHMgZm9yIHRoZSByZWQgdGVhbSB0byBhdHRlbXB0IHRvIGFjaGlldmUsIHN1Y2ggYXMgZXh0cmFjdGluZyBoYXJtZnVsIGluZm9ybWF0aW9uIG9yIHJlcHJvZ3JhbW1pbmcgdGhlIG1vZGVsIHRvIGFjdCBpbiBhIHBvdGVudGlhbGx5IGhhcm1mdWwgY2FwYWNpdHkuIFRoZSByZWQgdGVhbSBjb25zaXN0ZWQgb2YgZXhwZXJ0cyBpbiBjeWJlcnNlY3VyaXR5LCBhZHZlcnNhcmlhbCBtYWNoaW5lIGxlYXJuaW5nLCByZXNwb25zaWJsZSBBSSwgYW5kIGludGVncml0eSBpbiBhZGRpdGlvbiB0byBtdWx0aWxpbmd1YWwgY29udGVudCBzcGVjaWFsaXN0cyB3aXRoIGJhY2tncm91bmQgaW4gaW50ZWdyaXR5IGlzc3VlcyBpbiBzcGVjaWZpYyBnZW9ncmFwaGljIG1hcmtldHMuXG5cbiMjIyBDcml0aWNhbCBSaXNrcyBcblxuSW4gYWRkaXRpb24gdG8gb3VyIHNhZmV0eSB3b3JrIGFib3ZlLCB3ZSB0b29rIGV4dHJhIGNhcmUgb24gbWVhc3VyaW5nIGFuZC9vciBtaXRpZ2F0aW5nIHRoZSBmb2xsb3dpbmcgY3JpdGljYWwgcmlzayBhcmVhczpcblxuKioxXFwuIENCUk5FIChDaGVtaWNhbCwgQmlvbG9naWNhbCwgUmFkaW9sb2dpY2FsLCBOdWNsZWFyLCBhbmQgRXhwbG9zaXZlIFdlYXBvbnMpOioqIExsYW1hIDMuMiAxQiBhbmQgM0IgbW9kZWxzIGFyZSBzbWFsbGVyIGFuZCBsZXNzIGNhcGFibGUgZGVyaXZhdGl2ZXMgb2YgTGxhbWEgMy4xLiBGb3IgTGxhbWEgMy4xIDcwQiBhbmQgNDA1QiwgdG8gYXNzZXNzIHJpc2tzIHJlbGF0ZWQgdG8gcHJvbGlmZXJhdGlvbiBvZiBjaGVtaWNhbCBhbmQgYmlvbG9naWNhbCB3ZWFwb25zLCB3ZSBwZXJmb3JtZWQgdXBsaWZ0IHRlc3RpbmcgZGVzaWduZWQgdG8gYXNzZXNzIHdoZXRoZXIgdXNlIG9mIExsYW1hIDMuMSBtb2RlbHMgY291bGQgbWVhbmluZ2Z1bGx5IGluY3JlYXNlIHRoZSBjYXBhYmlsaXRpZXMgb2YgbWFsaWNpb3VzIGFjdG9ycyB0byBwbGFuIG9yIGNhcnJ5IG91dCBhdHRhY2tzIHVzaW5nIHRoZXNlIHR5cGVzIG9mIHdlYXBvbnMgYW5kIGhhdmUgZGV0ZXJtaW5lZCB0aGF0IHN1Y2ggdGVzdGluZyBhbHNvIGFwcGxpZXMgdG8gdGhlIHNtYWxsZXIgMUIgYW5kIDNCIG1vZGVscy4gXG5cbioqMlxcLiBDaGlsZCBTYWZldHk6KiogQ2hpbGQgU2FmZXR5IHJpc2sgYXNzZXNzbWVudHMgd2VyZSBjb25kdWN0ZWQgdXNpbmcgYSB0ZWFtIG9mIGV4cGVydHMsIHRvIGFzc2VzcyB0aGUgbW9kZWxcdTIwMTlzIGNhcGFiaWxpdHkgdG8gcHJvZHVjZSBvdXRwdXRzIHRoYXQgY291bGQgcmVzdWx0IGluIENoaWxkIFNhZmV0eSByaXNrcyBhbmQgaW5mb3JtIG9uIGFueSBuZWNlc3NhcnkgYW5kIGFwcHJvcHJpYXRlIHJpc2sgbWl0aWdhdGlvbnMgdmlhIGZpbmUgdHVuaW5nLiBXZSBsZXZlcmFnZWQgdGhvc2UgZXhwZXJ0IHJlZCB0ZWFtaW5nIHNlc3Npb25zIHRvIGV4cGFuZCB0aGUgY292ZXJhZ2Ugb2Ygb3VyIGV2YWx1YXRpb24gYmVuY2htYXJrcyB0aHJvdWdoIExsYW1hIDMgbW9kZWwgZGV2ZWxvcG1lbnQuIEZvciBMbGFtYSAzLCB3ZSBjb25kdWN0ZWQgbmV3IGluLWRlcHRoIHNlc3Npb25zIHVzaW5nIG9iamVjdGl2ZSBiYXNlZCBtZXRob2RvbG9naWVzIHRvIGFzc2VzcyB0aGUgbW9kZWwgcmlza3MgYWxvbmcgbXVsdGlwbGUgYXR0YWNrIHZlY3RvcnMgaW5jbHVkaW5nIHRoZSBhZGRpdGlvbmFsIGxhbmd1YWdlcyBMbGFtYSAzIGlzIHRyYWluZWQgb24uIFdlIGFsc28gcGFydG5lcmVkIHdpdGggY29udGVudCBzcGVjaWFsaXN0cyB0byBwZXJmb3JtIHJlZCB0ZWFtaW5nIGV4ZXJjaXNlcyBhc3Nlc3NpbmcgcG90ZW50aWFsbHkgdmlvbGF0aW5nIGNvbnRlbnQgd2hpbGUgdGFraW5nIGFjY291bnQgb2YgbWFya2V0IHNwZWNpZmljIG51YW5jZXMgb3IgZXhwZXJpZW5jZXMuIFxuXG4qKjNcXC4gQ3liZXIgQXR0YWNrczoqKiBPdXIgY3liZXIgYXR0YWNrIHVwbGlmdCBzdHVkeSBpbnZlc3RpZ2F0ZWQgd2hldGhlciBMTE1zIGNhbiBlbmhhbmNlIGh1bWFuIGNhcGFiaWxpdGllcyBpbiBoYWNraW5nIHRhc2tzLCBib3RoIGluIHRlcm1zIG9mIHNraWxsIGxldmVsIGFuZCBzcGVlZC4gT3VyIGF0dGFjayBhdXRvbWF0aW9uIHN0dWR5IGZvY3VzZWQgb24gZXZhbHVhdGluZyB0aGUgY2FwYWJpbGl0aWVzIG9mIExMTXMgd2hlbiB1c2VkIGFzIGF1dG9ub21vdXMgYWdlbnRzIGluIGN5YmVyIG9mZmVuc2l2ZSBvcGVyYXRpb25zLCBzcGVjaWZpY2FsbHkgaW4gdGhlIGNvbnRleHQgb2YgcmFuc29td2FyZSBhdHRhY2tzLiBUaGlzIGV2YWx1YXRpb24gd2FzIGRpc3RpbmN0IGZyb20gcHJldmlvdXMgc3R1ZGllcyB0aGF0IGNvbnNpZGVyZWQgTExNcyBhcyBpbnRlcmFjdGl2ZSBhc3Npc3RhbnRzLiBUaGUgcHJpbWFyeSBvYmplY3RpdmUgd2FzIHRvIGFzc2VzcyB3aGV0aGVyIHRoZXNlIG1vZGVscyBjb3VsZCBlZmZlY3RpdmVseSBmdW5jdGlvbiBhcyBpbmRlcGVuZGVudCBhZ2VudHMgaW4gZXhlY3V0aW5nIGNvbXBsZXggY3liZXItYXR0YWNrcyB3aXRob3V0IGh1bWFuIGludGVydmVudGlvbi5cblxuIyMjIENvbW11bml0eSBcblxuKipJbmR1c3RyeSBQYXJ0bmVyc2hpcHM6KiogR2VuZXJhdGl2ZSBBSSBzYWZldHkgcmVxdWlyZXMgZXhwZXJ0aXNlIGFuZCB0b29saW5nLCBhbmQgd2UgYmVsaWV2ZSBpbiB0aGUgc3RyZW5ndGggb2YgdGhlIG9wZW4gY29tbXVuaXR5IHRvIGFjY2VsZXJhdGUgaXRzIHByb2dyZXNzLiBXZSBhcmUgYWN0aXZlIG1lbWJlcnMgb2Ygb3BlbiBjb25zb3J0aXVtcywgaW5jbHVkaW5nIHRoZSBBSSBBbGxpYW5jZSwgUGFydG5lcnNoaXAgb24gQUkgYW5kIE1MQ29tbW9ucywgYWN0aXZlbHkgY29udHJpYnV0aW5nIHRvIHNhZmV0eSBzdGFuZGFyZGl6YXRpb24gYW5kIHRyYW5zcGFyZW5jeS4gV2UgZW5jb3VyYWdlIHRoZSBjb21tdW5pdHkgdG8gYWRvcHQgdGF4b25vbWllcyBsaWtlIHRoZSBNTENvbW1vbnMgUHJvb2Ygb2YgQ29uY2VwdCBldmFsdWF0aW9uIHRvIGZhY2lsaXRhdGUgY29sbGFib3JhdGlvbiBhbmQgdHJhbnNwYXJlbmN5IG9uIHNhZmV0eSBhbmQgY29udGVudCBldmFsdWF0aW9ucy4gT3VyIFB1cnBsZSBMbGFtYSB0b29scyBhcmUgb3BlbiBzb3VyY2VkIGZvciB0aGUgY29tbXVuaXR5IHRvIHVzZSBhbmQgd2lkZWx5IGRpc3RyaWJ1dGVkIGFjcm9zcyBlY29zeXN0ZW0gcGFydG5lcnMgaW5jbHVkaW5nIGNsb3VkIHNlcnZpY2UgcHJvdmlkZXJzLiBXZSBlbmNvdXJhZ2UgY29tbXVuaXR5IGNvbnRyaWJ1dGlvbnMgdG8gb3VyIFtHaXRodWIgcmVwb3NpdG9yeV0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvUHVycGxlTGxhbWEpLlxuXG4qKkdyYW50czoqKiBXZSBhbHNvIHNldCB1cCB0aGUgW0xsYW1hIEltcGFjdCBHcmFudHNdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vbGxhbWEtaW1wYWN0LWdyYW50cy8pIHByb2dyYW0gdG8gaWRlbnRpZnkgYW5kIHN1cHBvcnQgdGhlIG1vc3QgY29tcGVsbGluZyBhcHBsaWNhdGlvbnMgb2YgTWV0YVx1MjAxOXMgTGxhbWEgbW9kZWwgZm9yIHNvY2lldGFsIGJlbmVmaXQgYWNyb3NzIHRocmVlIGNhdGVnb3JpZXM6IGVkdWNhdGlvbiwgY2xpbWF0ZSBhbmQgb3BlbiBpbm5vdmF0aW9uLiBUaGUgMjAgZmluYWxpc3RzIGZyb20gdGhlIGh1bmRyZWRzIG9mIGFwcGxpY2F0aW9ucyBjYW4gYmUgZm91bmQgW2hlcmVdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vbGxhbWEtaW1wYWN0LWdyYW50cy8jZmluYWxpc3RzKS4gXG5cbioqUmVwb3J0aW5nOioqIEZpbmFsbHksIHdlIHB1dCBpbiBwbGFjZSBhIHNldCBvZiByZXNvdXJjZXMgaW5jbHVkaW5nIGFuIFtvdXRwdXQgcmVwb3J0aW5nIG1lY2hhbmlzbV0oaHR0cHM6Ly9kZXZlbG9wZXJzLmZhY2Vib29rLmNvbS9sbGFtYV9vdXRwdXRfZmVlZGJhY2spIGFuZCBbYnVnIGJvdW50eSBwcm9ncmFtXShodHRwczovL3d3dy5mYWNlYm9vay5jb20vd2hpdGVoYXQpIHRvIGNvbnRpbnVvdXNseSBpbXByb3ZlIHRoZSBMbGFtYSB0ZWNobm9sb2d5IHdpdGggdGhlIGhlbHAgb2YgdGhlIGNvbW11bml0eS5cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9ucyBhbmQgTGltaXRhdGlvbnNcbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbioqVmFsdWVzOioqIFRoZSBjb3JlIHZhbHVlcyBvZiBMbGFtYSAzLjIgYXJlIG9wZW5uZXNzLCBpbmNsdXNpdml0eSBhbmQgaGVscGZ1bG5lc3MuIEl0IGlzIG1lYW50IHRvIHNlcnZlIGV2ZXJ5b25lLCBhbmQgdG8gd29yayBmb3IgYSB3aWRlIHJhbmdlIG9mIHVzZSBjYXNlcy4gSXQgaXMgdGh1cyBkZXNpZ25lZCB0byBiZSBhY2Nlc3NpYmxlIHRvIHBlb3BsZSBhY3Jvc3MgbWFueSBkaWZmZXJlbnQgYmFja2dyb3VuZHMsIGV4cGVyaWVuY2VzIGFuZCBwZXJzcGVjdGl2ZXMuIExsYW1hIDMuMiBhZGRyZXNzZXMgdXNlcnMgYW5kIHRoZWlyIG5lZWRzIGFzIHRoZXkgYXJlLCB3aXRob3V0IGluc2VydGlvbiB1bm5lY2Vzc2FyeSBqdWRnbWVudCBvciBub3JtYXRpdml0eSwgd2hpbGUgcmVmbGVjdGluZyB0aGUgdW5kZXJzdGFuZGluZyB0aGF0IGV2ZW4gY29udGVudCB0aGF0IG1heSBhcHBlYXIgcHJvYmxlbWF0aWMgaW4gc29tZSBjYXNlcyBjYW4gc2VydmUgdmFsdWFibGUgcHVycG9zZXMgaW4gb3RoZXJzLiBJdCByZXNwZWN0cyB0aGUgZGlnbml0eSBhbmQgYXV0b25vbXkgb2YgYWxsIHVzZXJzLCBlc3BlY2lhbGx5IGluIHRlcm1zIG9mIHRoZSB2YWx1ZXMgb2YgZnJlZSB0aG91Z2h0IGFuZCBleHByZXNzaW9uIHRoYXQgcG93ZXIgaW5ub3ZhdGlvbiBhbmQgcHJvZ3Jlc3MuIFxuXG4qKlRlc3Rpbmc6KiogTGxhbWEgMy4yIGlzIGEgbmV3IHRlY2hub2xvZ3ksIGFuZCBsaWtlIGFueSBuZXcgdGVjaG5vbG9neSwgdGhlcmUgYXJlIHJpc2tzIGFzc29jaWF0ZWQgd2l0aCBpdHMgdXNlLiBUZXN0aW5nIGNvbmR1Y3RlZCB0byBkYXRlIGhhcyBub3QgY292ZXJlZCwgbm9yIGNvdWxkIGl0IGNvdmVyLCBhbGwgc2NlbmFyaW9zLiBGb3IgdGhlc2UgcmVhc29ucywgYXMgd2l0aCBhbGwgTExNcywgTGxhbWEgMy4yXHUyMDE5cyBwb3RlbnRpYWwgb3V0cHV0cyBjYW5ub3QgYmUgcHJlZGljdGVkIGluIGFkdmFuY2UsIGFuZCB0aGUgbW9kZWwgbWF5IGluIHNvbWUgaW5zdGFuY2VzIHByb2R1Y2UgaW5hY2N1cmF0ZSwgYmlhc2VkIG9yIG90aGVyIG9iamVjdGlvbmFibGUgcmVzcG9uc2VzIHRvIHVzZXIgcHJvbXB0cy4gVGhlcmVmb3JlLCBiZWZvcmUgZGVwbG95aW5nIGFueSBhcHBsaWNhdGlvbnMgb2YgTGxhbWEgMy4yIG1vZGVscywgZGV2ZWxvcGVycyBzaG91bGQgcGVyZm9ybSBzYWZldHkgdGVzdGluZyBhbmQgdHVuaW5nIHRhaWxvcmVkIHRvIHRoZWlyIHNwZWNpZmljIGFwcGxpY2F0aW9ucyBvZiB0aGUgbW9kZWwuIFBsZWFzZSByZWZlciB0byBhdmFpbGFibGUgcmVzb3VyY2VzIGluY2x1ZGluZyBvdXIgW1Jlc3BvbnNpYmxlIFVzZSBHdWlkZV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9yZXNwb25zaWJsZS11c2UtZ3VpZGUpLCBbVHJ1c3QgYW5kIFNhZmV0eV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS90cnVzdC1hbmQtc2FmZXR5Lykgc29sdXRpb25zLCBhbmQgb3RoZXIgW3Jlc291cmNlc10oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9kb2NzL2dldC1zdGFydGVkLykgdG8gbGVhcm4gbW9yZSBhYm91dCByZXNwb25zaWJsZSBkZXZlbG9wbWVudC5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKioiLAogICAgImRpc3BsYXlOYW1lIjogIkxsYW1hLTMuMi0xQi1JbnN0cnVjdCIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1HTFYwLTYyQk0iLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJydHg2MDAwLWJsYWNrd2VsbC1zdngxLXRocm91Z2hwdXQtbG9yYS1mcDgtdThoaG9vY2wwYSIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMjExOTYwMzczNywKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9sbGFtYS0zXzItMWItaW5zdHJ1Y3QuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJOL0EiLAogICAgIm5hbWUiOiAibGxhbWEtMy4yLTFiLWluc3RydWN0IiwKICAgICJvcmdOYW1lIjogIm5pbSIsCiAgICAicHJlY2lzaW9uIjogIk4vQSIsCiAgICAicHJpdmFjeSI6ICIiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk1ldGEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJUaGUgTWV0YSBMbGFtYSAzLjIgY29sbGVjdGlvbiBvZiBtdWx0aWxpbmd1YWwgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzIChMTE1zKSBpcyBhIGNvbGxlY3Rpb24gb2YgcHJlLXRyYWluZWQgYW5kIGluc3RydWN0aW9uLXR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDFCIGFuZCAzQiBzaXplcyAodGV4dCBpbi90ZXh0IG91dCkuIiwKICAgICJ0ZWFtTmFtZSI6ICJtZXRhIiwKICAgICJ1cGRhdGVkRGF0ZSI6ICIyMDI1LTA4LTE4VDE2OjQ5OjM1LjI4NFoiCn0= source: URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/llama-3_2-1b-instruct optimizationProfiles: - profileId: nim/meta/llama-3.2-1b-instruct:b200x1-throughput-bf16-olbx5u2wza framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct B200x1 BF16 Throughput ngcMetadata: 00974a79b608dd9dc2e302879e71708692c9c6304f5905eb4da7d661dadd6ec2: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3190e2309f20a42f1888add452d98f204147634d83e7e5a7bbb401f9e898de2e number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h100x1-throughput-bf16-coy0mruniw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100x1 BF16 Throughput ngcMetadata: 023958aa70e985eb0a0d25c60d7a03732ad5ee7d4f9ac2ebcce17397b172b58c: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 4ba0b194b524b5d78bfa90c76ad9789b54069996b45beca9ce05762a295d871a number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x1-throughput-fp8-q4ene2avnw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x1 FP8 Throughput ngcMetadata: 0b900e8d26b11d548f74a903739434bf00fc990439a9245042e344d253481719: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: b771a0a1bf21ee92364a0f1c9db64628d74919517edf09f47b079aab90af963e number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:a10gx1-throughput-bf16-wmuh1shq9q framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A10Gx1 BF16 Throughput ngcMetadata: 0f7eb9e9a9b4470a7b5b6e93b806ad27ff49b1a94c30aa2986ffaf281f6e8d1f: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e28f4aa923af93efab6e6c14dceae117980f3f805e47f871464af69ea1457946 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 1 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct RTX6000_BLACKWELL_SVx1 BF16 Latency ngcMetadata: 0f87e0f30087419b3a4a74d7902753a6daee998e59c0676d412fefe141f62ffe: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 6582d9bebeaaa8b1cc21b6a10cdde0daf92a198e7f9950b21908a77a90d47c3e number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__2 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100_NVLx1 BF16 Throughput ngcMetadata: 0f94ccdaf02fa00a986ba3b2b8ff0351ffa73fe262176e89830445ad81b6bfbc: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 92f394e8f167dca76b9c8eb40b8a09edd896b6fd6ec126ba5609a9c90cc21f59 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__3 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_144GBx1 FP8 Latency ngcMetadata: 129db5959331b4c24cae55957a8bef7cce73fcc7571001fe18556c9b691db5d8: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 11d5467289919d18be03dbdd3236e1d2b1fdf81681b52167fadc2af453e8f6ea number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:l40sx1-throughput-bf16-mr-zfjdk9w framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct L40Sx1 BF16 Throughput ngcMetadata: 13d24e5a873aea5df261998c94710c6d00b59074f8389143d94a370762569bf8: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 72a4b35de823e2ba47bc9bac68b3704d0a9eae3db2037458d70d813809c6af78 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__4 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct RTX6000_BLACKWELL_SVx1 FP8 Latency ngcMetadata: 14389e34e76649cff246559bc0374718143cb5ac1286f7a53f6e0314c70b004b: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 2493505e4182b1596bf60600e22bae9fd94056b3988e591bceace38117523d26 number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__5 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct RTX6000_BLACKWELL_SVx1 BF16 Throughput ngcMetadata: 1d76561dbe108226813651f3fd70416295040612f0cf3c36fd330fc388d9ef60: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 8d4e43ad080af609d17f7c559a838f1e46da4a990bfbee068d540601847951e5 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__6 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200_NVLx1 FP8 Throughput ngcMetadata: 280bfbbbf4ea6e6744b706d25032054ad18289814406f251d9f862b044c51c67: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 50ad558f72f96fb5171036046bfaab28fc9eb1157e31488c5da2c3ab0134c020 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__7 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200_NVLx1 BF16 Throughput ngcMetadata: 2d1a186f55c204c95b4abd9df2056e3095b148700cd8fdda115ffe7bea3bed60: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 940e6e9a959cdd8829c9cba449c1c8bc83ef2522ce1f263cbc7e1920399fe465 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__8 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100_NVLx1 FP8 Throughput ngcMetadata: 2e2ecec7b2d03c998a8bae64e150a5f88bfde56917d372dc91ffc08f94c9d07f: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9fb78395ea4e775bdbf7c8df874ee89b4e084d35fd3ee6f8b105ec6061e8d887 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__9 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200_NVLx2 FP8 Latency ngcMetadata: 2e92e2be673e48b2312076393db8caff10c7dae24bf90cd1637b197fe2dda0f2: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: ba433d54af67e3a0d72db4a896acb2e92ba9caa41d731086c34d9e77df019c7d number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:a100x2-latency-bf16-ezdh3qtgsw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A100x2 BF16 Latency ngcMetadata: 345837de17bc4e103174352bc07a86112cef00318470e5477afb24908d09abb6: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f517db32f12098356f9ef902992f57d5362a4e58a8d185c993cc93657f18a3cb number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:a10gx2-latency-bf16-sdcegxqefa framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A10Gx2 BF16 Latency ngcMetadata: 41eb6cd432c8d498926942101511e4da1e913d0d22adbc96ed547a8042d2b7ce: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 071daef17e33c140ef8b82b89004ed3d5412e3eca9b4bedb8b57824dc05e975c number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 2 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__10 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A100_SXM4_40GBx2 BF16 Latency ngcMetadata: 43a51be16bada864c0ab6acc3e267e333fe69150a05287d5386e7cb39c7c61bb: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 04ee232eb94574469d111ff8001c42836ee881f67fbf9040fbdc582e6b1b1c42 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 2 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__11 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_144GBx1 BF16 Latency ngcMetadata: 4843f0f1c0b0b410cbc37dbb748396f2793b0eb5ed8ad9f215e06da1e82b98e8: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 736c2ad1750f0504768fb31d97587a07cc473517c232e8454f098e63c0f5de5c number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__12 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A100_SXM4_40GBx1 BF16 Throughput ngcMetadata: 4acbbc32a700f17dd483e6a53914ec62688d029120fb0c216420e8481983d0e7: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 10849901781866ddf59b10df9f42464a7c089c5f0a61f41f6b25862f19195a7b number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 1 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:l40sx2-latency-fp8-uvobdo54ig framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct L40Sx2 FP8 Latency ngcMetadata: 55be74aa57225eb45db56bda45a2e1ad7a02f8f30d5f8eef9877df8adacc0550: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 0669a60d949ab85b17b5f2a73d7e9f6b131797740da6ed43e29e5f41066d571c number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x2-latency-fp8--yymwnqgka framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x2 FP8 Latency ngcMetadata: 58db8acdee23b42a43f731e5e6e7d123ff889d70318dd876d8325bfdd9d52023: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d9bafa9974769a2f7539affd5e55acef006ce62c15bc088dc3a55afd818ee124 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:gb200x1-throughput-bf16-zyj-crhkzq framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GB200x1 BF16 Throughput ngcMetadata: 59619a192c8ef4c65e8363642f722508401f1392f64fd007337abb01ecbe7d19: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 35decffe402ab43b965bedff55c8cef9addc05e917187701562af2f4fe213de9 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x1-throughput-bf16-tsa8sfptpw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x1 BF16 Throughput ngcMetadata: 61555d7be4e6de25c9219d7a0bb106d40ce887b31f29ea8df4fee6110e2b853b: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 9b5fee25e36a210bec2865d4ebd5c974a8cf4e4002efacd9ec516642370cbd9c number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:b200x1-throughput-fp8-ys-xbyv-sg framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct B200x1 FP8 Throughput ngcMetadata: 6d0ee85cf622a72848fc5daa170614ce7fcec7167fe53d718878f08eb24cb965: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 5c56717955f737f260b918572f35036dee10c1b54530f4096fa66af19b17ffd5 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__13 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_480GBx1 FP8 Throughput ngcMetadata: 700827bec7ac9724fe295b4bdde657eff97c34de54f3ad504fabfe32e12e3e18: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 8e95c5073de6fd99ffce7014cc733fe55fa894162cfec8c938756de81fa8ecac number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__14 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200_NVLx2 BF16 Latency ngcMetadata: 70089c0e01ba82698bed7ab932bafebc141455e40bd15567f7e37496ac7bcf1e: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200_NVL gpu_device: 233b:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 3575e95e2064a522faa33fa6dbf9a6c3eddbee6bcf286d0c44315142c402b089 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 233B:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x2-latency-bf16-itm2i3hlig framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x2 BF16 Latency ngcMetadata: 7c29442049d0390525e51aaf5d3d3ac7c676bf7222707b7ed29442e2a95227c5: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: f987c70ae752902a0fb500d8f378afd65fc5b47b5eeb88627004b0edb210bcd8 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__15 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct RTX6000_BLACKWELL_SVx1 FP8 Throughput ngcMetadata: 85eeb431dec2e7ce1aff645c1e1e08d0a42a644f64874c68a65fd4e07189b902: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: RTX6000_BLACKWELL_SV gpu_device: 2bb5:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: d76814b2d2442f8ad709563f653ed4b80e39f5ad1acbd0b84822235fe4e3d1a4 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_BLACKWELL_SV - key: COUNT value: 1 - key: GPU DEVICE value: 2BB5:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:l40sx1-throughput-fp8-wocwu5pweq framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct L40Sx1 FP8 Throughput ngcMetadata: 894221e5032dfb82de8567266ea22114b8597aabc85b93e92ad290508ecd33bf: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 13f1a9e953c8a5320111dc8a580cd3855291326abe1d1e5b5c7dfced9cb6f6ea number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:a100x1-throughput-bf16-dohmk4psfa framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct A100x1 BF16 Throughput ngcMetadata: 8b22a466a5ef2f848151ea4679201cf4f7fe7ebd7094671cfa3df7a25836b4ff: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: c83a64076a4cecd2c6d8d55db86ba5d0b31395c28ab806962828aa291c192b33 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:gb200x2-latency-bf16-2w1oa3-9bw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GB200x2 BF16 Latency ngcMetadata: 930b33fdac9c955b3149d675d262d286f7e4db61503e9c9de17aa18dfe092238: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: e8d3089f177a1641f3b610799a19a3a4c752e1795eca7be92a129e9bae5cbc39 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__16 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_480GBx1 BF16 Throughput ngcMetadata: a416c249ee8f78d2790919c1d5e6f3afa3be9d85f3e77cd635e65335caae4ddb: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: cafc299ec54dd11d527965baac566347feccd9dad56d5a89cfb4e710e56b8b2c number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x1-throughput-fp8-b62hkfmx2a framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x1 FP8 Throughput ngcMetadata: a6780e332aeb2c67ff491b2b1d13f04c58c238bc07bad39af5b0c552d6e3dfae: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7ccea195195ee0642c6785c8d5aa7ab8976737fc4f80f2966f5dcf7c8333391d number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:gb200x1-throughput-fp8-nupr5gs2dw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GB200x1 FP8 Throughput ngcMetadata: a8d5512071d8c48e62ac709edc231cbf158aacc5faae00040379c8c3bc4f2bf8: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: bc56bf15cfcf13e2c7834d0ce1767a27719c1de7291cee654f6232c35375bf45 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h100x2-latency-fp8-5cyndvc2za framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100x2 FP8 Latency ngcMetadata: af99cd31d06f9fb19ffe3dfce1e5c053ffbd43f3c7e671d9c4550eccb8dee31e: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 44b31027ddef82c6ddcd49ecfc68f20067975ad0d9b62755ca3667e055f48ab5 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:l40sx2-latency-bf16-wimz1alj0q framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct L40Sx2 BF16 Latency ngcMetadata: b0833059fa3270d15e7a2ccbd1228fe5a3681b5801395d5c2c306fac3a386534: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a4315018cc1c0f75d76920b73d557daea0e2f4dfbd8b626515adb36e90ebba12 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__17 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_144GBx1 FP8 Throughput ngcMetadata: b4375abbe106a961f61ebfc40ecb73490ca64fadba7b06c156173aeec81ed2fa: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 94f9fdc707b068711db2447004698e4a90be58c6d3329463ba57c85714bff488 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:b200x2-latency-bf16-jvvom3lafg framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct B200x2 BF16 Latency ngcMetadata: bb8774e429cd06145c3af972a557193da4859bbb406bdd6ab4eba1111b757ee4: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 417053eecdaf868c0db37d64920e90eb29881638168c9781c33309dabd9852c8 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__18 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100_NVLx2 FP8 Latency ngcMetadata: bbc09967e87df528eafcdee9c95946cbc528a004bade8c30e4d655902b4a1eda: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 7ad4d81f5c1ff5bd7171ee75a51e45af792644f3cc45282999e3405adfbec78e number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h100x1-throughput-fp8-tfwwzbhdca framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100x1 FP8 Throughput ngcMetadata: cad5ff155623a7ed9e6e400347be5d2b1772324a4389585f372d99ab2b18310b: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: fa0733fe89758e6911ee12b330d3bc39d1e933a9cffcd13f80f54f00e44d5808 number_of_gpus: '2' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 2GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__19 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GH200_144GBx1 BF16 Throughput ngcMetadata: cc2a610402f4d5fc1b580b09af8e0f35c4a6214bc5a3da2de66aa1c9eaf00703: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GH200_144GB gpu_device: 2348:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 64b5a893869e9c17ddd2a31f28ebe867079c41899f1e00c503cce640fa487128 number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_144GB - key: COUNT value: 1 - key: GPU DEVICE value: 2348:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:gb200x2-latency-fp8-mj9h4xjlpw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct GB200x2 FP8 Latency ngcMetadata: d30b476874b44f6d697a81c37a6a5df7747b95d77ec196644b1b288cfa4ebb99: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: GB200 gpu_device: 2941:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a79685d119872d802f1fd849c1636665049ff58a7354fb536df1451d42952a75 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: GB200 - key: COUNT value: 2 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h100x2-latency-bf16-kdm6hypmza framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100x2 BF16 Latency ngcMetadata: d35b0a4879ffc8a4ee620979a9b0306c1d35265c0d0d4917b1079da1bd44c830: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: adb5fe983b732e233035db031b01461e698505aa8db330f00da89ed240b244b3 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:h200x2-latency-fp8-qdlgs44zrw framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H200x2 FP8 Latency ngcMetadata: ece478a8ed72c4ff1b85bf758b105a30b724f5da2320278a50d7328ae661eaed: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: a14e294573c64a9a49641e82012cb4fa3776f6fe25d9be84092b4ec2476006e1 number_of_gpus: '4' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 3GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-1b-instruct:hf-9213176-tool_calling__20 framework: TensorRT-LLM displayName: Llama 3.2 1B Instruct H100_NVLx2 BF16 Latency ngcMetadata: ee50ced41e24f36d4ad7c0bb3504688562be53a94b7f76fa99a867ff8b5d06ca: model: meta/llama-3.2-1b-instruct release: 1.12.0 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm nim_workspace_hash_v1: 77f4dfe035e443e59bbaf204c6e17b9c52cb16cbb638e426a5eedb0a8b6b2177 number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.12.0 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - variantId: Llama 3.2 3B Instruct modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0xOVQyMDo0MzoyMC41MzhaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyBNb2RlbCBJbmZvcm1hdGlvblxuXG5UaGUgTWV0YSBMbGFtYSAzLjIgY29sbGVjdGlvbiBvZiBtdWx0aWxpbmd1YWwgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzIChMTE1zKSBpcyBhIGNvbGxlY3Rpb24gb2YgcHJlLXRyYWluZWQgYW5kIGluc3RydWN0aW9uLXR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDFCIGFuZCAzQiBzaXplcyAodGV4dCBpbi90ZXh0IG91dCkuIFRoZSBMbGFtYSAzLjIgaW5zdHJ1Y3Rpb24tdHVuZWQgdGV4dCBvbmx5IG1vZGVscyBhcmUgb3B0aW1pemVkIGZvciBtdWx0aWxpbmd1YWwgZGlhbG9ndWUgdXNlIGNhc2VzLCBpbmNsdWRpbmcgYWdlbnRpYyByZXRyaWV2YWwgYW5kIHN1bW1hcml6YXRpb24gdGFza3MuIFRoZXkgb3V0cGVyZm9ybSBtYW55IG9mIHRoZSBhdmFpbGFibGUgb3BlbiBzb3VyY2UgYW5kIGNsb3NlZCBjaGF0IG1vZGVscyBvbiBjb21tb24gaW5kdXN0cnkgYmVuY2htYXJrcy4gXG5cbkxsYW1hIDMuMiBtb2RlbHMgYXJlIHJlYWR5IGZvciBjb21tZXJjaWFsIHVzZS5cblxuTW9kZWxzIGFyZSBhY2NlbGVyYXRlZCBieSBbVGVuc29yUlQtTExNXShodHRwczovL2dpdGh1Yi5jb20vTlZJRElBL1RlbnNvclJULUxMTSksIGEgbGlicmFyeSBmb3Igb3B0aW1pemluZyBMYXJnZSBMYW5ndWFnZSBNb2RlbCAoTExNKSBpbmZlcmVuY2Ugb24gTlZJRElBIEdQVXMuXG5cbioqTW9kZWxzIGluIHRoaXMgQ29sbGVjdGlvbjoqKiAgXG4tIExsYW1hLTMuMi0xQlxuLSBMbGFtYS0zLjItMUItSW5zdHJ1Y3Rcbi0gTGxhbWEtMy4yLTNCXG4tIExsYW1hLTMuMi0zQi1JbnN0cnVjdFxuXG4qKk1vZGVsIERldmVsb3BlcjoqKiBNZXRhXG5cbioqTW9kZWwgVmVyc2lvbjoqKiAzLjJcblxuKipNb2RlbCBSZWxlYXNlIERhdGU6KiogU2VwdGVtYmVyIDI1LCAyMDI0XG5cbioqVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb246KipcblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFtMbGFtYSAzLjIgTW9kZWwgQ2FyZF0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvbGxhbWEtbW9kZWxzL2Jsb2IvbWFpbi9tb2RlbHMvbGxhbWEzXzIvTU9ERUxfQ0FSRC5tZCkuXG5cbioqTGljZW5zZToqKiBVc2Ugb2YgTGxhbWEgMy4yIGlzIGdvdmVybmVkIGJ5IHRoZSBbTGxhbWEgMy4yIENvbW11bml0eSBMaWNlbnNlXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1tb2RlbHMvYmxvYi9tYWluL21vZGVscy9sbGFtYTNfMi9MSUNFTlNFKSAoYSBjdXN0b20sIGNvbW1lcmNpYWwgbGljZW5zZSBhZ3JlZW1lbnQpLlxuXG4qKk1vZGVsIEFyY2hpdGVjdHVyZToqKiBMbGFtYSAzLjIgaXMgYW4gYXV0by1yZWdyZXNzaXZlIGxhbmd1YWdlIG1vZGVsIHRoYXQgdXNlcyBhbiBvcHRpbWl6ZWQgdHJhbnNmb3JtZXIgYXJjaGl0ZWN0dXJlLiBUaGUgdHVuZWQgdmVyc2lvbnMgdXNlIHN1cGVydmlzZWQgZmluZS10dW5pbmcgKFNGVCkgYW5kIHJlaW5mb3JjZW1lbnQgbGVhcm5pbmcgd2l0aCBodW1hbiBmZWVkYmFjayAoUkxIRikgdG8gYWxpZ24gd2l0aCBodW1hbiBwcmVmZXJlbmNlcyBmb3IgaGVscGZ1bG5lc3MgYW5kIHNhZmV0eS5cblxufCAgfCBUcmFpbmluZyBEYXRhIHwgUGFyYW1zIHwgSW5wdXQgbW9kYWxpdGllcyB8IE91dHB1dCBtb2RhbGl0aWVzIHwgQ29udGV4dCBMZW5ndGggfCBHUUEgfCBTaGFyZWQgRW1iZWRkaW5ncyB8IFRva2VuIGNvdW50IHwgS25vd2xlZGdlIGN1dG9mZiB8XG58IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHwgOi0tLS0gfCA6LS0tLSB8IDotLS0tIHxcbnwgTGxhbWEgMy4yICh0ZXh0IG9ubHkpICB8IEEgbmV3IG1peCBvZiBwdWJsaWNseSBhdmFpbGFibGUgb25saW5lIGRhdGEuIHwgMUIgKDEuMjNCKSB8IE11bHRpbGluZ3VhbCBUZXh0IHwgTXVsdGlsaW5ndWFsIFRleHQgYW5kIGNvZGUgIHwgMTI4ayB8IFllcyB8IFllcyB8IFVwIHRvIDlUIHRva2VucyB8IERlY2VtYmVyIDIwMjMgfFxufCAgfCAgfCAzQiAoMy4yMUIpIHwgTXVsdGlsaW5ndWFsIFRleHQgfCBNdWx0aWxpbmd1YWwgVGV4dCBhbmQgY29kZSAgfCAgfCAgfCAgfCAgfCAgfFxuXG4qKlN1cHBvcnRlZCBMYW5ndWFnZXM6KiogRW5nbGlzaCwgR2VybWFuLCBGcmVuY2gsIEl0YWxpYW4sIFBvcnR1Z3Vlc2UsIEhpbmRpLCBTcGFuaXNoLCBhbmQgVGhhaSBhcmUgb2ZmaWNpYWxseSBzdXBwb3J0ZWQuIExsYW1hIDMuMiBoYXMgYmVlbiB0cmFpbmVkIG9uIGEgYnJvYWRlciBjb2xsZWN0aW9uIG9mIGxhbmd1YWdlcyB0aGFuIHRoZXNlIDggc3VwcG9ydGVkIGxhbmd1YWdlcy4gRGV2ZWxvcGVycyBtYXkgZmluZS10dW5lIExsYW1hIDMuMiBtb2RlbHMgZm9yIGxhbmd1YWdlcyBiZXlvbmQgdGhlc2Ugc3VwcG9ydGVkIGxhbmd1YWdlcywgcHJvdmlkZWQgdGhleSBjb21wbHkgd2l0aCB0aGUgTGxhbWEgMy4yIENvbW11bml0eSBMaWNlbnNlIGFuZCB0aGUgQWNjZXB0YWJsZSBVc2UgUG9saWN5LiBEZXZlbG9wZXJzIGFyZSBhbHdheXMgZXhwZWN0ZWQgdG8gZW5zdXJlIHRoYXQgdGhlaXIgZGVwbG95bWVudHMsIGluY2x1ZGluZyB0aG9zZSB0aGF0IGludm9sdmUgYWRkaXRpb25hbCBsYW5ndWFnZXMsIGFyZSBjb21wbGV0ZWQgc2FmZWx5IGFuZCByZXNwb25zaWJseS5cblxuKipMbGFtYSAzLjIgTW9kZWwgRmFtaWx5OioqIFRva2VuIGNvdW50cyByZWZlciB0byBwcmUtdHJhaW5pbmcgZGF0YSBvbmx5LiBBbGwgbW9kZWwgdmVyc2lvbnMgdXNlIEdyb3VwZWQtUXVlcnkgQXR0ZW50aW9uIChHUUEpIGZvciBpbXByb3ZlZCBpbmZlcmVuY2Ugc2NhbGFiaWxpdHkuXG5cbioqU3RhdHVzOioqIFRoaXMgaXMgYSBzdGF0aWMgbW9kZWwgdHJhaW5lZCBvbiBhbiBvZmZsaW5lIGRhdGFzZXQuIEZ1dHVyZSB2ZXJzaW9ucyBtYXkgYmUgcmVsZWFzZWQgdGhhdCBpbXByb3ZlIG1vZGVsIGNhcGFiaWxpdGllcyBhbmQgc2FmZXR5LiBcblxuKipGZWVkYmFjazoqKiBXaGVyZSB0byBzZW5kIHF1ZXN0aW9ucyBvciBjb21tZW50cyBhYm91dCB0aGUgbW9kZWwgSW5zdHJ1Y3Rpb25zIG9uIGhvdyB0byBwcm92aWRlIGZlZWRiYWNrIG9yIGNvbW1lbnRzIG9uIHRoZSBtb2RlbCBjYW4gYmUgZm91bmQgaW4gdGhlIG1vZGVsIFtSRUFETUVdKGh0dHBzOi8vZ2l0aHViLmNvbS9tZXRhLWxsYW1hL2xsYW1hLW1vZGVscy90cmVlL21haW4vbW9kZWxzL2xsYW1hM18yKS4gRm9yIG1vcmUgdGVjaG5pY2FsIGluZm9ybWF0aW9uIGFib3V0IGdlbmVyYXRpb24gcGFyYW1ldGVycyBhbmQgcmVjaXBlcyBmb3IgaG93IHRvIHVzZSBMbGFtYSAzLjIgaW4gYXBwbGljYXRpb25zLCBwbGVhc2UgZ28gW2hlcmVdKGh0dHBzOi8vZ2l0aHViLmNvbS9tZXRhLWxsYW1hL2xsYW1hLXJlY2lwZXMpLiBcblxuIyMgSW50ZW5kZWQgVXNlXG5cbioqSW50ZW5kZWQgVXNlIENhc2VzOioqIExsYW1hIDMuMiBpcyBpbnRlbmRlZCBmb3IgY29tbWVyY2lhbCBhbmQgcmVzZWFyY2ggdXNlIGluIG11bHRpcGxlIGxhbmd1YWdlcy4gSW5zdHJ1Y3Rpb24gdHVuZWQgdGV4dCBvbmx5IG1vZGVscyBhcmUgaW50ZW5kZWQgZm9yIGFzc2lzdGFudC1saWtlIGNoYXQgYW5kIGFnZW50aWMgYXBwbGljYXRpb25zIGxpa2Uga25vd2xlZGdlIHJldHJpZXZhbCBhbmQgc3VtbWFyaXphdGlvbiwgbW9iaWxlIEFJIHBvd2VyZWQgd3JpdGluZyBhc3Npc3RhbnRzIGFuZCBxdWVyeSBhbmQgcHJvbXB0IHJld3JpdGluZy4gUHJlLXRyYWluZWQgbW9kZWxzIGNhbiBiZSBhZGFwdGVkIGZvciBhIHZhcmlldHkgb2YgYWRkaXRpb25hbCBuYXR1cmFsIGxhbmd1YWdlIGdlbmVyYXRpb24gdGFza3MuIFxuXG4qKk91dCBvZiBTY29wZToqKiBVc2UgaW4gYW55IG1hbm5lciB0aGF0IHZpb2xhdGVzIGFwcGxpY2FibGUgbGF3cyBvciByZWd1bGF0aW9ucyAoaW5jbHVkaW5nIHRyYWRlIGNvbXBsaWFuY2UgbGF3cykuIFVzZSBpbiBhbnkgb3RoZXIgd2F5IHRoYXQgaXMgcHJvaGliaXRlZCBieSB0aGUgQWNjZXB0YWJsZSBVc2UgUG9saWN5IGFuZCBMbGFtYSAzLjIgQ29tbXVuaXR5IExpY2Vuc2UuIFVzZSBpbiBsYW5ndWFnZXMgYmV5b25kIHRob3NlIGV4cGxpY2l0bHkgcmVmZXJlbmNlZCBhcyBzdXBwb3J0ZWQgaW4gdGhpcyBtb2RlbCBjYXJkLlxuXG4jIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvblxuXG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OioqXG4tIE5WSURJQSBBbXBlcmVcbi0gTlZJRElBIEhvcHBlclxuLSBOVklESUEgTG92ZWxhY2Vcbi0gTlZJRElBIEpldHNvblxuXG4qKlN1cHBvcnRlZCBPcGVyYXRpbmcgU3lzdGVtKHMpOioqXG4tIExpbnV4IFxuLSBXaW5kb3dzXG5cbiMjIEhhcmR3YXJlIGFuZCBTb2Z0d2FyZVxuXG4qKlRyYWluaW5nIEZhY3RvcnM6KiogV2UgdXNlZCBjdXN0b20gdHJhaW5pbmcgbGlicmFyaWVzLCBNZXRhJ3MgY3VzdG9tIGJ1aWx0IEdQVSBjbHVzdGVyLCBhbmQgcHJvZHVjdGlvbiBpbmZyYXN0cnVjdHVyZSBmb3IgcHJlLXRyYWluaW5nLiBGaW5lLXR1bmluZywgYW5ub3RhdGlvbiwgYW5kIGV2YWx1YXRpb24gd2VyZSBhbHNvIHBlcmZvcm1lZCBvbiBwcm9kdWN0aW9uIGluZnJhc3RydWN0dXJlLlxuXG4qKlRyYWluaW5nIEVuZXJneSBVc2U6KiogVHJhaW5pbmcgdXRpbGl6ZWQgYSBjdW11bGF0aXZlIG9mICoqOTE2ayoqIEdQVSBob3VycyBvZiBjb21wdXRhdGlvbiBvbiBIMTAwLTgwR0IgKFREUCBvZiA3MDBXKSB0eXBlIGhhcmR3YXJlLCBwZXIgdGhlIHRhYmxlIGJlbG93LiBUcmFpbmluZyB0aW1lIGlzIHRoZSB0b3RhbCBHUFUgdGltZSByZXF1aXJlZCBmb3IgdHJhaW5pbmcgZWFjaCBtb2RlbCBhbmQgcG93ZXIgY29uc3VtcHRpb24gaXMgdGhlIHBlYWsgcG93ZXIgY2FwYWNpdHkgcGVyIEdQVSBkZXZpY2UgdXNlZCwgYWRqdXN0ZWQgZm9yIHBvd2VyIHVzYWdlIGVmZmljaWVuY3kuIFxuXG4jIyBcblxuKipUcmFpbmluZyBHcmVlbmhvdXNlIEdhcyBFbWlzc2lvbnM6KiogRXN0aW1hdGVkIHRvdGFsIGxvY2F0aW9uLWJhc2VkIGdyZWVuaG91c2UgZ2FzIGVtaXNzaW9ucyB3ZXJlICoqMjQwKiogdG9ucyBDTzJlcSBmb3IgdHJhaW5pbmcuIFNpbmNlIDIwMjAsIE1ldGEgaGFzIG1haW50YWluZWQgbmV0IHplcm8gZ3JlZW5ob3VzZSBnYXMgZW1pc3Npb25zIGluIGl0cyBnbG9iYWwgb3BlcmF0aW9ucyBhbmQgbWF0Y2hlZCAxMDAlIG9mIGl0cyBlbGVjdHJpY2l0eSB1c2Ugd2l0aCByZW5ld2FibGUgZW5lcmd5OyB0aGVyZWZvcmUsIHRoZSB0b3RhbCBtYXJrZXQtYmFzZWQgZ3JlZW5ob3VzZSBnYXMgZW1pc3Npb25zIGZvciB0cmFpbmluZyB3ZXJlIDAgdG9ucyBDTzJlcS5cblxufCAgfCBUcmFpbmluZyBUaW1lIChHUFUgaG91cnMpIHwgTG9naXQgR2VuZXJhdGlvbiBUaW1lIChHUFUgSG91cnMpIHwgVHJhaW5pbmcgUG93ZXIgQ29uc3VtcHRpb24gKFcpIHwgVHJhaW5pbmcgTG9jYXRpb24tQmFzZWQgR3JlZW5ob3VzZSBHYXMgRW1pc3Npb25zICh0b25zIENPMmVxKSB8IFRyYWluaW5nIE1hcmtldC1CYXNlZCBHcmVlbmhvdXNlIEdhcyBFbWlzc2lvbnMgKHRvbnMgQ08yZXEpIHxcbnwgOi0tLS0gfCA6LS0tOiB8IC0tLS0tIHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHxcbnwgTGxhbWEtMy4yLTFCIHwgMzcwayB8IFxcLSB8IDcwMCB8IDEwNyB8IDAgfFxufCBMbGFtYS0zLjItM0IgfCA0NjBrIHwgXFwtIHwgNzAwIHwgMTMzIHwgMCB8XG58IFRvdGFsIHwgODMwayB8ICAgICAgICAgODZrIHwgIHwgMjQwIHwgMCB8XG5cblRoZSBtZXRob2RvbG9neSB1c2VkIHRvIGRldGVybWluZSB0cmFpbmluZyBlbmVyZ3kgdXNlIGFuZCBncmVlbmhvdXNlIGdhcyBlbWlzc2lvbnMgY2FuIGJlIGZvdW5kIFtoZXJlXShodHRwczovL2FyeGl2Lm9yZy9wZGYvMjIwNC4wNTE0OSkuIFNpbmNlIE1ldGEgaXMgb3Blbmx5IHJlbGVhc2luZyB0aGVzZSBtb2RlbHMsIHRoZSB0cmFpbmluZyBlbmVyZ3kgdXNlIGFuZCBncmVlbmhvdXNlIGdhcyBlbWlzc2lvbnMgd2lsbCBub3QgYmUgaW5jdXJyZWQgYnkgb3RoZXJzLlxuXG4jIyBUcmFpbmluZyBEYXRhXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZDoqKiBVbmtub3duICBcbioqTGFiZWxpbmcgTWV0aG9kOioqIFVua25vd25cblxuKipPdmVydmlldzoqKiBMbGFtYSAzLjIgd2FzIHByZS10cmFpbmVkIG9uIHVwIHRvIDkgdHJpbGxpb24gdG9rZW5zIG9mIGRhdGEgZnJvbSBwdWJsaWNseSBhdmFpbGFibGUgc291cmNlcy4gRm9yIHRoZSAxQiBhbmQgM0IgTGxhbWEgMy4yIG1vZGVscywgd2UgaW5jb3Jwb3JhdGVkIGxvZ2l0cyBmcm9tIHRoZSBMbGFtYSAzLjEgOEIgYW5kIDcwQiBtb2RlbHMgaW50byB0aGUgcHJlLXRyYWluaW5nIHN0YWdlIG9mIHRoZSBtb2RlbCBkZXZlbG9wbWVudCwgd2hlcmUgb3V0cHV0cyAobG9naXRzKSBmcm9tIHRoZXNlIGxhcmdlciBtb2RlbHMgd2VyZSB1c2VkIGFzIHRva2VuLWxldmVsIHRhcmdldHMuIEtub3dsZWRnZSBkaXN0aWxsYXRpb24gd2FzIHVzZWQgYWZ0ZXIgcHJ1bmluZyB0byByZWNvdmVyIHBlcmZvcm1hbmNlLiBJbiBwb3N0LXRyYWluaW5nIHdlIHVzZWQgYSBzaW1pbGFyIHJlY2lwZSBhcyBMbGFtYSAzLjEgYW5kIHByb2R1Y2VkIGZpbmFsIGNoYXQgbW9kZWxzIGJ5IGRvaW5nIHNldmVyYWwgcm91bmRzIG9mIGFsaWdubWVudCBvbiB0b3Agb2YgdGhlIHByZS10cmFpbmVkIG1vZGVsLiBFYWNoIHJvdW5kIGludm9sdmVkIFN1cGVydmlzZWQgRmluZS1UdW5pbmcgKFNGVCksIFJlamVjdGlvbiBTYW1wbGluZyAoUlMpLCBhbmQgRGlyZWN0IFByZWZlcmVuY2UgT3B0aW1pemF0aW9uIChEUE8pLlxuXG4qKkRhdGEgRnJlc2huZXNzOioqIFRoZSBwcmUtdHJhaW5pbmcgZGF0YSBoYXMgYSBjdXRvZmYgb2YgRGVjZW1iZXIgMjAyMy5cblxuIyMgQmVuY2htYXJrcyBcXC0gRW5nbGlzaCBUZXh0XG5cbkluIHRoaXMgc2VjdGlvbiwgd2UgcmVwb3J0IHRoZSByZXN1bHRzIGZvciBMbGFtYSAzLjIgbW9kZWxzIG9uIHN0YW5kYXJkIGF1dG9tYXRpYyBiZW5jaG1hcmtzLiBGb3IgYWxsIHRoZXNlIGV2YWx1YXRpb25zLCB3ZSB1c2VkIG91ciBpbnRlcm5hbCBldmFsdWF0aW9ucyBsaWJyYXJ5LiBcblxuIyMjIEJhc2UgUHJlLXRyYWluZWQgTW9kZWxzIFxuXG58IENhdGVnb3J5IHwgQmVuY2htYXJrIHwgXFwjIFNob3RzIHwgTWV0cmljIHwgTGxhbWEtMy4yLTFCIHwgTGxhbWEtMy4yLTNCIHwgTGxhbWEtMy4xLThCIHxcbnwgLS0tLS0gfCAtLS0tLSB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfFxufCBHZW5lcmFsIHwgTU1MVSB8IDUgfCBtYWNyb1xcX2F2Zy9hY2NcXF9jaGFyIHwgMzIuMiB8IDU4IHwgNjYuNyB8XG58ICB8IEFHSUV2YWwgRW5nbGlzaCB8IDMtNSB8IGF2ZXJhZ2UvYWNjXFxfY2hhciB8IDIzLjMgfCAzOS4yIHwgNDcuOCB8XG58ICB8IEFSQy1DaGFsbGVuZ2UgfCAyNSB8IGFjY1xcX2NoYXIgfCAzMi44IHwgNjkuMSB8IDc5LjcgfFxufCBSZWFkaW5nIGNvbXByZWhlbnNpb24gfCBTUXVBRCB8IDEgfCBlbSB8IDQ5LjIgfCA2Ny43IHwgNzcgfFxufCAgfCBRdUFDIChGMSkgfCAxIHwgZjEgfCAzNy45IHwgNDIuOSB8IDQ0LjkgfFxufCAgfCBEUk9QIChGMSkgfCAzIHwgZjEgfCAyOC4wIHwgNDUuMiB8IDU5LjUgfFxufCBMb25nIENvbnRleHQgfCBOZWVkbGUgaW4gSGF5c3RhY2sgfCAwIHwgZW0gfCA5Ni44IHwgMSB8IDEgfFxuXG4jIyMgSW5zdHJ1Y3Rpb24tVHVuZWQgTW9kZWxzXG5cbnwgQ2FwYWJpbGl0eSB8ICB8IEJlbmNobWFyayB8IFxcIyBTaG90cyB8IE1ldHJpYyB8IExsYW1hLTMuMi0xQi1JbnN0cnVjdCB8IExsYW1hLTMuMi0zQi1JbnN0cnVjdCB8IExsYW1hLTMuMS04Qi1JbnN0cnVjdCB8XG58IDotLS06IHwgLS0tLS0gfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfFxufCBHZW5lcmFsIHwgIHwgTU1MVSB8IDUgfCBtYWNyb1xcX2F2Zy9hY2MgfCA0OS4zIHwgNjMuNCB8IDY5LjQgfFxufCBSZS13cml0aW5nIHwgIHwgT3Blbi1yZXdyaXRlIGV2YWwgfCAwIHwgbWljcm9cXF9hdmcvcm91Z2VMIHwgNDEuNiB8IDQwLjEgfCA0MC45IHxcbnwgU3VtbWFyaXphdGlvbiB8ICB8IFRMRFI5KyAodGVzdCkgfCAxIHwgcm91Z2VMIHwgMTYuOCB8IDE5LjAgfCAxNy4yIHxcbnwgSW5zdHJ1Y3Rpb24gZm9sbG93aW5nIHwgIHwgSUZFdmFsIHwgMCB8IEF2ZyhQcm9tcHQvSW5zdHJ1Y3Rpb24gYWNjIExvb3NlL1N0cmljdCkgfCA1OS41IHwgNzcuNCB8IDgwLjQgfFxufCBNYXRoIHwgIHwgR1NNOEsgKENvVCkgfCA4IHwgZW1cXF9tYWoxQDEgfCA0NC40IHwgNzcuNyB8IDg0LjUgfFxufCAgfCAgfCBNQVRIIChDb1QpIHwgMCB8IGZpbmFsXFxfZW0gfCAzMC42IHwgNDguMCB8IDUxLjkgfFxufCBSZWFzb25pbmcgfCAgfCBBUkMtQyB8IDAgfCBhY2MgfCA1OS40IHwgNzguNiB8IDgzLjQgfFxufCAgfCAgfCBHUFFBIHwgMCB8IGFjYyB8IDI3LjIgfCAzMi44IHwgMzIuOCB8XG58ICB8ICB8IEhlbGxhc3dhZyB8IDAgfCBhY2MgfCA0MS4yIHwgNjkuOCB8IDc4LjcgfFxufCBUb29sIFVzZSB8ICB8IEJGQ0wgVjIgfCAwIHwgYWNjIHwgMjUuNyB8IDY3LjAgfCA2Ny4xIHxcbnwgIHwgIHwgTmV4dXMgfCAwIHwgbWFjcm9cXF9hdmcvYWNjIHwgMTMuNSB8IDM0LjMgfCAzOC41IHxcbnwgTG9uZyBDb250ZXh0IHwgIHwgSW5maW5pdGVCZW5jaC9Fbi5RQSB8IDAgfCBsb25nYm9va1xcX3FhL2YxIHwgMjAuMyB8IDE5LjggfCAyNy4zIHxcbnwgIHwgIHwgSW5maW5pdGVCZW5jaC9Fbi5NQyB8IDAgfCBsb25nYm9va1xcX2Nob2ljZS9hY2MgfCAzOC4wIHwgNjMuMyB8IDcyLjIgfFxufCAgfCAgfCBOSUgvTXVsdGktbmVlZGxlIHwgMCB8IHJlY2FsbCB8IDc1LjAgfCA4NC43IHwgOTguOCB8XG58IE11bHRpbGluZ3VhbCB8ICB8IE1HU00gKENvVCkgfCAwIHwgZW0gfCAyNC41IHwgNTguMiB8IDY4LjkgfFxuXG4jIyMgTXVsdGlsaW5ndWFsIEJlbmNobWFya3NcblxufCBDYXRlZ29yeSB8IEJlbmNobWFyayB8IExhbmd1YWdlIHwgTGxhbWEtMy4yLTFCLUluc3RydWN0IHwgTGxhbWEtMy4yLTNCLUluc3RydWN0IHwgTGxhbWEtMy4xLThCLUluc3RydWN0IHxcbnwgOi0tLTogfCA6LS0tOiB8IDotLS06IHwgOi0tLTogfCA6LS0tOiB8IDotLS06IHxcbnwgR2VuZXJhbCB8IE1NTFUgKDUtc2hvdCwgbWFjcm9cXF9hdmcvYWNjKSB8IFBvcnR1Z3Vlc2UgfCAzOS44MiB8IDU0LjQ4IHwgNjIuMTIgfFxufCAgfCAgfCBTcGFuaXNoIHwgNDEuNTIgfCA1NS4wOSB8IDYyLjQ1IHxcbnwgIHwgIHwgSXRhbGlhbiB8IDM5Ljc5IHwgNTMuNzcgfCA2MS42MyB8XG58ICB8ICB8IEdlcm1hbiB8IDM5LjIwIHwgNTMuMjkgfCA2MC41OSB8XG58ICB8ICB8IEZyZW5jaCB8IDQwLjQ3IHwgNTQuNTkgfCA2Mi4zNCB8XG58ICB8ICB8IEhpbmRpIHwgMzMuNTEgfCA0My4zMSB8IDUwLjg4IHxcbnwgIHwgIHwgVGhhaSB8IDM0LjY3IHwgNDQuNTQgfCA1MC4zMiB8XG5cbiMjIFJlc3BvbnNpYmlsaXR5ICYgU2FmZXR5XG5cbkFzIHBhcnQgb2Ygb3VyIFJlc3BvbnNpYmxlIHJlbGVhc2UgYXBwcm9hY2gsIHdlIGZvbGxvd2VkIGEgdGhyZWUtcHJvbmdlZCBzdHJhdGVneSB0byBtYW5hZ2luZyB0cnVzdCAmIHNhZmV0eSByaXNrczpcblxuMS4gRW5hYmxlIGRldmVsb3BlcnMgdG8gZGVwbG95IGhlbHBmdWwsIHNhZmUgYW5kIGZsZXhpYmxlIGV4cGVyaWVuY2VzIGZvciB0aGVpciB0YXJnZXQgYXVkaWVuY2UgYW5kIGZvciB0aGUgdXNlIGNhc2VzIHN1cHBvcnRlZCBieSBMbGFtYSAgIFxuMi4gUHJvdGVjdCBkZXZlbG9wZXJzIGFnYWluc3QgYWR2ZXJzYXJpYWwgdXNlcnMgYWltaW5nIHRvIGV4cGxvaXQgTGxhbWEgY2FwYWJpbGl0aWVzIHRvIHBvdGVudGlhbGx5IGNhdXNlIGhhcm0gIFxuMy4gUHJvdmlkZSBwcm90ZWN0aW9ucyBmb3IgdGhlIGNvbW11bml0eSB0byBoZWxwIHByZXZlbnQgdGhlIG1pc3VzZSBvZiBvdXIgbW9kZWxzXG5cbiMjIyBSZXNwb25zaWJsZSBEZXBsb3ltZW50IFxuXG4qKkFwcHJvYWNoOioqIExsYW1hIGlzIGEgZm91bmRhdGlvbmFsIHRlY2hub2xvZ3kgZGVzaWduZWQgdG8gYmUgdXNlZCBpbiBhIHZhcmlldHkgb2YgdXNlIGNhc2VzLiBFeGFtcGxlcyBvbiBob3cgTWV0YVx1MjAxOXMgTGxhbWEgbW9kZWxzIGhhdmUgYmVlbiByZXNwb25zaWJseSBkZXBsb3llZCBjYW4gYmUgZm91bmQgaW4gb3VyIFtDb21tdW5pdHkgU3RvcmllcyB3ZWJwYWdlXShodHRwczovL2xsYW1hLm1ldGEuY29tL2NvbW11bml0eS1zdG9yaWVzLykuIE91ciBhcHByb2FjaCBpcyB0byBidWlsZCB0aGUgbW9zdCBoZWxwZnVsIG1vZGVscywgZW5hYmxpbmcgdGhlIHdvcmxkIHRvIGJlbmVmaXQgZnJvbSB0aGUgdGVjaG5vbG9neSBwb3dlciwgYnkgYWxpZ25pbmcgb3VyIG1vZGVsIHNhZmV0eSBmb3IgZ2VuZXJpYyB1c2UgY2FzZXMgYW5kIGFkZHJlc3NpbmcgYSBzdGFuZGFyZCBzZXQgb2YgaGFybXMuIERldmVsb3BlcnMgYXJlIHRoZW4gaW4gdGhlIGRyaXZlclx1MjAxOXMgc2VhdCB0byB0YWlsb3Igc2FmZXR5IGZvciB0aGVpciB1c2UgY2FzZXMsIGRlZmluaW5nIHRoZWlyIG93biBwb2xpY2llcyBhbmQgZGVwbG95aW5nIHRoZSBtb2RlbHMgd2l0aCB0aGUgbmVjZXNzYXJ5IHNhZmVndWFyZHMgaW4gdGhlaXIgTGxhbWEgc3lzdGVtcy4gTGxhbWEgMy4yIHdhcyBkZXZlbG9wZWQgZm9sbG93aW5nIHRoZSBiZXN0IHByYWN0aWNlcyBvdXRsaW5lZCBpbiBvdXIgW1Jlc3BvbnNpYmxlIFVzZSBHdWlkZV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9yZXNwb25zaWJsZS11c2UtZ3VpZGUvKS4gXG5cbiMjIyMgTGxhbWEgMy4yIEluc3RydWN0IFxuXG4qKk9iamVjdGl2ZToqKiBPdXIgbWFpbiBvYmplY3RpdmVzIGZvciBjb25kdWN0aW5nIHNhZmV0eSBmaW5lLXR1bmluZyBhcmUgdG8gcHJvdmlkZSB0aGUgcmVzZWFyY2ggY29tbXVuaXR5IHdpdGggYSB2YWx1YWJsZSByZXNvdXJjZSBmb3Igc3R1ZHlpbmcgdGhlIHJvYnVzdG5lc3Mgb2Ygc2FmZXR5IGZpbmUtdHVuaW5nLCBhcyB3ZWxsIGFzIHRvIG9mZmVyIGRldmVsb3BlcnMgYSByZWFkaWx5IGF2YWlsYWJsZSwgc2FmZSwgYW5kIHBvd2VyZnVsIG1vZGVsIGZvciB2YXJpb3VzIGFwcGxpY2F0aW9ucyB0byByZWR1Y2UgdGhlIGRldmVsb3BlciB3b3JrbG9hZCB0byBkZXBsb3kgc2FmZSBBSSBzeXN0ZW1zLiBXZSBpbXBsZW1lbnRlZCB0aGUgc2FtZSBzZXQgb2Ygc2FmZXR5IG1pdGlnYXRpb25zIGFzIGluIExsYW1hIDMsIGFuZCB5b3UgY2FuIGxlYXJuIG1vcmUgYWJvdXQgdGhlc2UgaW4gdGhlIExsYW1hIDMgW3BhcGVyXShodHRwczovL2FpLm1ldGEuY29tL3Jlc2VhcmNoL3B1YmxpY2F0aW9ucy90aGUtbGxhbWEtMy1oZXJkLW9mLW1vZGVscy8pLiBcblxuKipGaW5lLVR1bmluZyBEYXRhOioqIFdlIGVtcGxveSBhIG11bHRpLWZhY2V0ZWQgYXBwcm9hY2ggdG8gZGF0YSBjb2xsZWN0aW9uLCBjb21iaW5pbmcgaHVtYW4tZ2VuZXJhdGVkIGRhdGEgZnJvbSBvdXIgdmVuZG9ycyB3aXRoIHN5bnRoZXRpYyBkYXRhIHRvIG1pdGlnYXRlIHBvdGVudGlhbCBzYWZldHkgcmlza3MuIFdlXHUyMDE5dmUgZGV2ZWxvcGVkIG1hbnkgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWwgKExMTSktYmFzZWQgY2xhc3NpZmllcnMgdGhhdCBlbmFibGUgdXMgdG8gdGhvdWdodGZ1bGx5IHNlbGVjdCBoaWdoLXF1YWxpdHkgcHJvbXB0cyBhbmQgcmVzcG9uc2VzLCBlbmhhbmNpbmcgZGF0YSBxdWFsaXR5IGNvbnRyb2wuIFxuXG4qKlJlZnVzYWxzIGFuZCBUb25lOioqIEJ1aWxkaW5nIG9uIHRoZSB3b3JrIHdlIHN0YXJ0ZWQgd2l0aCBMbGFtYSAzLCB3ZSBwdXQgYSBncmVhdCBlbXBoYXNpcyBvbiBtb2RlbCByZWZ1c2FscyB0byBiZW5pZ24gcHJvbXB0cyBhcyB3ZWxsIGFzIHJlZnVzYWwgdG9uZS4gV2UgaW5jbHVkZWQgYm90aCBib3JkZXJsaW5lIGFuZCBhZHZlcnNhcmlhbCBwcm9tcHRzIGluIG91ciBzYWZldHkgZGF0YSBzdHJhdGVneSwgYW5kIG1vZGlmaWVkIG91ciBzYWZldHkgZGF0YSByZXNwb25zZXMgdG8gZm9sbG93IHRvbmUgZ3VpZGVsaW5lcy4gXG5cbiMjIyMgTGxhbWEgMy4yIFN5c3RlbXNcblxuKipTYWZldHkgYXMgYSBTeXN0ZW06KiogTGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzLCBpbmNsdWRpbmcgTGxhbWEgMy4yLCAqKmFyZSBub3QgZGVzaWduZWQgdG8gYmUgZGVwbG95ZWQgaW4gaXNvbGF0aW9uKiogYnV0IGluc3RlYWQgc2hvdWxkIGJlIGRlcGxveWVkIGFzIHBhcnQgb2YgYW4gb3ZlcmFsbCBBSSBzeXN0ZW0gd2l0aCBhZGRpdGlvbmFsIHNhZmV0eSBndWFyZHJhaWxzIGFzIHJlcXVpcmVkLiBEZXZlbG9wZXJzIGFyZSBleHBlY3RlZCB0byBkZXBsb3kgc3lzdGVtIHNhZmVndWFyZHMgd2hlbiBidWlsZGluZyBhZ2VudGljIHN5c3RlbXMuIFNhZmVndWFyZHMgYXJlIGtleSB0byBhY2hpZXZlIHRoZSByaWdodCBoZWxwZnVsbmVzcy1zYWZldHkgYWxpZ25tZW50IGFzIHdlbGwgYXMgbWl0aWdhdGluZyBzYWZldHkgYW5kIHNlY3VyaXR5IHJpc2tzIGluaGVyZW50IHRvIHRoZSBzeXN0ZW0gYW5kIGFueSBpbnRlZ3JhdGlvbiBvZiB0aGUgbW9kZWwgb3Igc3lzdGVtIHdpdGggZXh0ZXJuYWwgdG9vbHMuIEFzIHBhcnQgb2Ygb3VyIHJlc3BvbnNpYmxlIHJlbGVhc2UgYXBwcm9hY2gsIHdlIHByb3ZpZGUgdGhlIGNvbW11bml0eSB3aXRoIFtzYWZlZ3VhcmRzXShodHRwczovL2xsYW1hLm1ldGEuY29tL3RydXN0LWFuZC1zYWZldHkvKSB0aGF0IGRldmVsb3BlcnMgc2hvdWxkIGRlcGxveSB3aXRoIExsYW1hIG1vZGVscyBvciBvdGhlciBMTE1zLCBpbmNsdWRpbmcgTGxhbWEgR3VhcmQsIFByb21wdCBHdWFyZCBhbmQgQ29kZSBTaGllbGQuIEFsbCBvdXIgW3JlZmVyZW5jZSBpbXBsZW1lbnRhdGlvbnNdKGh0dHBzOi8vZ2l0aHViLmNvbS9tZXRhLWxsYW1hL2xsYW1hLWFnZW50aWMtc3lzdGVtKSBkZW1vcyBjb250YWluIHRoZXNlIHNhZmVndWFyZHMgYnkgZGVmYXVsdCBzbyBkZXZlbG9wZXJzIGNhbiBiZW5lZml0IGZyb20gc3lzdGVtLWxldmVsIHNhZmV0eSBvdXQtb2YtdGhlLWJveC4gXG5cbiMjIyBOZXcgQ2FwYWJpbGl0aWVzIGFuZCBVc2UgQ2FzZXNcblxuKipUZWNobm9sb2dpY2FsIEFkdmFuY2VtZW50OioqIExsYW1hIHJlbGVhc2VzIHVzdWFsbHkgaW50cm9kdWNlIG5ldyBjYXBhYmlsaXRpZXMgdGhhdCByZXF1aXJlIHNwZWNpZmljIGNvbnNpZGVyYXRpb25zIGluIGFkZGl0aW9uIHRvIHRoZSBiZXN0IHByYWN0aWNlcyB0aGF0IGdlbmVyYWxseSBhcHBseSBhY3Jvc3MgYWxsIEdlbmVyYXRpdmUgQUkgdXNlIGNhc2VzLiBGb3IgcHJpb3IgcmVsZWFzZSBjYXBhYmlsaXRpZXMgYWxzbyBzdXBwb3J0ZWQgYnkgTGxhbWEgMy4yLCBzZWUgW0xsYW1hIDMuMSBNb2RlbCBDYXJkXShodHRwczovL2dpdGh1Yi5jb20vbWV0YS1sbGFtYS9sbGFtYS1tb2RlbHMvYmxvYi9tYWluL21vZGVscy9sbGFtYTNfMS9NT0RFTF9DQVJELm1kKSwgYXMgdGhlIHNhbWUgY29uc2lkZXJhdGlvbnMgYXBwbHkgaGVyZSBhcyB3ZWxsLlxuXG4qKkNvbnN0cmFpbmVkIEVudmlyb25tZW50czoqKiBMbGFtYSAzLjIgMUIgYW5kIDNCIG1vZGVscyBhcmUgZXhwZWN0ZWQgdG8gYmUgZGVwbG95ZWQgaW4gaGlnaGx5IGNvbnN0cmFpbmVkIGVudmlyb25tZW50cywgc3VjaCBhcyBtb2JpbGUgZGV2aWNlcy4gTExNIFN5c3RlbXMgdXNpbmcgc21hbGxlciBtb2RlbHMgd2lsbCBoYXZlIGEgZGlmZmVyZW50IGFsaWdubWVudCBwcm9maWxlIGFuZCBzYWZldHkvaGVscGZ1bG5lc3MgdHJhZGVvZmYgdGhhbiBtb3JlIGNvbXBsZXgsIGxhcmdlciBzeXN0ZW1zLiBEZXZlbG9wZXJzIHNob3VsZCBlbnN1cmUgdGhlIHNhZmV0eSBvZiB0aGVpciBzeXN0ZW0gbWVldHMgdGhlIHJlcXVpcmVtZW50cyBvZiB0aGVpciB1c2UgY2FzZS4gV2UgcmVjb21tZW5kIHVzaW5nIGxpZ2h0ZXIgc3lzdGVtIHNhZmVndWFyZHMgZm9yIHN1Y2ggdXNlIGNhc2VzLCBsaWtlIExsYW1hIEd1YXJkIDMtMUIgb3IgaXRzIG1vYmlsZS1vcHRpbWl6ZWQgdmVyc2lvbi4gXG5cbiMjIyBFdmFsdWF0aW9uc1xuXG4qKlNjYWxlZCBFdmFsdWF0aW9uczoqKiBXZSBidWlsdCBkZWRpY2F0ZWQsIGFkdmVyc2FyaWFsIGV2YWx1YXRpb24gZGF0YXNldHMgYW5kIGV2YWx1YXRlZCBzeXN0ZW1zIGNvbXBvc2VkIG9mIExsYW1hIG1vZGVscyBhbmQgUHVycGxlIExsYW1hIHNhZmVndWFyZHMgdG8gZmlsdGVyIGlucHV0IHByb21wdCBhbmQgb3V0cHV0IHJlc3BvbnNlLiBJdCBpcyBpbXBvcnRhbnQgdG8gZXZhbHVhdGUgYXBwbGljYXRpb25zIGluIGNvbnRleHQsIGFuZCB3ZSByZWNvbW1lbmQgYnVpbGRpbmcgZGVkaWNhdGVkIGV2YWx1YXRpb24gZGF0YXNldCBmb3IgeW91ciB1c2UgY2FzZS5cblxuKipSZWQgVGVhbWluZzoqKiBXZSBjb25kdWN0ZWQgcmVjdXJyaW5nIHJlZCB0ZWFtaW5nIGV4ZXJjaXNlcyB3aXRoIHRoZSBnb2FsIG9mIGRpc2NvdmVyaW5nIHJpc2tzIHZpYSBhZHZlcnNhcmlhbCBwcm9tcHRpbmcgYW5kIHdlIHVzZWQgdGhlIGxlYXJuaW5ncyB0byBpbXByb3ZlIG91ciBiZW5jaG1hcmtzIGFuZCBzYWZldHkgdHVuaW5nIGRhdGFzZXRzLiBXZSBwYXJ0bmVyZWQgZWFybHkgd2l0aCBzdWJqZWN0LW1hdHRlciBleHBlcnRzIGluIGNyaXRpY2FsIHJpc2sgYXJlYXMgdG8gdW5kZXJzdGFuZCB0aGUgbmF0dXJlIG9mIHRoZXNlIHJlYWwtd29ybGQgaGFybXMgYW5kIGhvdyBzdWNoIG1vZGVscyBtYXkgbGVhZCB0byB1bmludGVuZGVkIGhhcm0gZm9yIHNvY2lldHkuIEJhc2VkIG9uIHRoZXNlIGNvbnZlcnNhdGlvbnMsIHdlIGRlcml2ZWQgYSBzZXQgb2YgYWR2ZXJzYXJpYWwgZ29hbHMgZm9yIHRoZSByZWQgdGVhbSB0byBhdHRlbXB0IHRvIGFjaGlldmUsIHN1Y2ggYXMgZXh0cmFjdGluZyBoYXJtZnVsIGluZm9ybWF0aW9uIG9yIHJlcHJvZ3JhbW1pbmcgdGhlIG1vZGVsIHRvIGFjdCBpbiBhIHBvdGVudGlhbGx5IGhhcm1mdWwgY2FwYWNpdHkuIFRoZSByZWQgdGVhbSBjb25zaXN0ZWQgb2YgZXhwZXJ0cyBpbiBjeWJlcnNlY3VyaXR5LCBhZHZlcnNhcmlhbCBtYWNoaW5lIGxlYXJuaW5nLCByZXNwb25zaWJsZSBBSSwgYW5kIGludGVncml0eSBpbiBhZGRpdGlvbiB0byBtdWx0aWxpbmd1YWwgY29udGVudCBzcGVjaWFsaXN0cyB3aXRoIGJhY2tncm91bmQgaW4gaW50ZWdyaXR5IGlzc3VlcyBpbiBzcGVjaWZpYyBnZW9ncmFwaGljIG1hcmtldHMuXG5cbiMjIyBDcml0aWNhbCBSaXNrcyBcblxuSW4gYWRkaXRpb24gdG8gb3VyIHNhZmV0eSB3b3JrIGFib3ZlLCB3ZSB0b29rIGV4dHJhIGNhcmUgb24gbWVhc3VyaW5nIGFuZC9vciBtaXRpZ2F0aW5nIHRoZSBmb2xsb3dpbmcgY3JpdGljYWwgcmlzayBhcmVhczpcblxuKioxXFwuIENCUk5FIChDaGVtaWNhbCwgQmlvbG9naWNhbCwgUmFkaW9sb2dpY2FsLCBOdWNsZWFyLCBhbmQgRXhwbG9zaXZlIFdlYXBvbnMpOioqIExsYW1hIDMuMiAxQiBhbmQgM0IgbW9kZWxzIGFyZSBzbWFsbGVyIGFuZCBsZXNzIGNhcGFibGUgZGVyaXZhdGl2ZXMgb2YgTGxhbWEgMy4xLiBGb3IgTGxhbWEgMy4xIDcwQiBhbmQgNDA1QiwgdG8gYXNzZXNzIHJpc2tzIHJlbGF0ZWQgdG8gcHJvbGlmZXJhdGlvbiBvZiBjaGVtaWNhbCBhbmQgYmlvbG9naWNhbCB3ZWFwb25zLCB3ZSBwZXJmb3JtZWQgdXBsaWZ0IHRlc3RpbmcgZGVzaWduZWQgdG8gYXNzZXNzIHdoZXRoZXIgdXNlIG9mIExsYW1hIDMuMSBtb2RlbHMgY291bGQgbWVhbmluZ2Z1bGx5IGluY3JlYXNlIHRoZSBjYXBhYmlsaXRpZXMgb2YgbWFsaWNpb3VzIGFjdG9ycyB0byBwbGFuIG9yIGNhcnJ5IG91dCBhdHRhY2tzIHVzaW5nIHRoZXNlIHR5cGVzIG9mIHdlYXBvbnMgYW5kIGhhdmUgZGV0ZXJtaW5lZCB0aGF0IHN1Y2ggdGVzdGluZyBhbHNvIGFwcGxpZXMgdG8gdGhlIHNtYWxsZXIgMUIgYW5kIDNCIG1vZGVscy4gXG5cbioqMlxcLiBDaGlsZCBTYWZldHk6KiogQ2hpbGQgU2FmZXR5IHJpc2sgYXNzZXNzbWVudHMgd2VyZSBjb25kdWN0ZWQgdXNpbmcgYSB0ZWFtIG9mIGV4cGVydHMsIHRvIGFzc2VzcyB0aGUgbW9kZWxcdTIwMTlzIGNhcGFiaWxpdHkgdG8gcHJvZHVjZSBvdXRwdXRzIHRoYXQgY291bGQgcmVzdWx0IGluIENoaWxkIFNhZmV0eSByaXNrcyBhbmQgaW5mb3JtIG9uIGFueSBuZWNlc3NhcnkgYW5kIGFwcHJvcHJpYXRlIHJpc2sgbWl0aWdhdGlvbnMgdmlhIGZpbmUgdHVuaW5nLiBXZSBsZXZlcmFnZWQgdGhvc2UgZXhwZXJ0IHJlZCB0ZWFtaW5nIHNlc3Npb25zIHRvIGV4cGFuZCB0aGUgY292ZXJhZ2Ugb2Ygb3VyIGV2YWx1YXRpb24gYmVuY2htYXJrcyB0aHJvdWdoIExsYW1hIDMgbW9kZWwgZGV2ZWxvcG1lbnQuIEZvciBMbGFtYSAzLCB3ZSBjb25kdWN0ZWQgbmV3IGluLWRlcHRoIHNlc3Npb25zIHVzaW5nIG9iamVjdGl2ZSBiYXNlZCBtZXRob2RvbG9naWVzIHRvIGFzc2VzcyB0aGUgbW9kZWwgcmlza3MgYWxvbmcgbXVsdGlwbGUgYXR0YWNrIHZlY3RvcnMgaW5jbHVkaW5nIHRoZSBhZGRpdGlvbmFsIGxhbmd1YWdlcyBMbGFtYSAzIGlzIHRyYWluZWQgb24uIFdlIGFsc28gcGFydG5lcmVkIHdpdGggY29udGVudCBzcGVjaWFsaXN0cyB0byBwZXJmb3JtIHJlZCB0ZWFtaW5nIGV4ZXJjaXNlcyBhc3Nlc3NpbmcgcG90ZW50aWFsbHkgdmlvbGF0aW5nIGNvbnRlbnQgd2hpbGUgdGFraW5nIGFjY291bnQgb2YgbWFya2V0IHNwZWNpZmljIG51YW5jZXMgb3IgZXhwZXJpZW5jZXMuIFxuXG4qKjNcXC4gQ3liZXIgQXR0YWNrczoqKiBPdXIgY3liZXIgYXR0YWNrIHVwbGlmdCBzdHVkeSBpbnZlc3RpZ2F0ZWQgd2hldGhlciBMTE1zIGNhbiBlbmhhbmNlIGh1bWFuIGNhcGFiaWxpdGllcyBpbiBoYWNraW5nIHRhc2tzLCBib3RoIGluIHRlcm1zIG9mIHNraWxsIGxldmVsIGFuZCBzcGVlZC4gT3VyIGF0dGFjayBhdXRvbWF0aW9uIHN0dWR5IGZvY3VzZWQgb24gZXZhbHVhdGluZyB0aGUgY2FwYWJpbGl0aWVzIG9mIExMTXMgd2hlbiB1c2VkIGFzIGF1dG9ub21vdXMgYWdlbnRzIGluIGN5YmVyIG9mZmVuc2l2ZSBvcGVyYXRpb25zLCBzcGVjaWZpY2FsbHkgaW4gdGhlIGNvbnRleHQgb2YgcmFuc29td2FyZSBhdHRhY2tzLiBUaGlzIGV2YWx1YXRpb24gd2FzIGRpc3RpbmN0IGZyb20gcHJldmlvdXMgc3R1ZGllcyB0aGF0IGNvbnNpZGVyZWQgTExNcyBhcyBpbnRlcmFjdGl2ZSBhc3Npc3RhbnRzLiBUaGUgcHJpbWFyeSBvYmplY3RpdmUgd2FzIHRvIGFzc2VzcyB3aGV0aGVyIHRoZXNlIG1vZGVscyBjb3VsZCBlZmZlY3RpdmVseSBmdW5jdGlvbiBhcyBpbmRlcGVuZGVudCBhZ2VudHMgaW4gZXhlY3V0aW5nIGNvbXBsZXggY3liZXItYXR0YWNrcyB3aXRob3V0IGh1bWFuIGludGVydmVudGlvbi5cblxuIyMjIENvbW11bml0eSBcblxuKipJbmR1c3RyeSBQYXJ0bmVyc2hpcHM6KiogR2VuZXJhdGl2ZSBBSSBzYWZldHkgcmVxdWlyZXMgZXhwZXJ0aXNlIGFuZCB0b29saW5nLCBhbmQgd2UgYmVsaWV2ZSBpbiB0aGUgc3RyZW5ndGggb2YgdGhlIG9wZW4gY29tbXVuaXR5IHRvIGFjY2VsZXJhdGUgaXRzIHByb2dyZXNzLiBXZSBhcmUgYWN0aXZlIG1lbWJlcnMgb2Ygb3BlbiBjb25zb3J0aXVtcywgaW5jbHVkaW5nIHRoZSBBSSBBbGxpYW5jZSwgUGFydG5lcnNoaXAgb24gQUkgYW5kIE1MQ29tbW9ucywgYWN0aXZlbHkgY29udHJpYnV0aW5nIHRvIHNhZmV0eSBzdGFuZGFyZGl6YXRpb24gYW5kIHRyYW5zcGFyZW5jeS4gV2UgZW5jb3VyYWdlIHRoZSBjb21tdW5pdHkgdG8gYWRvcHQgdGF4b25vbWllcyBsaWtlIHRoZSBNTENvbW1vbnMgUHJvb2Ygb2YgQ29uY2VwdCBldmFsdWF0aW9uIHRvIGZhY2lsaXRhdGUgY29sbGFib3JhdGlvbiBhbmQgdHJhbnNwYXJlbmN5IG9uIHNhZmV0eSBhbmQgY29udGVudCBldmFsdWF0aW9ucy4gT3VyIFB1cnBsZSBMbGFtYSB0b29scyBhcmUgb3BlbiBzb3VyY2VkIGZvciB0aGUgY29tbXVuaXR5IHRvIHVzZSBhbmQgd2lkZWx5IGRpc3RyaWJ1dGVkIGFjcm9zcyBlY29zeXN0ZW0gcGFydG5lcnMgaW5jbHVkaW5nIGNsb3VkIHNlcnZpY2UgcHJvdmlkZXJzLiBXZSBlbmNvdXJhZ2UgY29tbXVuaXR5IGNvbnRyaWJ1dGlvbnMgdG8gb3VyIFtHaXRodWIgcmVwb3NpdG9yeV0oaHR0cHM6Ly9naXRodWIuY29tL21ldGEtbGxhbWEvUHVycGxlTGxhbWEpLlxuXG4qKkdyYW50czoqKiBXZSBhbHNvIHNldCB1cCB0aGUgW0xsYW1hIEltcGFjdCBHcmFudHNdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vbGxhbWEtaW1wYWN0LWdyYW50cy8pIHByb2dyYW0gdG8gaWRlbnRpZnkgYW5kIHN1cHBvcnQgdGhlIG1vc3QgY29tcGVsbGluZyBhcHBsaWNhdGlvbnMgb2YgTWV0YVx1MjAxOXMgTGxhbWEgbW9kZWwgZm9yIHNvY2lldGFsIGJlbmVmaXQgYWNyb3NzIHRocmVlIGNhdGVnb3JpZXM6IGVkdWNhdGlvbiwgY2xpbWF0ZSBhbmQgb3BlbiBpbm5vdmF0aW9uLiBUaGUgMjAgZmluYWxpc3RzIGZyb20gdGhlIGh1bmRyZWRzIG9mIGFwcGxpY2F0aW9ucyBjYW4gYmUgZm91bmQgW2hlcmVdKGh0dHBzOi8vbGxhbWEubWV0YS5jb20vbGxhbWEtaW1wYWN0LWdyYW50cy8jZmluYWxpc3RzKS4gXG5cbioqUmVwb3J0aW5nOioqIEZpbmFsbHksIHdlIHB1dCBpbiBwbGFjZSBhIHNldCBvZiByZXNvdXJjZXMgaW5jbHVkaW5nIGFuIFtvdXRwdXQgcmVwb3J0aW5nIG1lY2hhbmlzbV0oaHR0cHM6Ly9kZXZlbG9wZXJzLmZhY2Vib29rLmNvbS9sbGFtYV9vdXRwdXRfZmVlZGJhY2spIGFuZCBbYnVnIGJvdW50eSBwcm9ncmFtXShodHRwczovL3d3dy5mYWNlYm9vay5jb20vd2hpdGVoYXQpIHRvIGNvbnRpbnVvdXNseSBpbXByb3ZlIHRoZSBMbGFtYSB0ZWNobm9sb2d5IHdpdGggdGhlIGhlbHAgb2YgdGhlIGNvbW11bml0eS5cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9ucyBhbmQgTGltaXRhdGlvbnNcbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbioqVmFsdWVzOioqIFRoZSBjb3JlIHZhbHVlcyBvZiBMbGFtYSAzLjIgYXJlIG9wZW5uZXNzLCBpbmNsdXNpdml0eSBhbmQgaGVscGZ1bG5lc3MuIEl0IGlzIG1lYW50IHRvIHNlcnZlIGV2ZXJ5b25lLCBhbmQgdG8gd29yayBmb3IgYSB3aWRlIHJhbmdlIG9mIHVzZSBjYXNlcy4gSXQgaXMgdGh1cyBkZXNpZ25lZCB0byBiZSBhY2Nlc3NpYmxlIHRvIHBlb3BsZSBhY3Jvc3MgbWFueSBkaWZmZXJlbnQgYmFja2dyb3VuZHMsIGV4cGVyaWVuY2VzIGFuZCBwZXJzcGVjdGl2ZXMuIExsYW1hIDMuMiBhZGRyZXNzZXMgdXNlcnMgYW5kIHRoZWlyIG5lZWRzIGFzIHRoZXkgYXJlLCB3aXRob3V0IGluc2VydGlvbiB1bm5lY2Vzc2FyeSBqdWRnbWVudCBvciBub3JtYXRpdml0eSwgd2hpbGUgcmVmbGVjdGluZyB0aGUgdW5kZXJzdGFuZGluZyB0aGF0IGV2ZW4gY29udGVudCB0aGF0IG1heSBhcHBlYXIgcHJvYmxlbWF0aWMgaW4gc29tZSBjYXNlcyBjYW4gc2VydmUgdmFsdWFibGUgcHVycG9zZXMgaW4gb3RoZXJzLiBJdCByZXNwZWN0cyB0aGUgZGlnbml0eSBhbmQgYXV0b25vbXkgb2YgYWxsIHVzZXJzLCBlc3BlY2lhbGx5IGluIHRlcm1zIG9mIHRoZSB2YWx1ZXMgb2YgZnJlZSB0aG91Z2h0IGFuZCBleHByZXNzaW9uIHRoYXQgcG93ZXIgaW5ub3ZhdGlvbiBhbmQgcHJvZ3Jlc3MuIFxuXG4qKlRlc3Rpbmc6KiogTGxhbWEgMy4yIGlzIGEgbmV3IHRlY2hub2xvZ3ksIGFuZCBsaWtlIGFueSBuZXcgdGVjaG5vbG9neSwgdGhlcmUgYXJlIHJpc2tzIGFzc29jaWF0ZWQgd2l0aCBpdHMgdXNlLiBUZXN0aW5nIGNvbmR1Y3RlZCB0byBkYXRlIGhhcyBub3QgY292ZXJlZCwgbm9yIGNvdWxkIGl0IGNvdmVyLCBhbGwgc2NlbmFyaW9zLiBGb3IgdGhlc2UgcmVhc29ucywgYXMgd2l0aCBhbGwgTExNcywgTGxhbWEgMy4yXHUyMDE5cyBwb3RlbnRpYWwgb3V0cHV0cyBjYW5ub3QgYmUgcHJlZGljdGVkIGluIGFkdmFuY2UsIGFuZCB0aGUgbW9kZWwgbWF5IGluIHNvbWUgaW5zdGFuY2VzIHByb2R1Y2UgaW5hY2N1cmF0ZSwgYmlhc2VkIG9yIG90aGVyIG9iamVjdGlvbmFibGUgcmVzcG9uc2VzIHRvIHVzZXIgcHJvbXB0cy4gVGhlcmVmb3JlLCBiZWZvcmUgZGVwbG95aW5nIGFueSBhcHBsaWNhdGlvbnMgb2YgTGxhbWEgMy4yIG1vZGVscywgZGV2ZWxvcGVycyBzaG91bGQgcGVyZm9ybSBzYWZldHkgdGVzdGluZyBhbmQgdHVuaW5nIHRhaWxvcmVkIHRvIHRoZWlyIHNwZWNpZmljIGFwcGxpY2F0aW9ucyBvZiB0aGUgbW9kZWwuIFBsZWFzZSByZWZlciB0byBhdmFpbGFibGUgcmVzb3VyY2VzIGluY2x1ZGluZyBvdXIgW1Jlc3BvbnNpYmxlIFVzZSBHdWlkZV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9yZXNwb25zaWJsZS11c2UtZ3VpZGUpLCBbVHJ1c3QgYW5kIFNhZmV0eV0oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS90cnVzdC1hbmQtc2FmZXR5Lykgc29sdXRpb25zLCBhbmQgb3RoZXIgW3Jlc291cmNlc10oaHR0cHM6Ly9sbGFtYS5tZXRhLmNvbS9kb2NzL2dldC1zdGFydGVkLykgdG8gbGVhcm4gbW9yZSBhYm91dCByZXNwb25zaWJsZSBkZXZlbG9wbWVudC5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKioiLAogICAgImRpc3BsYXlOYW1lIjogIkxsYW1hLTMuMi0zQi1JbnN0cnVjdCIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIkJ1bGsgQnVpbGQiLAogICAgICAgICJOU1BFQ1QtMTFaOC0xMThQIiwKICAgICAgICAibGxhbWEtMy4yLTNiLWluc3RydWN0IiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAicnR4NDA5MHgxLXRocm91Z2hwdXQtbG9yYS1mcDgtMGp1Z2hzbXJwdyIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMzc3NjcyNTEyNCwKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9sbGFtYS0zXzItM2ItaW5zdHJ1Y3QuanBnIiwKICAgICJtb2RlbEZvcm1hdCI6ICJOL0EiLAogICAgIm5hbWUiOiAibGxhbWEtMy4yLTNiLWluc3RydWN0IiwKICAgICJvcmdOYW1lIjogIm5pbSIsCiAgICAicHJlY2lzaW9uIjogIk4vQSIsCiAgICAicHJpdmFjeSI6ICIiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk1ldGEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJUaGUgTWV0YSBMbGFtYSAzLjIgY29sbGVjdGlvbiBvZiBtdWx0aWxpbmd1YWwgbGFyZ2UgbGFuZ3VhZ2UgbW9kZWxzIChMTE1zKSBpcyBhIGNvbGxlY3Rpb24gb2YgcHJlLXRyYWluZWQgYW5kIGluc3RydWN0aW9uLXR1bmVkIGdlbmVyYXRpdmUgbW9kZWxzIGluIDFCIGFuZCAzQiBzaXplcyAodGV4dCBpbi90ZXh0IG91dCkuIiwKICAgICJ0ZWFtTmFtZSI6ICJtZXRhIiwKICAgICJ1cGRhdGVkRGF0ZSI6ICIyMDI1LTA3LTI0VDIyOjMxOjAzLjQ1MloiCn0= source: URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/llama-3_2-3b-instruct optimizationProfiles: - profileId: nim/meta/llama-3.2-3b-instruct:rtx4090x1-throughput-fp8-jtgu5wt2yg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX4090x1 FP8 Throughput ngcMetadata: 08cb5b3735b6331f07212bd488639ad1a049dbcf3e96375acbbb83ca861f9ec9: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX4090 gpu_device: 2684:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX4090 - key: COUNT value: 1 - key: GPU DEVICE value: 2684:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 4GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h20x1-throughput-bf16-hnixelsq-q framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H20x1 BF16 Throughput ngcMetadata: 1cdb4d3f28059cb1aacb005776112ce4f7060a20d25d072932ce60bbe993fabc: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H20 gpu_device: 2329:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H20 - key: COUNT value: 1 - key: GPU DEVICE value: 2329:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:a100x2-latency-bf16-dbue0mkzcw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A100x2 BF16 Latency ngcMetadata: 2146fcf18ea0412d564c6ed21d2f727281b95361fd78ccfa3d0570ec1716e8db: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 2 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:a100x1-throughput-bf16-lblsxfeipq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A100x1 BF16 Throughput ngcMetadata: 222d1729a785201e8a021b226d74d227d01418c41b556283ee1bdbf0a818bd94: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100_NVLx1 BF16 Throughput ngcMetadata: 25b5e251d366671a4011eaada9872ad1d02b48acc33aa0637853a3e3c3caa516: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__2 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A100_SXM4_40GBx2 BF16 Latency ngcMetadata: 30316e5488489e3c0c2b0e7eee9e4bf5e82655b2a31b66d2e2c5dfa2b4e99bb2: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 2 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:rtx4090x1-latency-fp8-cq5x62ffbg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX4090x1 FP8 Latency ngcMetadata: 33ca5a99fa9b89117df4b610b3f37fdf3462bc2e84a5b96bcf7685e5d839f7f5: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX4090 gpu_device: 2684:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX4090 - key: COUNT value: 1 - key: GPU DEVICE value: 2684:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h20x2-latency-bf16-u-xo-smuuq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H20x2 BF16 Latency ngcMetadata: 362bd1de84adb8cc5be888391810dd9cc02ce3f25ad0b70fd500be54f93b9d4c: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H20 gpu_device: 2329:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H20 - key: COUNT value: 2 - key: GPU DEVICE value: 2329:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h200x1-throughput-bf16-frc0n1b7nw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H200x1 BF16 Throughput ngcMetadata: 434e8d336fa23cbe151748d32b71e196d69f20d319ee8b59852a1ca31a48d311: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:b200x2-latency-fp8-04qswl5yla framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct B200x2 FP8 Latency ngcMetadata: 4950d30811e1e426e97cda69e6c03a8a4819db8aa4abf34722ced4542a1f6b52: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__3 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX6000_ADAx1 BF16 Latency ngcMetadata: 566962048d4b01afd12f466ae697cf071eed5a46be33d66f3733e978ce99d1e7: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__4 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100_NVLx1 FP8 Throughput ngcMetadata: 5811750e70b7e9f340f4d670c72fcbd5282e254aeb31f62fd4f937cfb9361007: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 1 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h200x2-latency-bf16--b69z90dgg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H200x2 BF16 Latency ngcMetadata: 6832a9395f54086162fd7b1c6cfaae17c7d1e535a60e2b7675504c9fc7b57689: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h100x2-latency-fp8-r2-4vhtqrq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100x2 FP8 Latency ngcMetadata: 6c3f01dd2b2a56e3e83f70522e4195d3f2add70b28680082204bbb9d6150eb04: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:a10gx1-throughput-bf16-r9bno-v4fw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A10Gx1 BF16 Throughput ngcMetadata: 74bfd8b2df5eafe452a9887637eef4820779fb4e1edb72a4a7a2a1a2d1e6480b: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 1 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h100x1-throughput-fp8-kc5b4ag-cg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100x1 FP8 Throughput ngcMetadata: 7b508014e846234db3cabe5c9f38568b4ee96694b60600a0b71c621dc70cacf3: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h20x2-latency-fp8-icgplntjww framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H20x2 FP8 Latency ngcMetadata: 7fba1c034f3ace0a31d7cc345ec44482735555168c62c332bb38121c26345bbd: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H20 gpu_device: 2329:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H20 - key: COUNT value: 2 - key: GPU DEVICE value: 2329:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__5 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX6000_ADAx1 FP8 Throughput ngcMetadata: 8620431f3069e2f17f1cf712639ba06d67290d74c4c2e9a0d6e606952de91a88: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h20x1-throughput-fp8-bmppgnfoeq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H20x1 FP8 Throughput ngcMetadata: 86be215b815363c818c00883dd403bd1f4ce5c610037637529a2a7e039973de6: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H20 gpu_device: 2329:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H20 - key: COUNT value: 1 - key: GPU DEVICE value: 2329:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:b200x1-throughput-fp8-pysymm95jq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct B200x1 FP8 Throughput ngcMetadata: 8b87146e39b0305ae1d73bc053564d1b4b4c565f81aa5abe3e84385544ca9b60: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l20x1-throughput-bf16-rpqq5ggd-q framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L20x1 BF16 Throughput ngcMetadata: 91c52b108cd75967df6ed98f3d1d73a34cb0899d625f6f86499089f545ebe458: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L20 gpu_device: 26ba:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L20 - key: COUNT value: 1 - key: GPU DEVICE value: 26BA:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__6 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100_NVLx2 FP8 Latency ngcMetadata: a00ce1e782317cd19ed192dcb0ce26ab8b0c1da8928c33de8893897888ff7580: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__7 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX6000_ADAx1 FP8 Latency ngcMetadata: a1ebfd69da7c3b97aa566387a4f086e563ff848cc5bab442147badc55f63364a: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:b200x1-throughput-bf16-iwdccsjltw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct B200x1 BF16 Throughput ngcMetadata: a4c63a91bccf635b570ddb6d14eeb6e7d0acb2389712892b08d21fad2ceaee38: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__8 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX6000_ADAx1 BF16 Throughput ngcMetadata: a7b900f860f8770ecf1a982e79395659729010beeec832b522d96e8243b2439a: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX6000_ADA gpu_device: 26b1:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l40sx1-throughput-bf16-i09pxvzjbg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L40Sx1 BF16 Throughput ngcMetadata: ac5071bbd91efcc71dc486fcd5210779570868b3b8328b4abf7a408a58b5e57c: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l40sx1-throughput-fp8-jnzgjqaxuw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L40Sx1 FP8 Throughput ngcMetadata: ad17776f4619854fccd50354f31132a558a1ca619930698fd184d6ccf5fe3c99: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h200x1-throughput-fp8-r0-6osqtng framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H200x1 FP8 Throughput ngcMetadata: af876a179190d1832143f8b4f4a71f640f3df07b0503259cedee3e3a8363aa96: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 1 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h100x2-latency-bf16-0i4agi9azq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100x2 BF16 Latency ngcMetadata: b3d535c0a7eaaea089b087ae645417c0b32fd01e7e9d638217cc032e51e74fd0: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 2 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__9 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100_NVLx2 BF16 Latency ngcMetadata: b7fad3b35b07d623fac6549078305b71d0e6e1d228a86fa0f7cfe4dbeca9151a: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100_NVL gpu_device: 2321:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: H100_NVL - key: COUNT value: 2 - key: GPU DEVICE value: 2321:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l20x2-latency-bf16-acj72sjf5a framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L20x2 BF16 Latency ngcMetadata: c1c471464263781f56805d7768a50f70c830dbc68d795d641bd5bef18455b6f4: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L20 gpu_device: 26ba:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L20 - key: COUNT value: 2 - key: GPU DEVICE value: 26BA:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l40sx2-latency-fp8-44i4vvrorq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L40Sx2 FP8 Latency ngcMetadata: c4ff823a8202af4b523274fb8c6cdd73fa8ee5af16391a6d36b17f714a3c71a0: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l20x2-latency-fp8-f2nzfrgyia framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L20x2 FP8 Latency ngcMetadata: c610b690036f0e8ac96ea3ed1e584ef5c4f8a4cf1253664b8dc08df5b404de48: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L20 gpu_device: 26ba:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: L20 - key: COUNT value: 2 - key: GPU DEVICE value: 26BA:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__10 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A100_SXM4_40GBx1 BF16 Throughput ngcMetadata: c6821c013c559912c37e61d7b954c5ca8fe07dda76d8bea0f4a52320e0a54427: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A100_SXM4_40GB gpu_device: 20b0:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: A100_SXM4_40GB - key: COUNT value: 1 - key: GPU DEVICE value: 20B0:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:rtx4090x1-throughput-bf16-8m--uis3tg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX4090x1 BF16 Throughput ngcMetadata: c78670b98ba7d5bc4105cbf723eb1cb514e3cb159dacd3d8b997b20c9ceeb1ea: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX4090 gpu_device: 2684:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: RTX4090 - key: COUNT value: 1 - key: GPU DEVICE value: 2684:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l20x1-throughput-fp8-fqsk6q2inq framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L20x1 FP8 Throughput ngcMetadata: d2f14fb35f10d3ffef37a9f198d3c39f37a1452f65a1b523ec0135868fb23ba7: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L20 gpu_device: 26ba:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: L20 - key: COUNT value: 1 - key: GPU DEVICE value: 26BA:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h200x2-latency-fp8-zzxu8dlxcw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H200x2 FP8 Latency ngcMetadata: e4f217a5fb016b570e34b8a8eb06051ccfef9534ba43da973bb7f678242eaa5f: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H200 gpu_device: 2335:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: fp8 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: FP8 - key: GPU value: H200 - key: COUNT value: 2 - key: GPU DEVICE value: 2335:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 5GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:h100x1-throughput-bf16--lfg89p-ew framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct H100x1 BF16 Throughput ngcMetadata: e7dbd9a8ce6270d2ec649a0fecbcae9b5336566113525f20aee3809ba5e63856: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:a10gx2-latency-bf16-0ksvrbt0ww framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct A10Gx2 BF16 Latency ngcMetadata: ee94491ed7167340de93fe9d1c87f10ba424da6f497eeabf83b4edcbeb69364c: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: A10G gpu_device: 2237:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: A10G - key: COUNT value: 2 - key: GPU DEVICE value: 2237:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:b200x2-latency-bf16-f-dquqynva framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct B200x2 BF16 Latency ngcMetadata: f44768c625db71a327cf17e750d5e1a8e60171a8d8ef6b4c1c4b57fe74c9bf46: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: B200 gpu_device: 2901:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: B200 - key: COUNT value: 2 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__11 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct GH200_480GBx1 FP8 Throughput ngcMetadata: f49b49f3d90159a594def51efd8595f1d618e288bca2721fe08e786a1ac67d04: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: fp8 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: FP8 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:rtx4090x1-latency-bf16-b25uxqlekg framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct RTX4090x1 BF16 Latency ngcMetadata: f5e266ce2a4692b37b80e0cb6ab2dea59a54d26b80396f1a521921384bd79ffe: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: RTX4090 gpu_device: 2684:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: latency tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: RTX4090 - key: COUNT value: 1 - key: GPU DEVICE value: 2684:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 7GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:hf-392a143-tool-use-v2__12 framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct GH200_480GBx1 BF16 Throughput ngcMetadata: f7f74ecd523cd63065a50016a8786a893b9b1efe0d313bc5bcc54682f56e55fe: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: GH200_480GB gpu_device: 2342:10de llm_engine: tensorrt_llm number_of_gpus: '1' pp: '1' precision: bf16 profile: throughput tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: THROUGHPUT - key: PRECISION value: BF16 - key: GPU value: GH200_480GB - key: COUNT value: 1 - key: GPU DEVICE value: 2342:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 12GB - key: LLM ENGINE value: TENSORRT_LLM - profileId: nim/meta/llama-3.2-3b-instruct:l40sx2-latency-bf16-pb6dhqvrgw framework: TensorRT-LLM displayName: Llama 3.2 3B Instruct L40Sx2 BF16 Latency ngcMetadata: fa36c3502e92c50f78a1906242f929864955e702b7dbfbdb19758fb7ee9aa811: model: meta/llama-3.2-3b-instruct release: 1.10.1 tags: feat_lora: 'false' gpu: L40S gpu_device: 26b9:10de llm_engine: tensorrt_llm number_of_gpus: '2' pp: '1' precision: bf16 profile: latency tp: '2' modelFormat: trt-llm spec: - key: PROFILE value: LATENCY - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 2 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.10.1 - key: DOWNLOAD SIZE value: 8GB - key: LLM ENGINE value: TENSORRT_LLM labels: - Llama - Meta - Multilingual Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: NeMo Retriever-Parse displayName: Nemoretriever Parse modelHubID: nemoretriever-parse category: Retrieval type: NGC description: Document text extraction model that converts document images into structured text with bounding boxes and semantic classes. Improves retrieval accuracy and supports LLM training data generation. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: nemoretriever-parse:1.2.0 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMy0xM1QwMDoyODozNC4zNTRaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIG5lbW9yZXRyaWV2ZXItcGFyc2UgXG5cbm5lbW9yZXRyaWV2ZXItcGFyc2UgaXMgYSBnZW5lcmFsIHB1cnBvc2UgdGV4dC1leHRyYWN0aW9uIG1vZGVsLCBzcGVjaWZpY2FsbHkgZGVzaWduZWQgdG8gaGFuZGxlIGRvY3VtZW50cy4gR2l2ZW4gYW4gaW1hZ2UsIG5lbW9yZXRyaWV2ZXItcGFyc2UgaXMgYWJsZSB0byBleHRyYWN0IGZvcm1hdHRlZC10ZXh0LCB3aXRoIGJvdW5kaW5nLWJveGVzIGFuZCB0aGUgY29ycmVzcG9uZGluZyBzZW1hbnRpYyBjbGFzcy4gVGhpcyBoYXMgZG93bnN0cmVhbSBiZW5lZml0cyBmb3Igc2V2ZXJhbCB0YXNrcyBzdWNoIGFzIGluY3JlYXNpbmcgdGhlIGF2YWlsYWJpbGl0eSBvZiB0cmFpbmluZy1kYXRhIGZvciBMYXJnZSBMYW5ndWFnZSBNb2RlbHMgKExMTXMpLCBpbXByb3ZpbmcgdGhlIGFjY3VyYWN5IG9mIHJldHJpZXZlciBzeXN0ZW1zLCBhbmQgZW5oYW5jaW5nIGRvY3VtZW50IHVuZGVyc3RhbmRpbmcgcGlwZWxpbmVzLlxuXG4jIyBMaWNlbnNlIFxuR09WRVJOSU5HIFRFUk1TOiBUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LylhbmQgW1Byb2R1Y3QtU3BlY2lmaWMgVGVybXMgZm9yIE5WSURJQSBBSSBQcm9kdWN0c10oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvcHJvZHVjdC1zcGVjaWZpYy10ZXJtcy1mb3ItYWktcHJvZHVjdHMvKS4gVXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQ29tbXVuaXR5IE1vZGVsIExpY2Vuc2VdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS5cblxuIyMgUmVmZXJlbmNlcyBcblxuWzFdIGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZG9jcy90cmFuc2Zvcm1lcnMvZW4vbW9kZWxfZG9jL21iYXJ0XG5cbiMjIE1vZGVsIEFyY2hpdGVjdHVyZSBcblxuIyMjIEFyY2hpdGVjdHVyZSBUeXBlIDogXG5UcmFuc2Zvcm1lci1iYXNlZCB2aXNpb24tZW5jb2Rlci1kZWNvZGVyIG1vZGVsXG5cbiMjIyBOZXR3b3JrIEFyY2hpdGVjdHVyZSBcblxuVmlzaW9uIEVuY29kZXI6IFZpVC1IIG1vZGVsIChodHRwczovL2h1Z2dpbmdmYWNlLmNvL252aWRpYS9DLVJBRElPKVxuQWRhcHRlciBMYXllcjogMUQgY29udm9sdXRpb25zICYgbm9ybXMgdG8gY29tcHJlc3MgZGltZW5zaW9uYWxpdHkgYW5kIHNlcXVlbmNlIGxlbmd0aCBvZiB0aGUgbGF0ZW50IHNwYWNlICgxMjgwIHRva2VucyB0byAzMjAgdG9rZW5zKVxuRGVjb2RlcjogbUJhcnQgWzFdIDEwIGJsb2Nrc1xuVG9rZW5pemVyOiBHYWxhY3RpY2EgKGh0dHBzOi8vYXJ4aXYub3JnL2Ficy8yMjExLjA5MDg1KTsgc2FtZSBhcyBOb3VnYXQgdG9rZW5pemVyXG5cbiMjIyBJbnB1dCBcblxuSW5wdXQgVHlwZTogSW1hZ2UsIFRleHRcblxuSW5wdXQgVHlwZShzKTogUmVkLCBHcmVlbiwgQmx1ZSAoUkdCKSArIFByb21wdCAoU3RyaW5nKVxuXG5JbnB1dCBQYXJhbWV0ZXJzOiAyRCwgMURcblxuT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OlxuXG5NYXggSW5wdXQgUmVzb2x1dGlvbiAoV2lkdGgsIEhlaWdodCk6IDE2NDgsIDIwNDhcblxuTWluIElucHV0IFJlc29sdXRpb24gKFdpZHRoLCBIZWlnaHQpOiAxMDI0LCAxMjgwXG5cbkNoYW5uZWwgQ291bnQ6IDNcblxuIyMjIE91dHB1dCBcblxuT3V0cHV0IFR5cGU6IFRleHRcblxuT3V0cHV0IEZvcm1hdDogU3RyaW5nXG5cbk91dHB1dCBQYXJhbWV0ZXJzOiAxRFxuXG5PdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0OiBuZW1vcmV0cmlldmVyLXBhcnNlIG91dHB1dCBmb3JtYXQgaXMgYSBzdHJpbmcgd2hpY2ggZW5jb2RlcyB0ZXh0IGNvbnRlbnQgKGZvcm1hdHRlZCBvciBub3QpIGFzIHdlbGwgYXMgYm91bmRpbmcgYm94ZXMgYW5kIGNsYXNzIGF0dHJpYnV0ZXMuXG5cbiMjIFNvZnR3YXJlIEludGVncmF0aW9uXG5cblJ1bnRpbWUgRW5naW5lKHMpOiBQeVRvcmNoXG5cblN1cHBvcnRlZCBIYXJkd2FyZSBQbGF0Zm9ybShzKTogTlZJRElBIEhvcHBlci9OVklESUEgQW1wZXJlL05WSURJQSBUdXJpbmdcblxuU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6IExpbnV4XG5cbiMjIE1vZGVsIFZlcnNpb25cblxubmVtb3JldHJpZXZlci1wYXJzZTogQXMgcGFydCBvZiB0aGlzIGZpcnN0IHJlbGVhc2UsIHdlIHNoYXJlIHRoZSBzZXQgb2Ygd2VpZ2h0cyBuYW1lZCBvdmVyam95ZWQtYWRkZXIuXG5cbiMjIFRyYWluaW5nIERhdGFzZXQgXG5cblxubmVtb3JldHJpZXZlci1wYXJzZSBpcyBmaXJzdCBwcmUtdHJhaW5lZCBvbiBvdXIgaW50ZXJuYWwgZGF0YXNldHM6IGh1bWFuLCBzeW50aGV0aWMgYW5kIGF1dG9tYXRlZFxuXG5JbmZlcmVuY2VcbiMjIEluZmVyZW5jZSBcblxuUnVudGltZSBFbmdpbmUocyk6IFB5VG9yY2hcblxuVGVzdCBIYXJkd2FyZTogTlZJRElBIEgxMDAjIFN5bmNocm9uaXphdGlvblxuXG4jIyBFdGhpY2FsIENvbnNpZGVyYXRpb25zXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgc3VwcG9ydGluZyBtb2RlbCB0ZWFtIHRvIGVuc3VyZSB0aGlzIG1vZGVsIG1lZXRzIHJlcXVpcmVtZW50cyBmb3IgdGhlIHJlbGV2YW50IGluZHVzdHJ5IGFuZCB1c2UgY2FzZSBhbmQgYWRkcmVzc2VzIHVuZm9yZXNlZW4gcHJvZHVjdCBtaXN1c2UuXG5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBoZXJlLlxuXG4qKllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cy4qKiIsCiAgICAiZGlzcGxheU5hbWUiOiAibmVtb3JldHJpZXZlci1wYXJzZSIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1VVDRVLTVCTkIiLAogICAgICAgICJhcHBsaWNhdGlvbjptb2RlbDp1c2NzX29iamVjdF9kZXRlY3Rpb24iLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiLAogICAgICAgICJ0ZWNobm9sb2d5Om1vZGVsOnNvbG5fYXBwbGljYXRpb25fZGV2ZWxvcG1lbnQiLAogICAgICAgICJ0ZWNobm9sb2d5Om1vZGVsOnNvbG5faW5mZXJlbmNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiY29udmVydGVkX2NoZWNrcG9pbnRfdjIiLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDU1ODY4NDEzOCwKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9uZW1vcmV0cmlldmVyLXBhcnNlLmpwZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiZnAzMiIsCiAgICAibmFtZSI6ICJuZW1vcmV0cmlldmVyLXBhcnNlIiwKICAgICJvcmdOYW1lIjogIm5pbSIsCiAgICAicHJlY2lzaW9uIjogIk4vQSIsCiAgICAicHJpdmFjeSI6ICIiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAiIiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIm5lbW9yZXRyaWV2ZXItcGFyc2UgaXMgYSB0aW55IGF1dG9yZWdyZXNzaXZlIFZpc2lvbiBMYW5ndWFnZSBNb2RlbCAoVkxNKSBkZXNpZ25lZCBmb3IgZG9jdW1lbnQgdHJhbnNjcmlwdGlvbiBmcm9tIGltYWdlcy4gSXQgb3V0cHV0cyB0ZXh0IGluIHJlYWRpbmcgb3JkZXIuIiwKICAgICJ0ZWFtTmFtZSI6ICJudmlkaWEiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDMtMTNUMDA6Mjk6MzAuNTMwWiIKfQ== source: URL: https://build.nvidia.com/nvidia/nemoretriever-parse optimizationProfiles: - profileId: nim/nvidia/nemoretriever-parse:a100x1-throughput-bf16-e9wjao-enw framework: TensorRT-LLM displayName: nemoretriever-parse A100 BF16 Throughput ngcMetadata: 19c68819d9428cfa494e977f4d2be6378215a8f610cce9bdfc0aa3cdd7d66aa9: model: nvidia/nemoretriever-parse release: 1.2.0 tags: gpu: A100 gpu_device: 20b2:10de llm_engine: tensorrt_llm pp: '1' profile: throughput precision: bf16 tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: Throughput - key: PRECISION value: BF16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20b2:10de - key: NIM VERSION value: 1.2.0 - key: DOWNLOAD SIZE value: 600MB - profileId: nim/nvidia/nemoretriever-parse:h100x1-throughput-bf16-2apiazbpma framework: TensorRT-LLM displayName: nemoretriever-parse H100 BF16 Throughput ngcMetadata: 8db6dcd816ca1ce8d07e72d8b9c4682120b3c50799422361e35b4ab87820efd6: model: nvidia/nemoretriever-parse release: 1.2.0 tags: gpu: H100 gpu_device: 2330:10de llm_engine: tensorrt_llm pp: '1' profile: throughput precision: bf16 tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: Throughput - key: PRECISION value: BF16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10de - key: NIM VERSION value: 1.2.0 - key: DOWNLOAD SIZE value: 600MB - profileId: nim/nvidia/nemoretriever-parse:l40sx1-throughput-bf16-r98ogb1a1a framework: TensorRT-LLM displayName: nemoretriever-parse L40S BF16 Throughput ngcMetadata: 00c8a43783e7acf3d59a0d773cd78d3d29eaa71fa4412af7af2fbaf20e196a8b: model: nvidia/nemoretriever-parse release: 1.2.0 tags: gpu: L40S gpu_device: 26b5:10de llm_engine: tensorrt_llm pp: '1' profile: throughput precision: bf16 tp: '1' modelFormat: trt-llm spec: - key: PROFILE value: Throughput - key: PRECISION value: BF16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26b5:10de - key: NIM VERSION value: 1.2.0 - key: DOWNLOAD SIZE value: 600MB labels: - NeMo - Text Extraction - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Nemoretriever Graphic Elements V1 displayName: Nemoretriever Graphic Elements V1 modelHubID: nemoretriever-graphic-elements-v1 category: Retrieval type: NGC description: Specialized object detection model that extracts elements from charts and graphs — titles, axis labels, legends, and data annotations. Purpose-built for document understanding pipelines. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Nemoretriever Graphic Elements V1 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIFtwcm90ZWN0ZWQgY2xhc3Nlc10oaHR0cHM6Ly93d3cuc2VuYXRlLmNhLmdvdi9jb250ZW50L3Byb3RlY3RlZC1jbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3RpbmcgfCBOb25lIHxcbnwgTWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzIHwgTm9uZSB8IiwKICAgICJidWlsdEJ5IjogIk5WSURJQSIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjUtMDMtMTRUMDA6Mjk6MDguNjc0WiIsCiAgICAiZGVzY3JpcHRpb24iOiAiIyMgKipNb2RlbCBPdmVydmlldyoqXG5cbiMjIyAqKkRlc2NyaXB0aW9uKipcblxuVGhlICoqTmVNbyBSZXRyaWV2ZXIgR3JhcGhpYyBFbGVtZW50cyB2MSoqIG1vZGVsIGlzIGEgc3BlY2lhbGl6ZWQgb2JqZWN0IGRldGVjdGlvbiBzeXN0ZW0gZGVzaWduZWQgdG8gaWRlbnRpZnkgYW5kIGV4dHJhY3Qga2V5IGVsZW1lbnRzIGZyb20gY2hhcnRzIGFuZCBncmFwaHMuIEJhc2VkIG9uIFlPTE9YLCBhbiBhbmNob3ItZnJlZSB2ZXJzaW9uIG9mIFlPTE8gKFlvdSBPbmx5IExvb2sgT25jZSksIHRoaXMgbW9kZWwgY29tYmluZXMgYSBzaW1wbGVyIGFyY2hpdGVjdHVyZSB3aXRoIGVuaGFuY2VkIHBlcmZvcm1hbmNlLiBXaGlsZSB0aGUgdW5kZXJseWluZyB0ZWNobm9sb2d5IGJ1aWxkcyB1cG9uIHdvcmsgZnJvbSBbTWVndmlpIFRlY2hub2xvZ3ldKGh0dHBzOi8vZ2l0aHViLmNvbS9NZWd2aWktQmFzZURldGVjdGlvbi9ZT0xPWCksIHdlIGRldmVsb3BlZCBvdXIgb3duIGJhc2UgbW9kZWwgdGhyb3VnaCBjb21wbGV0ZSByZXRyYWluaW5nIHJhdGhlciB0aGFuIHVzaW5nIHByZS10cmFpbmVkIHdlaWdodHMuXG5cblRoZSBtb2RlbCBleGNlbHMgYXQgZGV0ZWN0aW5nIGFuZCBsb2NhbGl6aW5nIHZhcmlvdXMgZ3JhcGhpYyBlbGVtZW50cyB3aXRoaW4gY2hhcnQgaW1hZ2VzLCBpbmNsdWRpbmcgdGl0bGVzLCBheGlzIGxhYmVscywgbGVnZW5kcywgYW5kIGRhdGEgcG9pbnQgYW5ub3RhdGlvbnMuIFRoaXMgY2FwYWJpbGl0eSBtYWtlcyBpdCBwYXJ0aWN1bGFybHkgdmFsdWFibGUgZm9yIGRvY3VtZW50IHVuZGVyc3RhbmRpbmcgdGFza3MgYW5kIGF1dG9tYXRlZCBkYXRhIGV4dHJhY3Rpb24gZnJvbSB2aXN1YWwgY29udGVudC5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UgYW5kIGlzIGEgcGFydCBvZiB0aGUgTlZJRElBIE5lTW8gUmV0cmlldmVyIGZhbWlseSBvZiBOSU0gbWljcm9zZXJ2aWNlcyBzcGVjaWZpY2FsbHkgZm9yIG9iamVjdCBkZXRlY3Rpb24gYW5kIG11bHRpbW9kYWwgZXh0cmFjdGlvbiBvZiBlbnRlcnByaXNlIGRvY3VtZW50cy5cblxuVGhpcyBtb2RlbCBzdXBlcnNlZGVzIHRoZSBbQ0FDSEVEXShodHRwczovL2J1aWxkLm52aWRpYS5jb20vdW5pdmVyc2l0eS1hdC1idWZmYWxvL2NhY2hlZCkgbW9kZWwuXG5cbiMjIyAqKkxpY2Vuc2UvVGVybXMgb2YgdXNlKipcblxuVXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtYWktZm91bmRhdGlvbi1tb2RlbHMtY29tbXVuaXR5LWxpY2Vuc2UtYWdyZWVtZW50LykuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqXG5cbioqRGVwbG95bWVudCBHZW9ncmFwaHkqKjogR2xvYmFsXG5cbioqVXNlIENhc2UqKjogPGJyPlxuXG5UaGlzIG1vZGVsIGlzIGRlc2lnbmVkIGZvciBhdXRvbWF0aW5nIGV4dHJhY3Rpb24gb2YgZ3JhcGhpYyBlbGVtZW50cyBvZiBjaGFydHMgaW4gZW50ZXJwcmlzZSBkb2N1bWVudHMuIEtleSBhcHBsaWNhdGlvbnMgaW5jbHVkZTpcbi0gRW50ZXJwcmlzZSBkb2N1bWVudCBleHRyYWN0aW9uLCBlbWJlZGRpbmcgYW5kIGluZGV4aW5nXG4tIEF1Z21lbnRpbmcgUmV0cmlldmFsIEF1Z21lbnRlZCBHZW5lcmF0aW9uIChSQUcpIHdvcmtmbG93cyB3aXRoIG11bHRpbW9kYWwgcmV0cmlldmFsXG4tIERhdGEgZXh0cmFjdGlvbiBmcm9tIGxlZ2FjeSBkb2N1bWVudHMgYW5kIHJlcG9ydHNcblxuKipSZWxlYXNlIERhdGUqKjogMjAyNS0wMy0xN1xuXG4jIyMgKipNb2RlbCBBcmNoaXRlY3R1cmUqKlxuXG4qKkFyY2hpdGVjdHVyZSB0eXBlOioqIFlPTE9YIDxicj5cbioqTmV0d29yayBhcmNoaXRlY3R1cmU6KiogRGFya05ldDUzIEJhY2tib25lIFxcKyBGUE4gRGVjb3VwbGVkIGhlYWQgKG9uZSAxeDEgY29udm9sdXRpb24gXFwrIDIgcGFyYWxsZWwgM3gzIGNvbnZvbHV0aW9ucyAob25lIGZvciB0aGUgY2xhc3NpZmljYXRpb24gYW5kIG9uZSBmb3IgdGhlIGJvdW5kaW5nIGJveCBwcmVkaWN0aW9uKVxuXG5ZT0xPWCBpcyBhIHNpbmdsZS1zdGFnZSBvYmplY3QgZGV0ZWN0b3IgdGhhdCBpbXByb3ZlcyBvbiBZb2xvLXYzLiBUaGUgbW9kZWwgaXMgZmluZS10dW5lZCB0byBkZXRlY3QgMTAgY2xhc3NlcyBvZiBvYmplY3RzIGluIGRvY3VtZW50czpcbjEuIENoYXJ0IHRpdGxlXG4xLiBYLWF4aXMgdGl0bGVcbjEuIFktYXhpcyB0aXRsZVxuMS4gWC1heGlzIGxhYmVsKHMpXG4xLiBZLWF4aXMgbGFiZWwocylcbjEuIExlZ2VuZCBsYWJlbChzKVxuMS4gTGVnZW5kIHRpdGxlXG4xLiBNYXJraW5ncyBhbmQgdmFsdWVzIGxhYmVsc1xuMS4gTWlzY2VsbGFuZW91cyBvdGhlciB0ZXh0cyBvbiB0aGUgY2hhcnRcblxuIyMgKipJbnB1dCoqXG5cbioqSW5wdXQgdHlwZShzKToqKiBJbWFnZSA8YnI+XG4qKklucHV0IGZvcm1hdChzKToqKiBSZWQsIEdyZWVuLCBCbHVlIChSR0IpIDxicj5cbioqSW5wdXQgcGFyYW1ldGVyczoqKiBUd28gRGltZW5zaW9uYWwgKDJEKSA8YnI+XG4qKk90aGVyIHByb3BlcnRpZXMgcmVsYXRlZCB0byBpbnB1dDoqKiBFeHBlY3RlZCBpbnB1dCBpcyBhIGBucC5uZGFycmF5YCBpbWFnZSBvZiBzaGFwZSBgW0NoYW5uZWwsIFdpZHRoLCBIZWlnaHRdYCwgb3IgYW4gYG5wLm5kYXJyYXlgIGJhdGNoIG9mIGltYWdlIG9mIHNoYXBlIGBbQmF0Y2gsIENoYW5uZWwsIFdpZHRoLCBIZWlnaHRdYC5cblxuIyMgKipPdXRwdXQqKlxuXG4qKk91dHB1dCB0eXBlKHMpOioqIFRleHQgYXNzb2NpYXRlZCB0byBlYWNoIG9mIHRoZSBmb2xsb3dpbmcgY2xhc3NlcyA6IDxicj5cbiogYFtcImNoYXJ0X3RpdGxlXCIsIFwieF90aXRsZVwiLCBcInlfdGl0bGVcIiwgXCJ4bGFiZWxcIiwgXCJ5bGFiZWxcIiwgXCJvdGhlclwiLCBcImxlZ2VuZF9sYWJlbFwiLCBcImxlZ2VuZF90aXRsZVwiLCBcIm1hcmtfbGFiZWxcIiwgXCJ2YWx1ZV9sYWJlbFwiXWBcblxuKipPdXRwdXQgZm9ybWF0OioqIERpY3Qgb2YgU3RyaW5nIDxicj5cbioqT3V0cHV0IHBhcmFtZXRlcnM6KiogMUQgPGJyPlxuKipPdGhlciBwcm9wZXJ0aWVzIHJlbGF0ZWQgdG8gb3V0cHV0OioqIE5vbmVcblxuIyMjIFNvZnR3YXJlIEludGVncmF0aW9uXG5cbioqUnVudGltZSBFbmdpbmUqKjogKipOZU1vIFJldHJpZXZlciBHcmFwaGljIEVsZW1lbnRzIHYxKiogTklNIDxicj5cbioqU3VwcG9ydGVkIEhhcmR3YXJlIE1pY3JvYXJjaGl0ZWN0dXJlIENvbXBhdGliaWxpdHkqKjogTlZJRElBIEFtcGVyZSwgTlZJRElBIEhvcHBlciwgTlZJRElBIExvdmVsYWNlIDxicj5cbioqU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocykqKjogTGludXhcblxuIyMgKipNb2RlbCBWZXJzaW9uKHMpOioqXG5cbiogYG5lbW9yZXRyaWV2ZXItZ3JhcGhpYy1lbGVtZW50cy12MWBcblxuIyMgKipUcmFpbmluZyBEYXRhc2V0OioqXG5cbiogUHViTWVkIENlbnRyYWwgKFBNQykgQ2hhcnQgRGF0YXNldFxuXG4gICogKipMaW5rOioqIFtodHRwczovL2NoYXJ0aW5mby5naXRodWIuaW8vaW5kZXhcXF8yMDIyLmh0bWxdKGh0dHBzOi8vY2hhcnRpbmZvLmdpdGh1Yi5pby9pbmRleF8yMDIyLmh0bWwpXG4gICogKipEYXRhIGNvbGxlY3Rpb24gbWV0aG9kOioqIEF1dG9tYXRlZCwgSHVtYW5cbiAgKiAqKkxhYmVsaW5nIG1ldGhvZCoqOiBIdW1hblxuICAqICoqRGVzY3JpcHRpb246KiogQSByZWFsLXdvcmxkIGRhdGFzZXQgY29sbGVjdGVkIGZyb20gUHViTWVkIENlbnRyYWwgRG9jdW1lbnRzIGFuZCBtYW51YWxseSBhbm5vdGF0ZWQsIHJlbGVhc2VkIGluIHRoZSBJQ1BSIDIwMjIgQ0hBUlQtSW5mb2dyYXBoaWMgY29tcGV0aXRpb24uIFRoZXJlIGFyZSA1LDYxNCBpbWFnZXMgZm9yIGNoYXJ0IGVsZW1lbnQgZGV0ZWN0aW9uLCA0LDI5MyBpbWFnZXMgZm9yIGZpbmFsIHBsb3QgZGV0ZWN0aW9uIGFuZCBkYXRhIGV4dHJhY3Rpb24sIGFuZCAyMiw5MjQgaW1hZ2VzIGZvciBjaGFydCBjbGFzc2lmaWNhdGlvbi5cblxuKiBEZWVwUnVsZSBkYXRhc2V0XG5cbiAgKiAqKkxpbms6KiogW2h0dHBzOi8vZ2l0aHViLmNvbS9zb2FwMTE3L0RlZXBSdWxlXShodHRwczovL2dpdGh1Yi5jb20vc29hcDExNy9EZWVwUnVsZSlcbiAgKiAqKkRhdGEgY29sbGVjdGlvbiBtZXRob2Q6KiogQXV0b21hdGVkLCBIdW1hblxuICAqICoqTGFiZWxpbmcgbWV0aG9kKio6IERpc3RpbGxhdGlvbiBieSB0aGUgQ0FDSEVEIG1vZGVsXG4gICogKipEZXNjcmlwdGlvbjoqKiBUaGUgb3JpZ2luYWwgZGF0YXNldCBjb25zaXN0cyBvZiAzODYsOTY2IGNoYXJ0IGltYWdlcyBvYnRhaW5lZCBieSBjcmF3bGluZyBwdWJsaWMgRXhjZWwgc2hlZXRzIGZyb20gdGhlIHdlYiB3aXRoIHRleHRzIG92ZXJ3cml0dGVuIHRvIHByb3RlY3QgcHJpdmFjeS4gVGhlIENBQ0hFRCBtb2RlbCBpcyB1c2VkIHRvIHBzZXVkby1sYWJlbCB0aGUgcmVsZXZhbnQgY2xhc3Nlcy4gV2UgdXNlZCBhIHN1YnNhbXBsZSBvZiA5LDA5MSBjaGFydHMgd2hlcmUgYSB0aXRsZSB3YXMgZGV0ZWN0ZWQgZm9yIHRyYWluaW5nIGFsb25nc2lkZSB3aXRoIHRoZSA1LDYxNCBQTUMgdHJhaW5pbmcgaW1hZ2VzLlxuXG4jIyAqKkV2YWx1YXRpb24gUmVzdWx0cyoqXG5cblJlc3VsdHMgd2VyZSBldmFsdWF0ZWQgdXNpbmcgdGhlICoqUE1DIENoYXJ0IGRhdGFzZXQqKi4gVGhlICoqTWVhbiBBdmVyYWdlIFByZWNpc2lvbiAobUFQKSoqIHdhcyB1c2VkIGFzIHRoZSBldmFsdWF0aW9uIG1ldHJpYyB0byBtZWFzdXJlIHRoZSBtb2RlbCdzIGFiaWxpdHkgdG8gY29ycmVjdGx5IGlkZW50aWZ5IGFuZCBsb2NhbGl6ZSBvYmplY3RzIGFjcm9zcyBkaWZmZXJlbnQgY29uZmlkZW5jZSB0aHJlc2hvbGRzLlxuXG4jIyMgKipEYXRhIENvbGxlY3Rpb24gJiBMYWJlbGluZyoqXG4tICoqRGF0YSBjb2xsZWN0aW9uIG1ldGhvZDoqKiAqKkh5YnJpZCAoQXV0b21hdGVkICYgSHVtYW4pKipcbi0gKipMYWJlbGluZyBtZXRob2Q6KiogKipIeWJyaWQgKEF1dG9tYXRlZCAmIEh1bWFuKSoqXG4tICoqUHJvcGVydGllczoqKiBUaGUgdmFsaWRhdGlvbiBkYXRhc2V0IGlzIHRoZSBzYW1lIGFzIHRoZSAqKlBNQyBDaGFydCBkYXRhc2V0KiouXG5cbiMjIyAqKkRhdGFzZXQgT3ZlcnZpZXcqKlxuXG4qKk51bWJlciBvZiBib3VuZGluZyBib3hlcyBhbmQgaW1hZ2VzIHBlciBjbGFzczoqKlxuXG58ICoqTGFiZWwqKiAgICAgICB8ICoqSW1hZ2VzKiogfCAqKkJveGVzKiogfFxufC0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLTp8LS0tLS0tLS0tOnxcbnwgKipjaGFydF90aXRsZSoqICAgfCAzOCAgfCAzOCAgfFxufCAqKmxlZ2VuZF9sYWJlbCoqICB8IDMxOCB8IDEwNzcgfFxufCAqKmxlZ2VuZF90aXRsZSoqICB8IDE3ICB8IDE5ICB8XG58ICoqbWFya19sYWJlbCoqICAgIHwgNDIgIHwgMjE5ICB8XG58ICoqb3RoZXIqKiAgICAgICAgIHwgMTEzIHwgNDY0ICB8XG58ICoqdmFsdWVfbGFiZWwqKiAgIHwgNTIgIHwgNzI2ICB8XG58ICoqeF90aXRsZSoqICAgICAgIHwgNDA0IHwgNDM3ICB8XG58ICoqeGxhYmVsKiogICAgICAgIHwgNTUzIHwgNDA5MSB8XG58ICoqeV90aXRsZSoqICAgICAgIHwgNTAyIHwgNTA1ICB8XG58ICoqeWxhYmVsKiogICAgICAgIHwgNTM0IHwgMzk0NCB8XG58ICoqVG90YWwqKiAgICAgICAgIHwgNTYwIHwgKioxMSw1MjAqKiB8XG5cbiMjIyAqKlBlci1DbGFzcyBQZXJmb3JtYW5jZSBNZXRyaWNzKipcblxuIyMjIyAqKkF2ZXJhZ2UgUHJlY2lzaW9uIChBUCkqKlxufCAqKkNsYXNzKiogICAgICAgfCAqKkFQKiogICB8ICoqQ2xhc3MqKiAgICAgICB8ICoqQVAqKiAgIHwgKipDbGFzcyoqICAgICAgfCAqKkFQKiogICB8XG58LS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS06fC0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tOnwtLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tOnxcbnwgKipjaGFydF90aXRsZSoqICB8IDgyLjM4ICB8ICoqeF90aXRsZSoqICAgICB8IDg4Ljc3ICB8ICoqeV90aXRsZSoqICAgIHwgODkuNDggIHxcbnwgKip4bGFiZWwqKiAgICAgIHwgODUuMDQgIHwgKip5bGFiZWwqKiAgICAgIHwgODYuMjIgIHwgKipvdGhlcioqICAgICAgfCA1NS4xNCAgfFxufCAqKmxlZ2VuZF9sYWJlbCoqIHwgODQuMDkgIHwgKipsZWdlbmRfdGl0bGUqKiB8IDYwLjYxICB8ICoqbWFya19sYWJlbCoqIHwgNDkuMzEgIHxcbnwgKip2YWx1ZV9sYWJlbCoqICB8IDYyLjY2ICB8ICAgICAgICAgICAgICAgIHwgICAgICAgIHwgICAgICAgICAgICAgICB8ICAgICAgICB8XG5cbiMjIyMgKipBdmVyYWdlIFJlY2FsbCAoQVIpKipcbnwgKipDbGFzcyoqICAgICAgIHwgKipBUioqICAgfCAqKkNsYXNzKiogICAgICAgfCAqKkFSKiogICB8ICoqQ2xhc3MqKiAgICAgIHwgKipBUioqICAgfFxufC0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tOnwtLS0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLTp8LS0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLTp8XG58ICoqY2hhcnRfdGl0bGUqKiAgfCA5My4xNiAgfCAqKnhfdGl0bGUqKiAgICAgfCA5Mi4zMSAgfCAqKnlfdGl0bGUqKiAgICB8IDkyLjMyICB8XG58ICoqeGxhYmVsKiogICAgICB8IDg4LjkzICB8ICoqeWxhYmVsKiogICAgICB8IDg5LjQwICB8ICoqb3RoZXIqKiAgICAgIHwgNzkuNDggIHxcbnwgKipsZWdlbmRfbGFiZWwqKiB8IDg4LjA3ICB8ICoqbGVnZW5kX3RpdGxlKiogfCA2OC40MiAgfCAqKm1hcmtfbGFiZWwqKiB8IDczLjYxICB8XG58ICoqdmFsdWVfbGFiZWwqKiAgfCA2OC4zMiAgfCAgICAgICAgICAgICAgICB8ICAgICAgICB8ICAgICAgICAgICAgICAgfCAgICAgICAgfFxuXG5cbiMjICoqSW5mZXJlbmNlOioqXG5cbioqRW5naW5lOioqIFRlbnNvcihSVCkgPGJyPlxuKipUZXN0IGhhcmR3YXJlOioqIFRlc3RlZCBvbiBhbGwgc3VwcG9ydGVkIGhhcmR3YXJlIGxpc3RlZCBpbiBjb21wYXRpYmlsaXR5IHNlY3Rpb25cblxuIyMgKipFdGhpY2FsIENvbnNpZGVyYXRpb25zOioqXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLlxuXG4qKkZvciBtb3JlIGRldGFpbGVkIGluZm9ybWF0aW9uIG9uIGV0aGljYWwgY29uc2lkZXJhdGlvbnMgZm9yIHRoaXMgbW9kZWwqKiwgcGxlYXNlIHNlZSB0aGUgTW9kZWwgQ2FyZCsrIFtFeHBsYWluYWJpbGl0eV0oZXhwbGFpbmFiaWxpdHkubWQpLCBbQmlhc10oYmlhcy5tZCksIFtTYWZldHkgJiBTZWN1cml0eV0oc2FmZXR5LXNlY3VyaXR5Lm1kKSwgYW5kIFtQcml2YWN5XShwcml2YWN5Lm1kKSBTdWJjYXJkcy5cblxuUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuIyMgR2V0IEhlbHBcblxuIyMjIEVudGVycHJpc2UgU3VwcG9ydFxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciAgc3VibWl0IGEgdGlja2V0IGF0IHRoZSBbTlZJRElBIEFJIEVudGVycHJpc2UgU3VwcG9ydCBTZXJ2aWNlcyBwYWdlLl0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuIyMjIE5WSURJQSBOSU0gRG9jdW1lbnRhdGlvblxuVmlzaXQgdGhlIFtOZU1vIFJldHJpZXZlciBkb2NzIHBhZ2VdKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25lbW8vcmV0cmlldmVyL2luZGV4Lmh0bWwpIGZvciByZWxlYXNlIGRvY3VtZW50YXRpb24sIGRlcGxveW1lbnQgZ3VpZGVzIGFuZCBtb3JlLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiTmVNbyBSZXRyaWV2ZXIgR3JhcGhpYyBFbGVtZW50cyB2MSIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IEludGVuZGVkIEFwcGxpY2F0aW9uICYgRG9tYWluOiB8IE9iamVjdCBEZXRlY3Rpb24gfFxufCBNb2RlbCBUeXBlOiB8IFlPTE9YLWFyY2hpdGVjdHVyZSBmb3IgZGV0ZWN0aW9uIG9mIGdyYXBoaWMgZWxlbWVudHMgd2l0aGluIGltYWdlcyBvZiBjaGFydHMuIHxcbnwgSW50ZW5kZWQgVXNlcjogfCBFbnRlcnByaXNlIGRldmVsb3BlcnMsIGRhdGEgc2NpZW50aXN0cywgYW5kIG90aGVyIHRlY2huaWNhbCB1c2VycyB3aG8gbmVlZCB0byBleHRyYWN0IHRleHR1YWwgZWxlbWVudHMgZnJvbSBjaGFydHMgYW5kIGdyYXBocy4gfFxufCBPdXRwdXQ6IHwgQSBMaXN0IG9mIGRpY3Rpb25hcmllcyBjb250YWluaW5nIGxpc3RzIG9mIGRpY3Rpb25hcmllcyBvZiBmbG9hdGluZyBwb2ludCBudW1iZXJzIChyZXByZXNlbnRpbmcgYm91bmRpbmcgYm94IGluZm9ybWF0aW9uKS4gPGJyPiAqKkV4YW1wbGUqKjogYHtcImRhdGFcIjogW3tcImluZGV4XCI6IDAsXCJib3VuZGluZ19ib3hlc1wiOiB7XCJ0YWJsZVwiOiBbe1wieF9taW5cIjogMC42NTAzLFwieV9taW5cIjogMC4yMTYxLFwieF9tYXhcIjogMC43ODM1LFwieV9tYXhcIjogMC4zMjM2LFwiY29uZmlkZW5jZVwiOiAwLjkzMDZ9XX19XX1gIHxcbnwgRGVzY3JpYmUgaG93IHRoZSBtb2RlbCB3b3JrczogfCBGaW5kcyBhbmQgaWRlbnRpZmllcyBvYmplY3RzIGluIGltYWdlcyBieSBmaXJzdCBkaXZpZGluZyB0aGUgaW1hZ2UgaW50byBhIGdyaWQuIEZvciBlYWNoIHNlY3Rpb24gb2YgdGhlIGdyaWQsIHRoZSBtb2RlbCB1c2VzIGEgc2VyaWVzIG9mIG5ldXJhbCBuZXR3b3JrcyB0byBleHRyYWN0IHZpc3VhbCBmZWF0dXJlcyBhbmQgc2ltdWx0YW5lb3VzbHkgcHJlZGljdCB3aGF0IG9iamVjdHMgYXJlIHByZXNlbnQgKGluIHRoaXMgY2FzZSBcImNoYXJ0IHRpdGxlXCIgb3IgXCJheGlzIGxhYmVsXCIgZXRjLikgYW5kIGV4YWN0bHkgd2hlcmUgdGhleSBhcmUgbG9jYXRlZCBpbiB0aGF0IHNlY3Rpb24sIGFsbCBpbiBhIHNpbmdsZSBwYXNzIHRocm91Z2ggdGhlIGltYWdlLiB8XG58IFBlcmZvcm1hbmNlIE1ldHJpY3M6IHwgQWNjdXJhY3ksIFRocm91Z2hwdXQsIGFuZCBMYXRlbmN5IHxcbnwgUG90ZW50aWFsIEtub3duIFJpc2tzOiB8IFRoaXMgbW9kZWwgd2lsbCBub3QgYWx3YXlzIGRldGVjdCBhbGwgZ3JhcGhpYyBlbGVtZW50cyBpbiBhbiBpbWFnZSwgZXNwZWNpYWxseSBmb3IgdW5jb21tb24gZWxlbWVudHMgb3IgbG93ZXIgcXVhbGl0eSBpbWFnZXMuIHxcbnwgTGljZW5zaW5nICYgVGVybXMgb2YgVXNlOiB8IFVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWFpLWZvdW5kYXRpb24tbW9kZWxzLWNvbW11bml0eS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCB0aGUgW0FwYWNoZSAyLjAgTGljZW5zZV0oaHR0cHM6Ly9naXRodWIuY29tL01lZ3ZpaS1CYXNlRGV0ZWN0aW9uL1lPTE9YL2Jsb2IvbWFpbi9MSUNFTlNFKS4gfFxufCBUZWNobmljYWwgTGltaXRhdGlvbnMgfCBUaGUgbW9kZWwgbWF5IGNvcnJlY3RseSBkZXRlY3QgZ3JhcGhpYyBlbGVtZW50cyBvZiBjaGFydHMsIGVzcGVjdGlhbGx5IG9uIHVuY29tbW9uIGNoYXJ0IHN0eWxlcyBvciBsb3dlciBxdWFsaXR5IGltYWdlcy4gfFxufCBOYW1lIHRoZSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIHRoaXMgaGFzIGJlZW4gdGVzdGVkIHRvIGRlbGl2ZXIgY29tcGFyYWJsZSBvdXRjb21lcyByZWdhcmRsZXNzIG9mOiB8IE5vdCBBcHBsaWNhYmxlIHxcbnwgVmVyaWZpZWQgdG8gaGF2ZSBtZXQgcHJlc2NyaWJlZCBOVklESUEgcXVhbGl0eSBzdGFuZGFyZHM6IHwgWWVzIHwiLAogICAgImZyYW1ld29yayI6ICJPdGhlciIsCiAgICAiaGFzUGxheWdyb3VuZCI6IGZhbHNlLAogICAgImhhc1NpZ25lZFZlcnNpb24iOiB0cnVlLAogICAgImlzUGxheWdyb3VuZEVuYWJsZWQiOiBmYWxzZSwKICAgICJpc1B1YmxpYyI6IGZhbHNlLAogICAgImlzUmVhZE9ubHkiOiB0cnVlLAogICAgImxhYmVscyI6IFsKICAgICAgICAiTlNQRUNULTNBMFEtUDM0RyIsCiAgICAgICAgIm52YWllOm1vZGVsOm52YWllX3N1cHBvcnRlZCIsCiAgICAgICAgIm52aWRpYV9uaW06bW9kZWw6bmltbWNyb19udmlkaWFfbmltIiwKICAgICAgICAicHJvZHVjdE5hbWVzOm5pbS1kZXYiLAogICAgICAgICJwcm9kdWN0TmFtZXM6bnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAibGF0ZXN0VmVyc2lvbklkU3RyIjogInJ0eDYwMDAtYmxhY2t3ZWxsLXN2eDEtdHJ0LWZwMTYtMXRlZDRjY2htYSIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMjgxMDEyMjQ2LAogICAgImxvZ28iOiAiaHR0cHM6Ly9kZXZlbG9wZXItYmxvZ3MubnZpZGlhLmNvbS93cC1jb250ZW50L3VwbG9hZHMvMjAyNC8wMy9uZW1vLXJldHJpZXZlci1ncmFwaGljLnBuZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiVHJpdG9uIiwKICAgICJuYW1lIjogIm5lbW9yZXRyaWV2ZXItZ3JhcGhpYy1lbGVtZW50cy12MSIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJGUDMyIiwKICAgICJwcml2YWN5IjogInwgRmllbGQgfCBSZXNwb25zZSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBHZW5lcmF0YWJsZSBvciByZXZlcnNlIGVuZ2luZWVyYWJsZSBwZXJzb25hbCBkYXRhPyB8IE5vIHxcbnwgUGVyc29uYWwgZGF0YSB1c2VkIHRvIGNyZWF0ZSB0aGlzIG1vZGVsPyB8IE5vbmUgfFxufCBIb3cgb2Z0ZW4gaXMgdGhlIGRhdGFzZXQgcmV2aWV3ZWQ/IHwgQmVmb3JlIEV2ZXJ5IFJlbGVhc2UgfFxufCBJcyBhIG1lY2hhbmlzbSBpbiBwbGFjZSB0byBob25vciBkYXRhIHN1YmplY3QgcmlnaHQgb2YgYWNjZXNzIG9yIGRlbGV0aW9uIG9mIHBlcnNvbmFsIGRhdGE/IHwgTm8gfFxufCBJcyB0aGVyZSBwcm92ZW5hbmNlIGZvciBhbGwgZGF0YXNldHMgdXNlZCBpbiB0cmFpbmluZz8gfCBZZXMgfFxufCBEb2VzIGRhdGEgbGFiZWxpbmcgKGFubm90YXRpb24sIG1ldGFkYXRhKSBjb21wbHkgd2l0aCBwcml2YWN5IGxhd3M/IHwgWWVzIHwiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IE1vZGVsIEFwcGxpY2F0aW9uKHMpOiB8IE9iamVjdCBEZXRlY3Rpb24gZm9yIFJldHJpZXZhbCwgZm9jdXNlZCBvbiBFbnRlcnByaXNlIHxcbnwgRGVzY3JpYmUgdGhlIHBoeXNpY2FsIHNhZmV0eSBpbXBhY3QgKGlmIHByZXNlbnQpLiB8IE5vdCBBcHBsaWNhYmxlIHxcbnwgVXNlIENhc2UgUmVzdHJpY3Rpb25zOiB8IEFiaWRlIGJ5IFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykuICAgfFxufCBNb2RlbCBhbmQgZGF0YXNldCByZXN0cmljdGlvbnM6IHwgVGhlIFByaW5jaXBsZSBvZiBsZWFzdCBwcml2aWxlZ2UgKFBvTFApIGlzIGFwcGxpZWQgbGltaXRpbmcgYWNjZXNzIGZvciBkYXRhc2V0IGdlbmVyYXRpb24gYW5kIG1vZGVsIGRldmVsb3BtZW50LiBSZXN0cmljdGlvbnMgZW5mb3JjZSBkYXRhc2V0IGFjY2VzcyBkdXJpbmcgdHJhaW5pbmcsIGFuZCBkYXRhc2V0IGxpY2Vuc2UgY29uc3RyYWludHMgYWRoZXJlZCB0by4gfCIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJOVklESUEgTmVNb1x1MjEyMiBSZXRyaWV2ZXIgTklNIGZvciBncmFwaGljIGVsZW1lbnRzIHYxIGlzIGEgZmluZS10dW5lZCBvYmplY3QgZGV0ZWN0aW9uIG1vZGVsLCB0cmFpbmVkIHNwZWNpZmljYWxseSBmb3IgZGV0ZWN0aW5nIHRoZSBlbGVtZW50cyBvZiBjaGFydHMgYW5kIHRhYmxlcyBpbiBkb2N1bWVudHMiLAogICAgInRlYW1OYW1lIjogIm52aWRpYSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0xNVQxODo0MzozMS41MTNaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/nemoretriever-graphic-elements-v1 optimizationProfiles: - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:a10gx1-trt-fp16-nwnqycg0xg framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 A10Gx1 FP16 ngcMetadata: 09231248dff89cf8859d9206931342e468fbddfe469df56334fbe00df7fda1da: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.6' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A10G - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:b200x1-trt-fp16-jtagdygnhq framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 B200x1 FP16 ngcMetadata: 0f3b150544da8a053048c1e2a37a282b2c43f09a99253882578d12bc1f2cfca6: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '10.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:h100x1-trt-fp16-jswckvqtmq framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 H100x1 FP16 ngcMetadata: 58adeef41afa742e753314ae51818e9f017f2c92ba0bfdc01befe6234703a54c: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '9.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:rtx6000-blackwell-svx1-trt-fp16-1ted4cchma framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 RTX6000x1 FP16 ngcMetadata: b4cc2f8b3d2dcf1afdcafbee8ea694c53aeee642d76f709ed0e79477b68a8dde: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '12.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: RTX6000 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:l40sx1-trt-fp16-cwnvuqbbna framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 L40Sx1 FP16 ngcMetadata: bc1487bf0ec3430f17595fff029c1bc50668344c7a30f9e5d64ee061c6e2d5fa: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.9' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:2_ONNX_FP16_1024 framework: ONNX displayName: Nemoretriever Graphic Elements V1 ONNX FP16 ngcMetadata: edc693c6fccd68d266622eace04225421e353d7ce31e3b207afc5ff35124127b: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton model_type: onnx precision: fp16 modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: ONNX - profileId: nim/nvidia/nemoretriever-graphic-elements-v1:a100x1-trt-fp16-qpwy-4niaa framework: TensorRT-LLM displayName: Nemoretriever Graphic Elements V1 A100x1 FP16 ngcMetadata: f0fb2f72a66230096c40fc3307872ebb9bce69816cbfc6e2918695ca824bd284: model: nvidia/nemoretriever-graphic-elements-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT labels: - signed images - NVIDIA AI Enterprise Supported - NVIDIA NIM - NSPECT-7OBP-T77C config: architectures: - Other modelType: NGC license: NVIDIA AI Foundation Models Community License - name: Nemoretriever Page Elements V2 displayName: Nemoretriever Page Elements V2 modelHubID: nemoretriever-page-elements-v2 category: Retrieval type: NGC description: Object detection model for identifying tables, charts, infographics, and titles within document pages. Improved accuracy and broader element coverage over its predecessor. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Nemoretriever Page Elements V2 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIFtwcm90ZWN0ZWQgY2xhc3Nlc10oaHR0cHM6Ly93d3cuc2VuYXRlLmNhLmdvdi9jb250ZW50L3Byb3RlY3RlZC1jbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3RpbmcgfCBOb25lIHxcbnwgTWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzIHwgTm9uZSB8IiwKICAgICJidWlsdEJ5IjogIk5WSURJQSIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjUtMDMtMTRUMDA6NDc6MDEuNTYzWiIsCiAgICAiZGVzY3JpcHRpb24iOiAiIyMgTW9kZWwgT3ZlcnZpZXdcblxuIyMjIERlc2NyaXB0aW9uXG5cblRoZSAqKk5lTW8gUmV0cmlldmVyIFBhZ2UgRWxlbWVudHMgdjIqKiBtb2RlbCBpcyBhIHNwZWNpYWxpemVkIG9iamVjdCBkZXRlY3Rpb24gbW9kZWwgZGVzaWduZWQgdG8gaWRlbnRpZnkgYW5kIGV4dHJhY3Qga2V5IGVsZW1lbnRzIGZyb20gY2hhcnRzIGFuZCBncmFwaHMuIFdoaWxlIHRoZSB1bmRlcmx5aW5nIHRlY2hub2xvZ3kgYnVpbGRzIHVwb24gd29yayBmcm9tIFtNZWd2aWkgVGVjaG5vbG9neV0oaHR0cHM6Ly9naXRodWIuY29tL01lZ3ZpaS1CYXNlRGV0ZWN0aW9uL1lPTE9YKSwgd2UgZGV2ZWxvcGVkIG91ciBvd24gYmFzZSBtb2RlbCB0aHJvdWdoIGNvbXBsZXRlIHJldHJhaW5pbmcgcmF0aGVyIHRoYW4gdXNpbmcgcHJlLXRyYWluZWQgd2VpZ2h0cy4gWU9MT1ggaXMgYW4gYW5jaG9yLWZyZWUgdmVyc2lvbiBvZiBZT0xPIChZb3UgT25seSBMb29rIE9uY2UpLCB0aGlzIG1vZGVsIGNvbWJpbmVzIGEgc2ltcGxlciBhcmNoaXRlY3R1cmUgd2l0aCBlbmhhbmNlZCBwZXJmb3JtYW5jZS4gVGhlIG1vZGVsIGlzIHRyYWluZWQgdG8gZGV0ZWN0ICoqdGFibGVzKiosICoqY2hhcnRzKiosICoqaW5mb2dyYXBoaWNzKiosIGFuZCAqKnRpdGxlcyoqIGluIGRvY3VtZW50cy5cblxuVGhpcyBtb2RlbCBzdXBlcnNlZGVzIHRoZSBbbnYteW9sb3gtcGFnZS1lbGVtZW50c10oaHR0cHM6Ly9idWlsZC5udmlkaWEuY29tL252aWRpYS9udi15b2xveC1wYWdlLWVsZW1lbnRzLXYxKSBtb2RlbC5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UgYW5kIGlzIGEgcGFydCBvZiB0aGUgTlZJRElBIE5lTW8gUmV0cmlldmVyIGZhbWlseSBvZiBOSU0gbWljcm9zZXJ2aWNlcyBzcGVjaWZpY2FsbHkgZm9yIG9iamVjdCBkZXRlY3Rpb24gYW5kIG11bHRpbW9kYWwgZXh0cmFjdGlvbiBvZiBlbnRlcnByaXNlIGRvY3VtZW50cy5cblxuIyMjIExpY2Vuc2UvVGVybXMgb2YgdXNlXG5cblRoZSB1c2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuIyMjIE1vZGVsIEFyY2hpdGVjdHVyZVxuXG4qKkFyY2hpdGVjdHVyZSBUeXBlKio6IFlPTE9YIDxicj5cbioqTmV0d29yayBBcmNoaXRlY3R1cmUqKjogRGFya05ldDUzIEJhY2tib25lIFxcKyBGUE4gRGVjb3VwbGVkIGhlYWQgKG9uZSAxeDEgY29udm9sdXRpb24gXFwrIDIgcGFyYWxsZWwgM3gzIGNvbnZvbHV0aW9ucyAob25lIGZvciB0aGUgY2xhc3NpZmljYXRpb24gYW5kIG9uZSBmb3IgdGhlIGJvdW5kaW5nIGJveCBwcmVkaWN0aW9uKS4gWU9MT1ggaXMgYSBzaW5nbGUtc3RhZ2Ugb2JqZWN0IGRldGVjdG9yIHRoYXQgaW1wcm92ZXMgb24gWW9sby12My4gPGJyPlxuKipEZXBsb3ltZW50IEdlb2dyYXBoeSoqOiBHbG9iYWxcblxuKipVc2UgQ2FzZSoqOiA8YnI+XG5UaGlzIG1vZGVsIGlzIGRlc2lnbmVkIGZvciBhdXRvbWF0aW5nIGV4dHJhY3Rpb24gb2YgY2hhcnRzLCB0YWJsZXMsIGluZm9ncmFwaGljcywgYW5kIHRpdGxlcyBpbiBlbnRlcnByaXNlIGRvY3VtZW50cy4gS2V5IGFwcGxpY2F0aW9ucyBpbmNsdWRlOlxuLSBFbnRlcnByaXNlIGRvY3VtZW50IGV4dHJhY3Rpb24sIGVtYmVkZGluZyBhbmQgaW5kZXhpbmdcbi0gQXVnbWVudGluZyBSZXRyaWV2YWwgQXVnbWVudGVkIEdlbmVyYXRpb24gKFJBRykgd29ya2Zsb3dzIHdpdGggbXVsdGltb2RhbCByZXRyaWV2YWxcbi0gRGF0YSBleHRyYWN0aW9uIGZyb20gbGVnYWN5IGRvY3VtZW50cyBhbmQgcmVwb3J0c1xuXG4qKlJlbGVhc2UgRGF0ZSoqOiAyMDI1LTAzLTE3XG5cbiMjIyBJbnRlbmRlZCB1c2VcblxuVGhlICoqTmVNbyBSZXRyaWV2ZXIgUGFnZSBFbGVtZW50cyB2MioqIG1vZGVsIGlzIHN1aXRhYmxlIGZvciB1c2VycyB3aG8gd2FudCB0byBleHRyYWN0LCBhbmQgdWx0aW1hdGVseSByZXRyaWV2ZSwgdGFibGVzLCBjaGFydHMgYW5kIGluZm9ncmFwaGljcy4gSXQgY2FuIGJlIHVzZWQgZm9yIGRvY3VtZW50IGFuYWx5c2lzLCB1bmRlcnN0YW5kaW5nIGFuZCBwcm9jZXNzaW5nLlxuXG4jIyBUZWNobmljYWwgRGV0YWlsc1xuXG4jIyMgSW5wdXRcblxuKipJbnB1dCBUeXBlKHMpKio6IEltYWdlIDxicj5cbioqSW5wdXQgRm9ybWF0KHMpKio6IFJlZCwgR3JlZW4sIEJsdWUgKFJHQikgPGJyPlxuKipJbnB1dCBQYXJhbWV0ZXJzKio6IFR3byBEaW1lbnNpb25hbCAoMkQpPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQqKjogSW1hZ2Ugc2l6ZSByZXNpemVkIHRvIGAoMTAyNCwgMTAyNClgXG5cbiMjIyBPdXRwdXRcblxuKipPdXRwdXQgVHlwZShzKSoqOiBBcnJheSA8YnI+XG4qKk91dHB1dCBGb3JtYXQqKjogQSBkaWN0aW9uYXJ5IG9mIGRpY3Rpb25hcmllcyBjb250YWluaW5nIGBucC5uZGFycmF5YC4gVGhlIG91dGVyIGRpY3Rpb25hcnkgY29udGFpbnMgZWFjaCBzYW1wbGUgKHBhZ2UpLiBJbm5lciBkaWN0aW9uYXJ5IGNvbnRhaW5zIGxpc3Qgb2YgZGljdGlvbmFyaWVzIHdpdGggYm91bmRpbmcgYm94ZXMsIGNsYXNzLCBhbmQgY29uZmlkZW5jZSBmb3IgdGhhdCBwYWdlIDxicj5cbioqT3V0cHV0IFBhcmFtZXRlcnMqKjogMUQgPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0Kio6IE91dHB1dCBjb250YWlucyBCb3VuZGluZyBib3gsIGRldGVjdGlvbiBjb25maWRlbmNlIGFuZCBvYmplY3QgY2xhc3MgKGNoYXJ0LCB0YWJsZSwgaW5mb2dyYXBoaWMsIHRpdGxlKS4gVGhyZXNob2xkcyB1c2VkIGZvciBub24tbWF4aW11bSBzdXBwcmVzc2lvbiBgY29uZl90aHJlc2ggPSAwLjAxYDsgYGlvdV90aHJlc2ggPSAwLjVgIDxicj5cbioqT3V0cHV0IENsYXNzZXMqKjogPGJyPlxuICAqIFRhYmxlXG4gICAgKiBEYXRhIHN0cnVjdHVyZWQgaW4gcm93cyBhbmQgY29sdW1uc1xuICAqIENoYXJ0XG4gICAgKiBTcGVjaWZpY2FsbHkgYmFyIGNoYXJ0cywgbGluZSBjaGFydHMsIG9yIHBpZSBjaGFydHNcbiAgKiBJbmZvZ3JhcGhpY1xuICAgICogVmlzdWFsIHJlcHJlc2VudGF0aW9ucyBvZiBpbmZvcm1hdGlvbiB0aGF0IGlzIG1vcmUgY29tcGxleCB0aGFuIGEgY2hhcnQsIGluY2x1ZGluZyBkaWFncmFtcyBhbmQgZmxvd2NoYXJ0c1xuICAgICogTWFwcyBhcmUgX25vdF8gY29uc2lkZXJlZCBpbmZvZ3JhcGhpY3NcbiAgKiBUaXRsZVxuICAgICogVGl0bGVzIGNhbiBiZSBwYWdlIHRpdGxlcywgc2VjdGlvbiB0aXRsZXMsIG9yIHRhYmxlL2NoYXJ0L2luZm9ncmFwaGljIHRpdGxlc1xuXG4jIyMgU29mdHdhcmUgSW50ZWdyYXRpb25cblxuKipSdW50aW1lKio6ICoqTmVNbyBSZXRyaWV2ZXIgUGFnZSBFbGVtZW50cyB2MioqIE5JTSA8YnI+XG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5Kio6IE5WSURJQSBBbXBlcmUsIE5WSURJQSBIb3BwZXIsIE5WSURJQSBMb3ZlbGFjZSA8YnI+XG4qKlN1cHBvcnRlZCBPcGVyYXRpbmcgU3lzdGVtKHMpKio6IExpbnV4IDxicj5cblxuIyMgTW9kZWwgVmVyc2lvbihzKTpcblxuKiBgbmVtb3JldHJpZXZlci1wYWdlLWVsZW1lbnRzLXYyYFxuXG4jIyBUcmFpbmluZyBEYXRhc2V0ICYgRXZhbHVhdGlvblxuXG4jIyMgVHJhaW5pbmcgRGF0YXNldFxuXG4qKkRhdGEgY29sbGVjdGlvbiBtZXRob2QgYnkgZGF0YXNldCoqOiBBdXRvbWF0ZWQgPGJyPlxuKipMYWJlbGluZyBtZXRob2QgYnkgZGF0YXNldCoqOiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4gPGJyPlxuKipQcmV0cmFpbmluZyAoYnkgTlZJRElBKSoqOiAxMTgsMjg3IGltYWdlcyBvZiB0aGUgW0NPQ08gdHJhaW4yMDE3XShodHRwczovL2NvY29kYXRhc2V0Lm9yZy8jZG93bmxvYWQpIGRhdGFzZXQgPGJyPlxuKipGaW5ldHVuaW5nIChieSBOVklESUEpKio6IDM2LDA5MyBpbWFnZXMgZnJvbSBbRGlnaXRhbCBDb3Jwb3JhIGRhdGFzZXRdKGh0dHBzOi8vZGlnaXRhbGNvcnBvcmEub3JnLyksIHdpdGggYW5ub3RhdGlvbnMgZnJvbSBbQXp1cmUgQUkgRG9jdW1lbnQgSW50ZWxsaWdlbmNlXShodHRwczovL2F6dXJlLm1pY3Jvc29mdC5jb20vZW4tdXMvcHJvZHVjdHMvYWktc2VydmljZXMvYWktZG9jdW1lbnQtaW50ZWxsaWdlbmNlKSBhbmQgZGF0YSBhbm5vdGF0aW9uIHRlYW0gPGJyPlxuKipOdW1iZXIgb2YgYm91bmRpbmcgYm94ZXMgcGVyIGNsYXNzKio6IDM1LDMyOCB0YWJsZXMsIDQ0LDE3OCB0aXRsZXMsIDExLDMxMyBjaGFydHMgYW5kIDYsNTAwIGluZm9ncmFwaGljcy4gVGhlIGxheW91dCBtb2RlbCBvZiBEb2N1bWVudCBJbnRlbGxpZ2VuY2Ugd2FzIHVzZWQgd2l0aCBgMjAyNC0wMi0yOS1wcmV2aWV3YCBBUEkgdmVyc2lvbi5cblxuIyMjIEV2YWx1YXRpb24gUmVzdWx0c1xuXG5UaGUgcHJpbWFyeSBldmFsdWF0aW9uIHNldCBpcyBhIGN1dCBvZiB0aGUgQXp1cmUgbGFiZWxzIGFuZCBkaWdpdGFsIGNvcnBvcmEgaW1hZ2VzLiBOdW1iZXIgb2YgYm91bmRpbmcgYm94ZXMgcGVyIGNsYXNzOiAxLDQ4MyB0YWJsZXMsIDEsOTY1IHRpdGxlcywgNDA0IGNoYXJ0cyBhbmQgNTAwIGluZm9ncmFwaGljcy4gTWVhbiBBdmVyYWdlIFByZWNpc2lvbiAobUFQKSB3YXMgdXNlZCBhcyBhbiBldmFsdWF0aW9uIG1ldHJpYywgd2hpY2ggbWVhc3VyZXMgdGhlIG1vZGVsJ3MgYWJpbGl0eSB0byBjb3JyZWN0bHkgaWRlbnRpZnkgYW5kIGxvY2FsaXplIG9iamVjdHMgYWNyb3NzIGRpZmZlcmVudCBjb25maWRlbmNlIHRocmVzaG9sZHMuXG5cbioqRGF0YSBjb2xsZWN0aW9uIG1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiA8YnI+XG4qKkxhYmVsaW5nIG1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiA8YnI+XG4qKlByb3BlcnRpZXMqKjogV2UgZXZhbHVhdGVkIHdpdGggQXp1cmUgbGFiZWxzIGZyb20gbWFudWFsbHkgc2VsZWN0ZWQgcGFnZXMsIGFzIHdlbGwgYXMgbWFudWFsIGluc3BlY3Rpb24gb24gcHVibGljIFBERnMgYW5kIHBvd2VycG9pbnQgc2xpZGVzLlxuXG4qKlBlci1jbGFzcyBQZXJmb3JtYW5jZSBNZXRyaWNzKio6XG58IENsYXNzICAgICAgIHwgQVAgKCUpIHwgQVIgKCUpIHxcbnw6LS0tLS0tLS0tLS0tfDotLS0tLS0tfDotLS0tLS0tfFxufCB0YWJsZSAgICAgICB8IDQ1LjYxOSB8IDY5LjgxNCB8XG58IGNoYXJ0ICAgICAgIHwgNTMuNDE5IHwgNzUuNzU1IHxcbnwgdGl0bGUgICAgICAgfCA0NS4xMTYgfCA2NS4yNDUgfFxufCBpbmZvZ3JhcGhpYyB8IDk2LjU5MSB8IDk3LjQwMCB8XG5cblxuIyMgSW5mZXJlbmNlOlxuXG4qKkVuZ2luZSoqOiBUZW5zb3JSVCA8YnI+XG4qKlRlc3QgaGFyZHdhcmUqKjogU2VlIFN1cHBvcnQgTWF0cml4IGZyb20gTklNIGRvY3VtZW50YXRpb25cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9uc1xuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS5cblxuKipGb3IgbW9yZSBkZXRhaWxlZCBpbmZvcm1hdGlvbiBvbiBldGhpY2FsIGNvbnNpZGVyYXRpb25zIGZvciB0aGlzIG1vZGVsKiosIHBsZWFzZSBzZWUgdGhlIE1vZGVsIENhcmQrKyBbRXhwbGFpbmFiaWxpdHldKGV4cGxhaW5hYmlsaXR5Lm1kKSwgW0JpYXNdKGJpYXMubWQpLCBbU2FmZXR5ICYgU2VjdXJpdHldKHNhZmV0eS1zZWN1cml0eS5tZCksIGFuZCBbUHJpdmFjeV0ocHJpdmFjeS5tZCkgU3ViY2FyZHMuXG5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuXG5cbiMjIEdldCBIZWxwXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgIHN1Ym1pdCBhIHRpY2tldCBhdCB0aGUgW05WSURJQSBBSSBFbnRlcnByaXNlIFN1cHBvcnQgU2VydmljZXMgcGFnZS5dKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvZGF0YS1jZW50ZXIvcHJvZHVjdHMvYWktZW50ZXJwcmlzZS1zdWl0ZS9zdXBwb3J0LykuXG5cbiMjIyBOVklESUEgTklNIERvY3VtZW50YXRpb25cblZpc2l0IHRoZSBbTmVNbyBSZXRyaWV2ZXIgZG9jcyBwYWdlXShodHRwczovL2RvY3MubnZpZGlhLmNvbS9uZW1vL3JldHJpZXZlci9pbmRleC5odG1sKSBmb3IgcmVsZWFzZSBkb2N1bWVudGF0aW9uLCBkZXBsb3ltZW50IGd1aWRlcyBhbmQgbW9yZS4iLAogICAgImRpc3BsYXlOYW1lIjogIk5lTW8gUmV0cmlldmVyIFBhZ2UgRWxlbWVudHMgdjIiLAogICAgImV4cGxhaW5hYmlsaXR5IjogInwgRmllbGQgfCBSZXNwb25zZSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBJbnRlbmRlZCBBcHBsaWNhdGlvbiAmIERvbWFpbjogfCBEb2N1bWVudCBVbmRlcnN0YW5kaW5nIHxcbnwgTW9kZWwgVHlwZTogfCBZT0xPWCBPYmplY3QgRGV0ZWN0aW9uIGZvciBDaGFydHMsIFRhYmxlcywgSW5mb2dyYXBoaWNzLCBhbmQgVGl0bGVzIHxcbnwgSW50ZW5kZWQgVXNlcjogfCBFbnRlcnByaXNlIGRldmVsb3BlcnMsIGRhdGEgc2NpZW50aXN0cywgYW5kIG90aGVyIHRlY2huaWNhbCB1c2VycyB3aG8gbmVlZCB0byBleHRyYWN0IHN0cnVjdHVyYWwgZWxlbWVudHMgZnJvbSBkb2N1bWVudHMuIHxcbnwgT3V0cHV0OiB8IEEgTGlzdCBvZiBkaWN0aW9uYXJpZXMgY29udGFpbmluZyBsaXN0cyBvZiBkaWN0aW9uYXJpZXMgb2YgZmxvYXRpbmcgcG9pbnQgbnVtYmVycyAocmVwcmVzZW50aW5nIGJvdW5kaW5nIGJveCBpbmZvcm1hdGlvbikuIDxicj4gKipFeGFtcGxlKio6IGB7XCJkYXRhXCI6IFt7XCJpbmRleFwiOiAwLFwiYm91bmRpbmdfYm94ZXNcIjoge1widGFibGVcIjogW3tcInhfbWluXCI6IDAuNjUwMyxcInlfbWluXCI6IDAuMjE2MSxcInhfbWF4XCI6IDAuNzgzNSxcInlfbWF4XCI6IDAuMzIzNixcImNvbmZpZGVuY2VcIjogMC45MzA2fV19fV19YCB8XG58IERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6IHwgRmluZHMgYW5kIGlkZW50aWZpZXMgb2JqZWN0cyBpbiBpbWFnZXMgYnkgZmlyc3QgZGl2aWRpbmcgdGhlIGltYWdlIGludG8gYSBncmlkLiBGb3IgZWFjaCBzZWN0aW9uIG9mIHRoZSBncmlkLCB0aGUgbW9kZWwgdXNlcyBhIHNlcmllcyBvZiBuZXVyYWwgbmV0d29ya3MgdG8gZXh0cmFjdCB2aXN1YWwgZmVhdHVyZXMgYW5kIHNpbXVsdGFuZW91c2x5IHByZWRpY3Qgd2hhdCBvYmplY3RzIGFyZSBwcmVzZW50IChpbiB0aGlzIGNhc2UgXCJjaGFydFwiIG9yIFwidGFibGVcIiBldGMuKSBhbmQgZXhhY3RseSB3aGVyZSB0aGV5IGFyZSBsb2NhdGVkIGluIHRoYXQgc2VjdGlvbiwgYWxsIGluIGEgc2luZ2xlIHBhc3MgdGhyb3VnaCB0aGUgaW1hZ2UuIHxcbnwgUG90ZW50aWFsIEtub3duIFJpc2tzOiB8IFRoaXMgbW9kZWwgbWF5IG5vdCBhbHdheXMgZGV0ZWN0IGFsbCBlbGVtZW50cyBpbiBhIGRvY3VtZW50LiB8XG58IExpY2Vuc2luZyAmIFRlcm1zIG9mIFVzZTogfCBVc2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1haS1mb3VuZGF0aW9uLW1vZGVscy1jb21tdW5pdHktbGljZW5zZS1hZ3JlZW1lbnQvKSBhbmQgdGhlIFtBcGFjaGUgMi4wIExpY2Vuc2VdKGh0dHBzOi8vZ2l0aHViLmNvbS9NZWd2aWktQmFzZURldGVjdGlvbi9ZT0xPWC9ibG9iL21haW4vTElDRU5TRSkuIHxcbnwgVGVjaG5pY2FsIExpbWl0YXRpb25zIHwgVGhlIG1vZGVsIG1heSBub3QgZ2VuZXJhbGl6ZSB0byB1bmtub3duIGRvY3VtZW50IHR5cGVzL2Zvcm1hdHMgbm90IGNvbW1vbmx5IGZvdW5kIG9uIHRoZSB3ZWIuIHxcbnwgTmFtZSB0aGUgYWR2ZXJzZWx5IGltcGFjdGVkIGdyb3VwcyB0aGlzIGhhcyBiZWVuIHRlc3RlZCB0byBkZWxpdmVyIGNvbXBhcmFibGUgb3V0Y29tZXMgcmVnYXJkbGVzcyBvZjogfCBOb3QgQXBwbGljYWJsZSB8XG58IFZlcmlmaWVkIHRvIGhhdmUgbWV0IHByZXNjcmliZWQgTlZJRElBIHF1YWxpdHkgc3RhbmRhcmRzOiB8IFllcyB8IiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1BWTZBLUxYVlYiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJydHg2MDAwLWJsYWNrd2VsbC1zdngxLXRydC1mcDE2LXhkMXdmZ2VkNXciLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDI3NzMwOTA3OCwKICAgICJsb2dvIjogImh0dHBzOi8vZGV2ZWxvcGVyLWJsb2dzLm52aWRpYS5jb20vd3AtY29udGVudC91cGxvYWRzLzIwMjQvMDMvbmVtby1yZXRyaWV2ZXItZ3JhcGhpYy5wbmciLAogICAgIm1vZGVsRm9ybWF0IjogIlRyaXRvbiIsCiAgICAibmFtZSI6ICJuZW1vcmV0cmlldmVyLXBhZ2UtZWxlbWVudHMtdjIiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiRlAxNiIsCiAgICAicHJpdmFjeSI6ICJ8IEZpZWxkIHwgUmVzcG9uc2UgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgR2VuZXJhdGFibGUgb3IgcmV2ZXJzZSBlbmdpbmVlcmFibGUgcGVyc29uYWwgZGF0YT8gfCBObyB8XG58IFBlcnNvbmFsIGRhdGEgdXNlZCB0byBjcmVhdGUgdGhpcyBtb2RlbD8gfCBOb25lIHxcbnwgSG93IG9mdGVuIGlzIHRoZSBkYXRhc2V0IHJldmlld2VkPyB8IEJlZm9yZSBFdmVyeSBSZWxlYXNlIHxcbnwgSXMgYSBtZWNoYW5pc20gaW4gcGxhY2UgdG8gaG9ub3IgZGF0YSBzdWJqZWN0IHJpZ2h0IG9mIGFjY2VzcyBvciBkZWxldGlvbiBvZiBwZXJzb25hbCBkYXRhPyB8IE5vIHxcbnwgSXMgdGhlcmUgcHJvdmVuYW5jZSBmb3IgYWxsIGRhdGFzZXRzIHVzZWQgaW4gdHJhaW5pbmc/IHwgWWVzIHxcbnwgRG9lcyBkYXRhIGxhYmVsaW5nIChhbm5vdGF0aW9uLCBtZXRhZGF0YSkgY29tcGx5IHdpdGggcHJpdmFjeSBsYXdzPyB8IFllcyB8IiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJOVklESUEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogInwgRmllbGQgfCBSZXNwb25zZSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBNb2RlbCBBcHBsaWNhdGlvbihzKTogfCBPYmplY3QgRGV0ZWN0aW9uIGZvciBSZXRyaWV2YWwsIGZvY3VzZWQgb24gRW50ZXJwcmlzZSB8XG58IERlc2NyaWJlIHRoZSBwaHlzaWNhbCBzYWZldHkgaW1wYWN0IChpZiBwcmVzZW50KS4gfCBOb3QgQXBwbGljYWJsZSB8XG58IFVzZSBDYXNlIFJlc3RyaWN0aW9uczogfCBBYmlkZSBieSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pLiAgIHxcbnwgTW9kZWwgYW5kIGRhdGFzZXQgcmVzdHJpY3Rpb25zOiB8IFRoZSBQcmluY2lwbGUgb2YgbGVhc3QgcHJpdmlsZWdlIChQb0xQKSBpcyBhcHBsaWVkIGxpbWl0aW5nIGFjY2VzcyBmb3IgZGF0YXNldCBnZW5lcmF0aW9uIGFuZCBtb2RlbCBkZXZlbG9wbWVudC4gUmVzdHJpY3Rpb25zIGVuZm9yY2UgZGF0YXNldCBhY2Nlc3MgZHVyaW5nIHRyYWluaW5nLCBhbmQgZGF0YXNldCBsaWNlbnNlIGNvbnN0cmFpbnRzIGFkaGVyZWQgdG8uIHwiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiTlZJRElBIE5lTW9cdTIxMjIgUmV0cmlldmVyIE5JTSBmb3IgcGFnZSBlbGVtZW50cyB2MiBpcyBhIGZpbmUtdHVuZWQgb2JqZWN0IGRldGVjdGlvbiBtb2RlbCwgdHJhaW5lZCBzcGVjaWZpY2FsbHkgZm9yIGRldGVjdGluZyBjaGFydHMsIHRhYmxlcywgaW5mb2dyYXBoaWNzLCBhbmQgdGl0bGVzIG9uIGEgZG9jdW1lbnQgcGFnZS4iLAogICAgInRlYW1OYW1lIjogIm52aWRpYSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0xNVQxODo0Mzo0OS4zNzhaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/nemoretriever-page-elements-v2 optimizationProfiles: - profileId: nim/nvidia/nemoretriever-page-elements-v2:a10gx1-trt-fp16-toixhuroha framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 A10Gx1 FP16 ngcMetadata: 09231248dff89cf8859d9206931342e468fbddfe469df56334fbe00df7fda1da: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '8.6' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A10G - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-page-elements-v2:b200x1-trt-fp16-ayukzqdapq framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 B200x1 FP16 ngcMetadata: 0f3b150544da8a053048c1e2a37a282b2c43f09a99253882578d12bc1f2cfca6: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '10.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-page-elements-v2:h100x1-trt-fp16-nuq3ijukrw framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 H100x1 FP16 ngcMetadata: 58adeef41afa742e753314ae51818e9f017f2c92ba0bfdc01befe6234703a54c: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '9.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-page-elements-v2:rtx6000-blackwell-svx1-trt-fp16-xd1wfged5w framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 RTX6000x1 FP16 ngcMetadata: b4cc2f8b3d2dcf1afdcafbee8ea694c53aeee642d76f709ed0e79477b68a8dde: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '12.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: RTX6000 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-page-elements-v2:l40sx1-trt-fp16-qnrq36wfcw framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 L40Sx1 FP16 ngcMetadata: bc1487bf0ec3430f17595fff029c1bc50668344c7a30f9e5d64ee061c6e2d5fa: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '8.9' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-page-elements-v2:a100x1-onnx-fp16-wagmq6-x1q framework: ONNX displayName: Nemoretriever Page Elements V2 ONNX FP16 ngcMetadata: edc693c6fccd68d266622eace04225421e353d7ce31e3b207afc5ff35124127b: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton model_type: onnx precision: fp16 modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: ONNX - profileId: nim/nvidia/nemoretriever-page-elements-v2:a100x1-trt-fp16-yukvwcfl5q framework: TensorRT-LLM displayName: Nemoretriever Page Elements V2 A100x1 FP16 ngcMetadata: f0fb2f72a66230096c40fc3307872ebb9bce69816cbfc6e2918695ca824bd284: model: nvidia/nemoretriever-page-elements-v2 release: 1.6.0 tags: backend: triton compute_capability: '8.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT labels: - signed images - NSPECT-7OBP-T77C - NVIDIA AI Enterprise Supported - NVIDIA NIM config: architectures: - Other modelType: NIM license: NVIDIA AI Foundation Models Community License - name: Nemoretriever Table Structure V1 displayName: Nemoretriever Table Structure V1 modelHubID: nemoretriever-table-structure-v1 category: Retrieval type: NGC description: Object detection model that identifies the internal structure of complex tables, delineating individual cells — including merged cells — rows, and columns. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Nemoretriever Table Structure V1 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIFtwcm90ZWN0ZWQgY2xhc3Nlc10oaHR0cHM6Ly93d3cuc2VuYXRlLmNhLmdvdi9jb250ZW50L3Byb3RlY3RlZC1jbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3RpbmcgfCBOb25lIHxcbnwgTWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzIHwgTm9uZSB8IiwKICAgICJidWlsdEJ5IjogIk5WSURJQSIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjUtMDMtMTRUMDA6MzU6MzAuODc5WiIsCiAgICAiZGVzY3JpcHRpb24iOiAiIyMgTW9kZWwgT3ZlcnZpZXdcblxuIyMjIERlc2NyaXB0aW9uXG5cblRoZSAqKk5lTW8gUmV0cmlldmVyIFRhYmxlIFN0cnVjdHVyZSB2MSoqIG1vZGVsIGlzIGEgc3BlY2lhbGl6ZWQgb2JqZWN0IGRldGVjdGlvbiBtb2RlbCBkZXNpZ25lZCB0byBpZGVudGlmeSBhbmQgZXh0cmFjdCB0aGUgc3RydWN0dXJlIG9mIHRhYmxlcyBpbiBpbWFnZXMuIEJhc2VkIG9uIFlPTE9YLCBhbiBhbmNob3ItZnJlZSB2ZXJzaW9uIG9mIFlPTE8gKFlvdSBPbmx5IExvb2sgT25jZSksIHRoaXMgbW9kZWwgY29tYmluZXMgYSBzaW1wbGVyIGFyY2hpdGVjdHVyZSB3aXRoIGVuaGFuY2VkIHBlcmZvcm1hbmNlLiBXaGlsZSB0aGUgdW5kZXJseWluZyB0ZWNobm9sb2d5IGJ1aWxkcyB1cG9uIHdvcmsgZnJvbSBbTWVndmlpIFRlY2hub2xvZ3ldKGh0dHBzOi8vZ2l0aHViLmNvbS9NZWd2aWktQmFzZURldGVjdGlvbi9ZT0xPWCksIHdlIGRldmVsb3BlZCBvdXIgb3duIGJhc2UgbW9kZWwgdGhyb3VnaCBjb21wbGV0ZSByZXRyYWluaW5nIHJhdGhlciB0aGFuIHVzaW5nIHByZS10cmFpbmVkIHdlaWdodHMuXG5cblRoZSBtb2RlbCBleGNlbHMgYXQgZGV0ZWN0aW5nIGFuZCBsb2NhbGl6aW5nIHRoZSBmdW5kYW1lbnRhbCBzdHJ1Y3R1cmFsIGVsZW1lbnRzIHdpdGhpbiB0YWJsZXMuIFRocm91Z2ggY2FyZWZ1bCBmaW5lLXR1bmluZywgaXQgY2FuIGFjY3VyYXRlbHkgaWRlbnRpZnkgYW5kIGRlbGluZWF0ZSB0aHJlZSBrZXkgY29tcG9uZW50cyB3aXRoaW4gdGFibGVzOlxuXG4xLiBJbmRpdmlkdWFsIGNlbGxzIChpbmNsdWRpbmcgbWVyZ2VkIGNlbGxzKVxuMi4gUm93c1xuMy4gQ29sdW1uc1xuXG5UaGlzIHNwZWNpYWxpemVkIGZvY3VzIG9uIHRhYmxlIHN0cnVjdHVyZSBlbmFibGVzIHByZWNpc2UgZGVjb21wb3NpdGlvbiBvZiBjb21wbGV4IHRhYmxlcyBpbnRvIHRoZWlyIGNvbnN0aXR1ZW50IHBhcnRzLCBmb3JtaW5nIHRoZSBmb3VuZGF0aW9uIGZvciBkb3duc3RyZWFtIHJldHJpZXZhbCB0YXNrcy4gVGhpcyBtb2RlbCBoZWxwcyBjb252ZXJ0IHRhYmxlcyBpbnRvIHRoZSBtYXJrZG93biBmb3JtYXQgd2hpY2ggY2FuIGltcHJvdmUgcmV0cmlldmFsIGFjY3VyYWN5LlxuXG5UaGlzIG1vZGVsIGlzIHJlYWR5IGZvciBjb21tZXJjaWFsIHVzZSBhbmQgaXMgYSBwYXJ0IG9mIHRoZSBOVklESUEgTmVNbyBSZXRyaWV2ZXIgZmFtaWx5IG9mIE5JTSBtaWNyb3NlcnZpY2VzIHNwZWNpZmljYWxseSBmb3Igb2JqZWN0IGRldGVjdGlvbiBhbmQgbXVsdGltb2RhbCBleHRyYWN0aW9uIG9mIGVudGVycHJpc2UgZG9jdW1lbnRzLlxuXG4jIyMgTGljZW5zZS9UZXJtcyBvZiB1c2VcblxuVGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pLlxuXG4qKllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgeW91ciB1c2Ugb2YgTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cy4qKlxuXG4jIyMgTW9kZWwgQXJjaGl0ZWN0dXJlXG5cbioqQXJjaGl0ZWN0dXJlIFR5cGUqKjogWU9MT1ggPGJyPlxuKipOZXR3b3JrIEFyY2hpdGVjdHVyZSoqOiBEYXJrTmV0NTMgQmFja2JvbmUgXFwrIEZQTiBEZWNvdXBsZWQgaGVhZCAob25lIDF4MSBjb252b2x1dGlvbiBcXCsgMiBwYXJhbGxlbCAzeDMgY29udm9sdXRpb25zIChvbmUgZm9yIHRoZSBjbGFzc2lmaWNhdGlvbiBhbmQgb25lIGZvciB0aGUgYm91bmRpbmcgYm94IHByZWRpY3Rpb24pLiBUaGUgWU9MT1ggYXJjaGl0ZWN0dXJlIGlzIGEgc2luZ2xlLXN0YWdlIG9iamVjdCBkZXRlY3RvciB0aGF0IGltcHJvdmVzIG9uIFlvbG8tdjMuIDxicj5cbioqRGVwbG95bWVudCBHZW9ncmFwaHkqKjogR2xvYmFsIDxicj5cblxuKipVc2UgQ2FzZSoqOiA8YnI+XG5UaGlzIG1vZGVsIHNwZWNpYWxpemVzIGluIGFuYWx5emluZyBpbWFnZXMgY29udGFpbmluZyB0YWJsZXMgYnk6XG4tIERldGVjdGluZyBhbmQgZXh0cmFjdGluZyB0YWJsZSBzdHJ1Y3R1cmUgZWxlbWVudHMgKHJvd3MsIGNvbHVtbnMsIGFuZCBjZWxscylcbi0gUHJvdmlkaW5nIHByZWNpc2UgbG9jYXRpb24gaW5mb3JtYXRpb24gZm9yIGVhY2ggZGV0ZWN0ZWQgZWxlbWVudFxuLSBTdXBwb3J0aW5nIGRvd25zdHJlYW0gdGFza3MgbGlrZSB0YWJsZSBhbmFseXNpcyBhbmQgZGF0YSBleHRyYWN0aW9uXG5cblRoZSBtb2RlbCBpcyBkZXNpZ25lZCB0byB3b3JrIGluIGNvbmp1bmN0aW9uIHdpdGggT0NSIChPcHRpY2FsIENoYXJhY3RlciBSZWNvZ25pdGlvbikgc3lzdGVtcyB0bzpcbjEuIElkZW50aWZ5IHRoZSBzdHJ1Y3R1cmFsIGxheW91dCBvZiB0YWJsZXNcbjIuIFByZXNlcnZlIHRoZSByZWxhdGlvbnNoaXBzIGJldHdlZW4gdGFibGUgZWxlbWVudHNcbjMuIEVuYWJsZSBhY2N1cmF0ZSBleHRyYWN0aW9uIG9mIHRhYnVsYXIgZGF0YSBmcm9tIGltYWdlc1xuXG5JZGVhbCBmb3I6XG4tIERvY3VtZW50IHByb2Nlc3Npbmcgc3lzdGVtc1xuLSBBdXRvbWF0ZWQgZGF0YSBleHRyYWN0aW9uIHBpcGVsaW5lc1xuLSBEaWdpdGFsIGNvbnRlbnQgbWFuYWdlbWVudCBzb2x1dGlvbnNcbi0gQnVzaW5lc3MgaW50ZWxsaWdlbmNlIGFwcGxpY2F0aW9uc1xuXG4qKlJlbGVhc2UgRGF0ZSoqOiAyMDI1LTAzLTE3XG5cbiMjIFRlY2huaWNhbCBEZXRhaWxzXG5cbiMjIyBJbnB1dFxuXG4qKklucHV0IHR5cGUocykqKjogSW1hZ2UgPGJyPlxuKipJbnB1dCBmb3JtYXQocykqKjogUmVkLCBHcmVlbiwgQmx1ZSAoUkdCKSA8YnI+XG4qKklucHV0IHBhcmFtZXRlcnMqKjogVHdvIERpbWVuc2lvbmFsICgyRCkgPGJyPlxuKipPdGhlciBwcm9wZXJ0aWVzIHJlbGF0ZWQgdG8gaW5wdXQqKjogSW1hZ2Ugc2l6ZSByZXNpemVkIHRvIGAoMTAyNCwgMTAyNClgXG5cbiMjIyBPdXRwdXRcblxuKipPdXRwdXQgVHlwZShzKSoqOiBBcnJheSA8YnI+XG4qKk91dHB1dCBGb3JtYXQqKjogQSBkaWN0aW9uYXJ5IG9mIGRpY3Rpb25hcmllcyBjb250YWluaW5nIGBucC5uZGFycmF5YCBvYmplY3RzLiBUaGUgb3V0ZXIgZGljdGlvbmFyeSBjb250YWlucyBlYWNoIHNhbXBsZSAodGFibGUpLiBJbm5lciBkaWN0aW9uYXJ5IGNvbnRhaW5zIGxpc3Qgb2YgZGljdGlvbmFyaWVzIHdpdGggYm91bmRpbmcgYm94ZXMsIGNsYXNzLCBhbmQgY29uZmlkZW5jZSBmb3IgdGhhdCB0YWJsZSA8YnI+XG4qKk91dHB1dCBQYXJhbWV0ZXJzKio6IDFEIDxicj5cbioqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dCoqOiBPdXRwdXQgY29udGFpbnMgQm91bmRpbmcgYm94LCBkZXRlY3Rpb24gY29uZmlkZW5jZSBhbmQgb2JqZWN0IGNsYXNzIChjZWxsLCByb3csIGNvbHVtbikuIFRocmVzaG9sZHMgdXNlZCBmb3Igbm9uLW1heGltdW0gc3VwcHJlc3Npb24gYGNvbmZfdGhyZXNoID0gMC4wMWA7IGBpb3VfdGhyZXNoID0gMC4yNWBcblxuIyMjIFNvZnR3YXJlIEludGVncmF0aW9uXG5cbioqUnVudGltZSoqOiAqKk5lTW8gUmV0cmlldmVyIFRhYmxlIFN0cnVjdHVyZSB2MSoqIE5JTSA8YnI+XG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5Kio6IE5WSURJQSBBbXBlcmUsIE5WSURJQSBIb3BwZXIsIE5WSURJQSBMb3ZlbGFjZSA8YnI+XG4qKlN1cHBvcnRlZCBPcGVyYXRpbmcgU3lzdGVtKHMpKio6IExpbnV4XG5cbiMjIE1vZGVsIFZlcnNpb24ocyk6XG5cbiogYG5lbW9yZXRyaWV2ZXItdGFibGUtc3RydWN0dXJlLXYxYFxuXG4jIyBUcmFpbmluZyBEYXRhc2V0ICYgRXZhbHVhdGlvblxuXG4jIyMgVHJhaW5pbmcgRGF0YXNldFxuXG4qKkRhdGEgY29sbGVjdGlvbiBtZXRob2QgYnkgZGF0YXNldCoqOiBBdXRvbWF0ZWQgPGJyPlxuKipMYWJlbGluZyBtZXRob2QgYnkgZGF0YXNldCoqOiBBdXRvbWF0ZWQgPGJyPlxuKipQcmV0cmFpbmluZyoqOiBbQ09DTyB0cmFpbjIwMTddKGh0dHBzOi8vY29jb2RhdGFzZXQub3JnLyNkb3dubG9hZClcbioqRmluZXR1bmluZyAoYnkgTlZJRElBKSoqOiAyMyw5NzcgaW1hZ2VzIGZyb20gW0RpZ2l0YWwgQ29ycG9yYSBkYXRhc2V0XShodHRwczovL2RpZ2l0YWxjb3Jwb3JhLm9yZy8pLCB3aXRoIGFubm90YXRpb25zIGZyb20gW0F6dXJlIEFJIERvY3VtZW50IEludGVsbGlnZW5jZV0oaHR0cHM6Ly9henVyZS5taWNyb3NvZnQuY29tL2VuLXVzL3Byb2R1Y3RzL2FpLXNlcnZpY2VzL2FpLWRvY3VtZW50LWludGVsbGlnZW5jZSkuXG5OdW1iZXIgb2YgYm91bmRpbmcgYm94ZXMgcGVyIGNsYXNzOiAxLDgyOCw5NzggY2VsbHMsIDEzNCwwODkgY29sdW1ucyBhbmQgMzE2LDkwMSByb3dzLiBUaGUgbGF5b3V0IG1vZGVsIG9mIERvY3VtZW50IEludGVsbGlnZW5jZSB3YXMgdXNlZCB3aXRoIGAyMDI0LTAyLTI5LXByZXZpZXdgIEFQSSB2ZXJzaW9uLlxuXG4jIyMgRXZhbHVhdGlvbiBSZXN1bHRzXG5cbioqVGhlIHByaW1hcnkgZXZhbHVhdGlvbiBzZXQqKjogMiw0NTkgZGlnaXRhbCBjb3Jwb3JhIGltYWdlcyB3aXRoIEF6dXJlIGxhYmVscy4gTnVtYmVyIG9mIGJvdW5kaW5nIGJveGVzIHBlciBjbGFzczogMjAwLDg0MCBjZWxscywgMTMsNjcwIGNvbHVtbnMgYW5kIDM0LDU3NSByb3dzLiBtQVAgd2FzIHVzZWQgYXMgYW4gZXZhbHVhdGlvbiBtZXRyaWMuIDxicj5cbioqRGF0YSBjb2xsZWN0aW9uIG1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiA8YnI+XG4qKkxhYmVsaW5nIG1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiA8YnI+XG4qKlByb3BlcnRpZXMqKjogV2UgZXZhbHVhdGVkIHdpdGggQXp1cmUgbGFiZWxzIGZyb20gbWFudWFsbHkgc2VsZWN0ZWQgcGFnZXMsIGFzIHdlbGwgYXMgbWFudWFsIGluc3BlY3Rpb24gb24gcHVibGljIFBERnMgYW5kIHBvd2VycG9pbnQgc2xpZGVzLlxuXG4qKlBlci1jbGFzcyBQZXJmb3JtYW5jZSBNZXRyaWNzKio6XG58IENsYXNzICB8IEF2ZXJhZ2UgUHJlY2lzaW9uICglKSB8IEF2ZXJhZ2UgUmVjYWxsICglKSB8XG58Oi0tLS0tLS18Oi0tLS0tLS0tLS0tLS0tLS0tLS0tLS18Oi0tLS0tLS0tLS0tLS0tLS0tLXxcbnwgY2VsbCAgIHwgNTguMzY1ICAgICAgICAgICAgICAgIHwgNjAuNjQ3ICAgICAgICAgICAgfFxufCByb3cgICAgfCA3Ni45OTIgICAgICAgICAgICAgICAgfCA4MS4xMTUgICAgICAgICAgICB8XG58IGNvbHVtbiB8IDg1LjI5MyAgICAgICAgICAgICAgICB8IDg3LjQzNCAgICAgICAgICAgIHxcblxuIyMgSW5mZXJlbmNlOlxuXG4qKkVuZ2luZSoqOiBUZW5zb3JSVC4gPGJyPlxuKipUZXN0IGhhcmR3YXJlKio6IFNlZSBTdXBwb3J0IE1hdHJpeCBmcm9tIE5JTSBkb2N1bWVudGF0aW9uLlxuXG4jIyBFdGhpY2FsIENvbnNpZGVyYXRpb25zXG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gV2hlbiBkb3dubG9hZGVkIG9yIHVzZWQgaW4gYWNjb3JkYW5jZSB3aXRoIG91ciB0ZXJtcyBvZiBzZXJ2aWNlLCBkZXZlbG9wZXJzIHNob3VsZCB3b3JrIHdpdGggdGhlaXIgaW50ZXJuYWwgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLlxuXG4qKkZvciBtb3JlIGRldGFpbGVkIGluZm9ybWF0aW9uIG9uIGV0aGljYWwgY29uc2lkZXJhdGlvbnMgZm9yIHRoaXMgbW9kZWwqKiwgcGxlYXNlIHNlZSB0aGUgTW9kZWwgQ2FyZCsrIFtFeHBsYWluYWJpbGl0eV0oZXhwbGFpbmFiaWxpdHkubWQpLCBbQmlhc10oYmlhcy5tZCksIFtTYWZldHkgJiBTZWN1cml0eV0oc2FmZXR5LXNlY3VyaXR5Lm1kKSwgYW5kIFtQcml2YWN5XShwcml2YWN5Lm1kKSBTdWJjYXJkcy5cblxuUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuIyMgR2V0IEhlbHBcblxuIyMjIEVudGVycHJpc2UgU3VwcG9ydFxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciAgc3VibWl0IGEgdGlja2V0IGF0IHRoZSBbTlZJRElBIEFJIEVudGVycHJpc2UgU3VwcG9ydCBTZXJ2aWNlcyBwYWdlLl0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuIyMjIE5WSURJQSBOSU0gRG9jdW1lbnRhdGlvblxuVmlzaXQgdGhlIFtOZU1vIFJldHJpZXZlciBkb2NzIHBhZ2VdKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25lbW8vcmV0cmlldmVyL2luZGV4Lmh0bWwpIGZvciByZWxlYXNlIGRvY3VtZW50YXRpb24sIGRlcGxveW1lbnQgZ3VpZGVzIGFuZCBtb3JlLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiTmVNbyBSZXRyaWV2ZXIgVGFibGUgU3RydWN0dXJlIHYxIiwKICAgICJleHBsYWluYWJpbGl0eSI6ICJ8IEZpZWxkIHwgUmVzcG9uc2UgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgSW50ZW5kZWQgQXBwbGljYXRpb24gJiBEb21haW46IHwgT2JqZWN0IERldGVjdGlvbiB8XG58IE1vZGVsIFR5cGU6IHwgWU9MT1gtYXJjaGl0ZWN0dXJlIGZvciBkZXRlY3Rpb24gb2YgdGFibGUgc3RydWN0dXJlIHdpdGhpbiBpbWFnZXMgb2YgdGFibGVzLiB8XG58IEludGVuZGVkIFVzZXI6IHwgRW50ZXJwcmlzZSBkZXZlbG9wZXJzLCBkYXRhIHNjaWVudGlzdHMsIGFuZCBvdGhlciB0ZWNobmljYWwgdXNlcnMgd2hvIG5lZWQgdG8gZXh0cmFjdCB0YWJsZSBzdHJ1Y3R1cmUgZnJvbSBpbWFnZXMuIHxcbnwgT3V0cHV0OiB8IEEgTGlzdCBvZiBkaWN0aW9uYXJpZXMgY29udGFpbmluZyBsaXN0cyBvZiBkaWN0aW9uYXJpZXMgb2YgZmxvYXRpbmcgcG9pbnQgbnVtYmVycyAocmVwcmVzZW50aW5nIGJvdW5kaW5nIGJveCBpbmZvcm1hdGlvbikuIDxicj4gKipFeGFtcGxlKio6IGB7XCJkYXRhXCI6IFt7XCJpbmRleFwiOiAwLFwiYm91bmRpbmdfYm94ZXNcIjoge1widGFibGVcIjogW3tcInhfbWluXCI6IDAuNjUwMyxcInlfbWluXCI6IDAuMjE2MSxcInhfbWF4XCI6IDAuNzgzNSxcInlfbWF4XCI6IDAuMzIzNixcImNvbmZpZGVuY2VcIjogMC45MzA2fV19fV19YCB8XG58IERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6IHwgRmluZHMgYW5kIGlkZW50aWZpZXMgb2JqZWN0cyBpbiBpbWFnZXMgYnkgZmlyc3QgZGl2aWRpbmcgdGhlIGltYWdlIGludG8gYSBncmlkLiBGb3IgZWFjaCBzZWN0aW9uIG9mIHRoZSBncmlkLCB0aGUgbW9kZWwgdXNlcyBhIHNlcmllcyBvZiBuZXVyYWwgbmV0d29ya3MgdG8gZXh0cmFjdCB2aXN1YWwgZmVhdHVyZXMgYW5kIHNpbXVsdGFuZW91c2x5IHByZWRpY3Qgd2hhdCBvYmplY3RzIGFyZSBwcmVzZW50IChpbiB0aGlzIGNhc2UgXCJjZWxsXCIsIFwicm93XCIsIG9yIFwiY29sdW1uXCIpIGFuZCBleGFjdGx5IHdoZXJlIHRoZXkgYXJlIGxvY2F0ZWQgaW4gdGhhdCBzZWN0aW9uLCBhbGwgaW4gYSBzaW5nbGUgcGFzcyB0aHJvdWdoIHRoZSBpbWFnZS4gfFxufCBQb3RlbnRpYWwgS25vd24gUmlza3M6IHwgVGhpcyBtb2RlbCBkb2VzIG5vdCBhbHdheXMgZ3VhcmFudGVlIHRvIHJldHJpZXZlIHRoZSBjb3JyZWN0IHRhYmxlIHN0cnVjdHVyZSBmb3IgYSBnaXZlbiBpbWFnZS4gfFxufCBMaWNlbnNpbmcgJiBUZXJtcyBvZiBVc2U6IHwgVXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtYWktZm91bmRhdGlvbi1tb2RlbHMtY29tbXVuaXR5LWxpY2Vuc2UtYWdyZWVtZW50LykuIHxcbnwgVGVjaG5pY2FsIExpbWl0YXRpb25zIHwgVGhlIG1vZGVsIG1heSBjb3JyZWN0bHkgZGV0ZWN0IHRhYmxlIGVsZW1lbnRzLCBlc3BlY3RpYWxseSBvbiB1bmNvbW1vbiB0YWJsZSBzdHlsZXMgb3IgbG93ZXIgcXVhbGl0eSBpbWFnZXMuIHxcbnwgTmFtZSB0aGUgYWR2ZXJzZWx5IGltcGFjdGVkIGdyb3VwcyB0aGlzIGhhcyBiZWVuIHRlc3RlZCB0byBkZWxpdmVyIGNvbXBhcmFibGUgb3V0Y29tZXMgcmVnYXJkbGVzcyBvZjogfCBOb3QgQXBwbGljYWJsZSB8XG58IFZlcmlmaWVkIHRvIGhhdmUgbWV0IHByZXNjcmliZWQgTlZJRElBIHF1YWxpdHkgc3RhbmRhcmRzOiB8IFllcyB8IiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC1LMDU2LTNIV0UiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJydHg2MDAwLWJsYWNrd2VsbC1zdngxLXRydC1mcDE2LXVueWl0ajdvZmEiLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDI3NzIxOTU5OCwKICAgICJsb2dvIjogImh0dHBzOi8vZGV2ZWxvcGVyLWJsb2dzLm52aWRpYS5jb20vd3AtY29udGVudC91cGxvYWRzLzIwMjQvMDMvbmVtby1yZXRyaWV2ZXItZ3JhcGhpYy5wbmciLAogICAgIm1vZGVsRm9ybWF0IjogIlRyaXRvbiIsCiAgICAibmFtZSI6ICJuZW1vcmV0cmlldmVyLXRhYmxlLXN0cnVjdHVyZS12MSIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJGUDMyIiwKICAgICJwcml2YWN5IjogInwgRmllbGQgfCBSZXNwb25zZSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBHZW5lcmF0YWJsZSBvciByZXZlcnNlIGVuZ2luZWVyYWJsZSBwZXJzb25hbCBkYXRhPyB8IE5vIHxcbnwgUGVyc29uYWwgZGF0YSB1c2VkIHRvIGNyZWF0ZSB0aGlzIG1vZGVsPyB8IE5vbmUgfFxufCBIb3cgb2Z0ZW4gaXMgdGhlIGRhdGFzZXQgcmV2aWV3ZWQ/IHwgQmVmb3JlIEV2ZXJ5IFJlbGVhc2UgfFxufCBJcyBhIG1lY2hhbmlzbSBpbiBwbGFjZSB0byBob25vciBkYXRhIHN1YmplY3QgcmlnaHQgb2YgYWNjZXNzIG9yIGRlbGV0aW9uIG9mIHBlcnNvbmFsIGRhdGE/IHwgTm8gfFxufCBJcyB0aGVyZSBwcm92ZW5hbmNlIGZvciBhbGwgZGF0YXNldHMgdXNlZCBpbiB0cmFpbmluZz8gfCBZZXMgfFxufCBEb2VzIGRhdGEgbGFiZWxpbmcgKGFubm90YXRpb24sIG1ldGFkYXRhKSBjb21wbHkgd2l0aCBwcml2YWN5IGxhd3M/IHwgWWVzIHwiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IE1vZGVsIEFwcGxpY2F0aW9uKHMpOiB8IE9iamVjdCBEZXRlY3Rpb24gZm9yIFJldHJpZXZhbCwgZm9jdXNlZCBvbiBFbnRlcnByaXNlIHxcbnwgRGVzY3JpYmUgdGhlIHBoeXNpY2FsIHNhZmV0eSBpbXBhY3QgKGlmIHByZXNlbnQpLiB8IE5vdCBBcHBsaWNhYmxlIHxcbnwgVXNlIENhc2UgUmVzdHJpY3Rpb25zOiB8IEFiaWRlIGJ5IFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykuICAgfFxufCBNb2RlbCBhbmQgZGF0YXNldCByZXN0cmljdGlvbnM6IHwgVGhlIFByaW5jaXBsZSBvZiBsZWFzdCBwcml2aWxlZ2UgKFBvTFApIGlzIGFwcGxpZWQgbGltaXRpbmcgYWNjZXNzIGZvciBkYXRhc2V0IGdlbmVyYXRpb24gYW5kIG1vZGVsIGRldmVsb3BtZW50LiBSZXN0cmljdGlvbnMgZW5mb3JjZSBkYXRhc2V0IGFjY2VzcyBkdXJpbmcgdHJhaW5pbmcsIGFuZCBkYXRhc2V0IGxpY2Vuc2UgY29uc3RyYWludHMgYWRoZXJlZCB0by4gfCIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJOVklESUEgTmVNb1x1MjEyMiBSZXRyaWV2ZXIgTklNIGZvciB0YWJsZSBzdHJ1Y3R1cmUgdjEgaXMgYSBmaW5lLXR1bmVkIG9iamVjdCBkZXRlY3Rpb24gbW9kZWwsIHRyYWluZWQgc3BlY2lmaWNhbGx5IGZvciBkZXRlY3RpbmcgdGhlIHN0cnVjdHVyZSBvZiBjb21wbGV4IHRhYmxlcy4iLAogICAgInRlYW1OYW1lIjogIm52aWRpYSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0xMC0xNVQxODo0NDowNS44NDVaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/nemoretriever-table-structure-v1 optimizationProfiles: - profileId: nim/nvidia/nemoretriever-table-structure-v1:a10gx1-trt-fp16-ncblfgrrew framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 A10Gx1 FP16 ngcMetadata: 09231248dff89cf8859d9206931342e468fbddfe469df56334fbe00df7fda1da: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.6' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A10G - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-table-structure-v1:b200x1-trt-fp16--ce2boy2vw framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 B200x1 FP16 ngcMetadata: 0f3b150544da8a053048c1e2a37a282b2c43f09a99253882578d12bc1f2cfca6: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '10.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-table-structure-v1:h100x1-trt-fp16-lnq0nmbo3g framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 H100x1 FP16 ngcMetadata: 58adeef41afa742e753314ae51818e9f017f2c92ba0bfdc01befe6234703a54c: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '9.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-table-structure-v1:rtx6000-blackwell-svx1-trt-fp16-unyitj7ofa framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 RTX6000x1 FP16 ngcMetadata: b4cc2f8b3d2dcf1afdcafbee8ea694c53aeee642d76f709ed0e79477b68a8dde: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '12.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: RTX6000 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-table-structure-v1:l40sx1-trt-fp16-ddoabmkana framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 L40Sx1 FP16 ngcMetadata: bc1487bf0ec3430f17595fff029c1bc50668344c7a30f9e5d64ee061c6e2d5fa: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.9' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/nemoretriever-table-structure-v1:a100x1-onnx-fp16-l8hnwsbr3g framework: ONNX displayName: Nemoretriever Table Structure V1 ONNX FP16 ngcMetadata: edc693c6fccd68d266622eace04225421e353d7ce31e3b207afc5ff35124127b: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton model_type: onnx precision: fp16 modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: ONNX - profileId: nim/nvidia/nemoretriever-table-structure-v1:a100x1-trt-fp16-jvvssvik-q framework: TensorRT-LLM displayName: Nemoretriever Table Structure V1 A100x1 FP16 ngcMetadata: f0fb2f72a66230096c40fc3307872ebb9bce69816cbfc6e2918695ca824bd284: model: nvidia/nemoretriever-table-structure-v1 release: 1.6.0 tags: backend: triton compute_capability: '8.0' model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100 - key: COUNT value: 1 - key: NIM VERSION value: 1.6.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT labels: - signed images - NSPECT-7OBP-T77C - NVIDIA AI Enterprise Supported - NVIDIA NIM config: architectures: - Other modelType: NIM license: NVIDIA AI Foundation Models Community License - name: PaddleOCR displayName: PaddleOCR modelHubID: paddleocr category: Retrieval type: NGC description: Ultra-lightweight OCR system developed by Baidu with broad support for diverse OCR algorithms. Covers the full pipeline from text detection through recognition across document types. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: PaddleOCR modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImNhbkd1ZXN0RG93bmxvYWQiOiBmYWxzZSwKICAgICJjcmVhdGVkRGF0ZSI6ICIyMDI1LTAyLTE5VDE2OjEwOjE3LjA3NVoiLAogICAgImRlc2NyaXB0aW9uIjogIiMjIE1vZGVsIE92ZXJ2aWV3XG5cbiMjIyBEZXNjcmlwdGlvblxuXG5QYWRkbGVPQ1IgaXMgYW4gdWx0cmEtbGlnaHR3ZWlnaHQgT3B0aWNhbCBDaGFyYWN0ZXIgUmVjb2duaXRpb24gKE9DUikgc3lzdGVtIGRldmVsb3BlZCBieSBCYWlkdS4gSXQgc3VwcG9ydHMgYSB2YXJpZXR5IG9mIGN1dHRpbmctZWRnZSBPQ1IgYWxnb3JpdGhtcyBhbmQgcHJvdmlkZXMgdmFsdWUgYXQgZXZlcnkgc3RhZ2Ugb2YgdGhlIEFJIHBpcGVsaW5lLCBpbmNsdWRpbmcgZGF0YSBnZW5lcmF0aW9uLCBtb2RlbCB0cmFpbmluZywgYW5kIGluZmVyZW5jZS5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbCB1c2UuXG5cbiMjIFRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uXG5cblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFtQYWRkbGVPQ1IgVG9vbGtpdF0oaHR0cHM6Ly9naXRodWIuY29tL1BhZGRsZVBhZGRsZS9QYWRkbGVPQ1IpLlxuXG4jIyMgVGVybXMgb2YgdXNlXG5UaGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykuIFBhZGRsZU9DUiBpcyBsaWNlbnNlZCB1bmRlciAgW0FwYWNoZS0yXShodHRwczovL3d3dy5hcGFjaGUub3JnL2xpY2Vuc2VzL0xJQ0VOU0UtMi4wKS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIG1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuIyMjIFJlZmVyZW5jZXNcbltHaXRodWJdKGh0dHBzOi8vZ2l0aHViLmNvbS9QYWRkbGVQYWRkbGUvUGFkZGxlT0NSL2Jsb2IvbWFpbi9SRUFETUVfZW4ubWQpXG5bQXJ4aXZdKGh0dHBzOi8vYXJ4aXYub3JnL2Ficy8yMjA2LjAzMDAxKVxuXG5cbiMjIE1vZGVsIEFyY2hpdGVjdHVyZVxuKipBcmNoaXRlY3R1cmUgVHlwZSBmb3IgVGV4dCBEZXRlY3RvcjoqKiBDTk4gPGJyPlxuKipOZXR3b3JrIEFyY2hpdGVjdHVyZSBmb3IgVGV4dCBEZXRlY3RvcjoqKiAgTEstUEFOXG5cbioqQXJjaGl0ZWN0dXJlIFR5cGUgZm9yIFRleHQgUmVjb2duaXRpb246KiogSHlicmlkIFRyYW5zZm9ybWVyIENOTiAgPGJyPlxuKipOZXR3b3JrIEFyY2hpdGVjdHVyZSBmb3IgVGV4dCBSZWNvZ25pdGlvbjoqKiBTVlRSLUxDTmV0IChOUlRSIEhlYWQgYW5kIENUQ0xvc3MgaGVhZCkgPGJyPlxuXG4jIyBJbnB1dFxuKipJbnB1dCBUeXBlKHMpOioqIEltYWdlIDxicj5cbioqSW5wdXQgRm9ybWF0KHMpOioqIFJlZCwgR3JlZW4sIEJsdWUgKFJHQikgPGJyPlxuKipJbnB1dCBQYXJhbWV0ZXJzOioqIFR3byBEaW1lbnNpb25hbCAoMkQpIDxicj5cbioqU3VwcG9ydGVkIExhbmd1YWdlczoqKiBFbmdsaXNoIDxicj5cbioqTWluaW11bSBpbnB1dCBpbWFnZSBkaW1lbnNpb25zOioqICgzMiwgMzIpIDxicj5cbioqTWF4aW11bSBpbnB1dCBpbWFnZSBkaW1lbnNpb25zOioqIE5vIGxpbWl0YXRpb24gPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQ6KiogbmQgYXJyYXksIG9yIGJhdGNoIG9mIG5kIGFycmF5cyBhcmUgcGFzc2VkIGluIHdpdGggc2hhcGUgW0JhdGNoLCBDaGFubmVsLCBXaWR0aCwgSGVpZ2h0XS4gUGFkZGxlT0NSIGRvZXMgc29tZSBpbnRlcm5hbCB0aHJlc2hvbGRpbmcsIGJ1dCBub25lIHdhcyBpbXBsZW1lbnRlZCBmcm9tIG91ciBzaWRlLiA8YnI+XG5cbiMjIE91dHB1dFxuKipPdXRwdXQgVHlwZShzKToqKiBUZXh0IDxicj5cbioqT3V0cHV0IEZvcm1hdDoqKiAgU3RyaW5nIDxicj5cbioqT3V0cHV0IFBhcmFtZXRlcnM6KiogMUQgPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gT3V0cHV0OioqIEJhdGNoIG9mIHRleHQgc3RyaW5ncy4gPGJyPlxuXG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5OioqIE5WSURJQSBBbXBlcmUsIE5WSURJQSBIb3BwZXIsIE5WSURJQSBMb3ZlbGFjZTxicj5cblxuIyMgU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6XG4qIExpbnV4IDxicj5cblxuIyMgTW9kZWwgVmVyc2lvbihzKTpcbiogYmFpZHUvcGFkZGxlb2NyICA8YnI+XG5cbiMjIFRyYWluaW5nIERhdGFzZXQ6XG5cbioqTGluazoqKiAgPGJyPlxuXG5UZXh0IGRldGVjdGlvbiBkYXRhc2V0cyBpbmNsdWRlIExTVlQgKFN1biBldCBhbC4gMjAxOSksIFJDVFctMTcgKFNoaWV0IGFsLiAyMDE3KSwgTVRXSSAyMDE4IChIZSBhbmQgWWFuZyAyMDE4KSwgQ0FTSUEtMTBLIChIZSBldCBhbC4gMjAxOCksIFNST0lFIChIdWFuZyBldCBhbC4gMjAxOSksIE1MVCAyMDE5IChOYXllZiBldCBhbC4gMjAxOSksIEJESSAoS2FyYXR6YXMgZXQgYWwuIDIwMTEpLCBNU1JBVEQ1MDAgKFlhbyBldCBhbC4gMjAxMikgYW5kIENDUEQgMjAxOSAoWHUgZXQgYWwuIDIwMTgpLlxuXG5UaGVzZSBhcmUgdHdvIG9mIHRoZSBkYXRhc2V0cyAoYW1vbmcgb3RoZXJzKSB3aGljaCBhcmUgdXNlZCBmb3IgdGV4dCByZWNvZ25pdGlvbjpcbltPcGVuSW1hZ2VzXShodHRwczovL2dpdGh1Yi5jb20vb3BlbmltYWdlcy9kYXRhc2V0KSA8YnI+XG5bSW52b2ljZURhdGFzZXRzXShodHRwczovL2dpdGh1Yi5jb20vRnV4aUppYS9JbnZvaWNlRGF0YXNldHMpXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0OioqIFVua25vd24gPGJyPlxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldCoqIFVua25vd24gPGJyPlxuXG5UZXh0IERldGVjdGlvbjogMTI3ayB0cmFpbmluZyBpbWFnZXMgKDY4SyByZWFsIHNjZW5lIGltYWdlcyBmcm9tIEJhaWR1IGltYWdlIHNlYXJjaCBhbmQgcHVibGljIGRhdGFzZXRzIGFuZCA1OUsgc3ludGhldGljIGltYWdlcylcblxuVGV4dCBSZWNvZ25pdGlvbjogMTguNU0gdHJhaW5pbmcgaW1hZ2VzICg3TSByZWFsIHNjZW5lIGltYWdlcyBmcm9tIEJhaWR1IGltYWdlIHNlYXJjaCBhbmQgcHVibGljIGRhdGFzZXRzIGFuZCAxMS41TSBzeW50aGV0aWMgaW1hZ2VzKVxuXG4jIyBFdmFsdWF0aW9uOlxuXG5UaGUgbW9kZWwgaGFzIGJlZW4gcHJpbWFyaWx5IGV2YWx1YXRlZCBvbiBzdGFuZGFyZCBkb2N1bWVudCBsYXlvdXRzLiBQZXJmb3JtYW5jZSBvbiBjb21wbGV4IGxheW91dHMgc3VjaCBhcyBkZW5zZSB0YWJsZXMsIG11bHRpLWNvbHVtbiBkb2N1bWVudHMsIGFuZCBtaXhlZCBoYW5kd3JpdGluZy9wcmludGVkIHRleHQgbWF5IHZhcnkuIFVzZXJzIHNob3VsZCBjb25kdWN0IHRoZWlyIG93biB0ZXN0aW5nIHdoZW4gd29ya2luZyB3aXRoIHBhcnRpY3VsYXJseSBjaGFsbGVuZ2luZyBkb2N1bWVudCBzdHJ1Y3R1cmVzLlxuXG5QbGVhc2Ugc2VlIFBhZGRsZU9DUidzIGluZm9ybWF0aW9uIG9uIFt0aGUgbW9kZWxdKGh0dHBzOi8vcGFkZGxlcGFkZGxlLmdpdGh1Yi5pby9QYWRkbGVPQ1IvbGF0ZXN0L2VuL3Bwb2NyL292ZXJ2aWV3Lmh0bWwjcHAtb2NydjMtZW5nbGlzaC1tb2RlbCkgZm9yIG1vcmUgZGV0YWlscy5cblxuIyMgSW5mZXJlbmNlOlxuKipFbmdpbmU6KiogVGVuc29yKFJUKSA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogVGVzdGVkIG9uIGFsbCBzdXBwb3J0ZWQgaGFyZHdhcmUgbGlzdGVkIGluIGNvbXBhdGliaWxpdHkgc2VjdGlvbiA8YnI+XG5cbiMjIEV0aGljYWwgQ29uc2lkZXJhdGlvbnM6XG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuICBXaGVuIGRvd25sb2FkZWQgb3IgdXNlZCBpbiBhY2NvcmRhbmNlIHdpdGggb3VyIHRlcm1zIG9mIHNlcnZpY2UsIGRldmVsb3BlcnMgc2hvdWxkIHdvcmsgd2l0aCB0aGVpciBpbnRlcm5hbCBtb2RlbCB0ZWFtIHRvIGVuc3VyZSB0aGlzIG1vZGVsIG1lZXRzIHJlcXVpcmVtZW50cyBmb3IgdGhlIHJlbGV2YW50IGluZHVzdHJ5IGFuZCB1c2UgY2FzZSBhbmQgYWRkcmVzc2VzIHVuZm9yZXNlZW4gcHJvZHVjdCBtaXN1c2UuXG5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuIiwKICAgICJkaXNwbGF5TmFtZSI6ICJQYWRkbGVPQ1IiLAogICAgImZyYW1ld29yayI6ICJPdGhlciIsCiAgICAiaGFzUGxheWdyb3VuZCI6IGZhbHNlLAogICAgImhhc1NpZ25lZFZlcnNpb24iOiB0cnVlLAogICAgImlzUGxheWdyb3VuZEVuYWJsZWQiOiBmYWxzZSwKICAgICJpc1B1YmxpYyI6IGZhbHNlLAogICAgImlzUmVhZE9ubHkiOiB0cnVlLAogICAgImxhYmVscyI6IFsKICAgICAgICAiTlNQRUNULTJJWUktQkExRyIsCiAgICAgICAgIk5WSURJQSBOSU0iLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJsNDBzeDEtdHJ0LWZwMTYtazd2bmMteW1jZyIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogMTI4NTMwNjYxLAogICAgImxvZ28iOiAiaHR0cHM6Ly9kZXZlbG9wZXItYmxvZ3MubnZpZGlhLmNvbS93cC1jb250ZW50L3VwbG9hZHMvMjAyNC8wMy9uZW1vLXJldHJpZXZlci1ncmFwaGljLnBuZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiTi9BIiwKICAgICJuYW1lIjogInBhZGRsZW9jciIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJOL0EiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJQYWRkbGVPQ1IgaXMgYW4gdWx0cmEgbGlnaHR3ZWlnaHQgT3B0aWNhbCBDaGFyYWN0ZXIgUmVjb2duaXRpb24gKE9DUikgc3lzdGVtIGJ5IEJhaWR1LiBQYWRkbGVPQ1Igc3VwcG9ydHMgYSB2YXJpZXR5IG9mIGN1dHRpbmctZWRnZSBhbGdvcml0aG1zIHJlbGF0ZWQgdG8gT0NSLiIsCiAgICAidGVhbU5hbWUiOiAiYmFpZHUiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDctMTZUMDA6MzI6MDQuMjk4WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/baidu/containers/paddleocr optimizationProfiles: - profileId: nim/baidu/paddleocr:l4x1-trt-fp16-fswetrkejq framework: TensorRT-LLM displayName: Paddleocr NVIDIA L4x1 FP16 ngcMetadata: 49049986fc9bf66bc3674dd5ff7953472d7ec6ae82a64b74b8d33d3e8c077391: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 27b8:10de gpu: NVIDIA L4 gpu_key: l4 model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L4 - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:2_TRT_python_2 framework: TensorRT-LLM displayName: Paddleocr NVIDIA A100-SXM4-80GBx1 FP16 ngcMetadata: 495980e0b97395173bd2ddce9f7dec2851c654643e3bdb91c4d8fc24047c4d6a: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 20b2:10de gpu: NVIDIA A100-SXM4-80GB gpu_key: a100-sxm4-80gb model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100-SXM4-80GB - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:2_TRT_python_2__2 framework: TensorRT-LLM displayName: Paddleocr NVIDIA H100 NVLx1 FP16 ngcMetadata: 5c2af3e6451d4087fa274ab38bca77845fbb8e0577c176407511154869d2fe26: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 2321:10de gpu: NVIDIA H100 NVL gpu_key: h100-nvl model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100-NVL - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:l40sx1-trt-fp16-evboykuf0g framework: TensorRT-LLM displayName: Paddleocr NVIDIA L40Sx1 FP16 ngcMetadata: 631c6b6c76996d8cc04cf7cfde63d15d1b5f57cb323dc129f2a838b35703f1d9: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 26b9:10de gpu: NVIDIA L40S gpu_key: l40s model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:2_TRT_python_2__3 framework: TensorRT-LLM displayName: Paddleocr NVIDIA A100-SXM4-40GBx1 FP16 ngcMetadata: 93868053f6713346c8c4f6602b6a981b18d95d6680510bf249fd5b83477bbc52: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 20b0:10de gpu: NVIDIA A100-SXM4-40GB gpu_key: a100-sxm4-40gb model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100-SXM4-40GB - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:a10gx1-trt-fp16-ijpjeptpna framework: TensorRT-LLM displayName: Paddleocr NVIDIA A10Gx1 FP16 ngcMetadata: acba2841622c4da2050811e8c7c4bae4c16996ab61b67d68b089176524d70383: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 2237:10de gpu: NVIDIA A10G gpu_key: a10g model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A10G - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:b200x1-trt-fp16-itomrwaucq framework: TensorRT-LLM displayName: Paddleocr NVIDIA B200x1 FP16 ngcMetadata: b6c8b6aef874d014b535faf2742d759bce6670c32b777ea8762d6264f7d30737: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 2901:10de gpu: NVIDIA B200 gpu_key: b200 model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:2_TRT_python_2__4 framework: TensorRT-LLM displayName: Paddleocr NVIDIA H100 80GB HBM3x1 FP16 ngcMetadata: eaad888e841d6944998862e9ea19050e530701214aa6caa164047bc0fb800a69: model: baidu/paddleocr release: 1.5.0 tags: backend: triton batch_size: '32' device_id: 2330:10de gpu: NVIDIA H100 80GB HBM3 gpu_key: h100-hbm3-80gb model_type: tensorrt precision: fp16 modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100-HBM3-80GB - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: TENSORRT - profileId: nim/baidu/paddleocr:4_ONNX_python_2 framework: ONNX displayName: Paddleocr ONNX FP16 ngcMetadata: edc693c6fccd68d266622eace04225421e353d7ce31e3b207afc5ff35124127b: model: baidu/paddleocr release: 1.5.0 tags: backend: triton model_type: onnx precision: fp16 modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.5.0 - key: DOWNLOAD SIZE value: 1GB - key: BACKEND value: TRITON - key: MODEL TYPE value: ONNX labels: - signed images - NSPECT-LDAL-INWI - NVIDIA AI Enterprise Supported - NVIDIA NIM config: architectures: - Other modelType: NIM license: NVIDIA AI Foundation Models Community License - name: Llama 3.2 NV EmbedQA 1b V2 displayName: Llama 3.2 NV EmbedQA 1b V2 modelHubID: llama-3.2-nv-embedqa-v2 category: Retrieval type: NGC description: Embedding model for multilingual and cross-lingual question-answering retrieval across 26 languages. Supports dynamic embedding sizing to significantly reduce storage footprint. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: Llama 3.2 NV EmbedQA 1b V2 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIFtwcm90ZWN0ZWQgY2xhc3Nlc10oaHR0cHM6Ly93d3cuc2VuYXRlLmNhLmdvdi9jb250ZW50L3Byb3RlY3RlZC1jbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3RpbmcgfCBOb25lIHxcbnwgTWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzIHwgTm9uZSB8IiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMi0xOVQxNjoxMToyNy45MDdaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyAqKk1vZGVsIE92ZXJ2aWV3KipcblxuIyMjICoqRGVzY3JpcHRpb24qKlxuXG5UaGUgTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIEVtYmVkZGluZyAxQiBtb2RlbCBpcyBvcHRpbWl6ZWQgZm9yICoqbXVsdGlsaW5ndWFsIGFuZCBjcm9zcy1saW5ndWFsKiogdGV4dCBxdWVzdGlvbi1hbnN3ZXJpbmcgcmV0cmlldmFsIHdpdGggKipzdXBwb3J0IGZvciBsb25nIGRvY3VtZW50cyAodXAgdG8gODE5MiB0b2tlbnMpIGFuZCBkeW5hbWljIGVtYmVkZGluZyBzaXplIChNYXRyeW9zaGthIEVtYmVkZGluZ3MpKiouIFRoaXMgbW9kZWwgd2FzIGV2YWx1YXRlZCBvbiAyNiBsYW5ndWFnZXM6IEVuZ2xpc2gsIEFyYWJpYywgQmVuZ2FsaSwgQ2hpbmVzZSwgQ3plY2gsIERhbmlzaCwgRHV0Y2gsIEZpbm5pc2gsIEZyZW5jaCwgR2VybWFuLCBIZWJyZXcsIEhpbmRpLCBIdW5nYXJpYW4sIEluZG9uZXNpYW4sIEl0YWxpYW4sIEphcGFuZXNlLCBLb3JlYW4sIE5vcndlZ2lhbiwgUGVyc2lhbiwgUG9saXNoLCBQb3J0dWd1ZXNlLCBSdXNzaWFuLCBTcGFuaXNoLCBTd2VkaXNoLCBUaGFpLCBhbmQgVHVya2lzaC5cblxuSW4gYWRkaXRpb24gdG8gZW5hYmxpbmcgbXVsdGlsaW5ndWFsIGFuZCBjcm9zcy1saW5ndWFsIHF1ZXN0aW9uLWFuc3dlcmluZyByZXRyaWV2YWwsIHRoaXMgbW9kZWwgcmVkdWNlcyB0aGUgZGF0YSBzdG9yYWdlIGZvb3RwcmludCBieSAzNXggdGhyb3VnaCBkeW5hbWljIGVtYmVkZGluZyBzaXppbmcgYW5kIHN1cHBvcnQgZm9yIGxvbmdlciB0b2tlbiBsZW5ndGgsIG1ha2luZyBpdCBmZWFzaWJsZSB0byBoYW5kbGUgbGFyZ2Utc2NhbGUgZGF0YXNldHMgZWZmaWNpZW50bHkuXG5cbkFuIGVtYmVkZGluZyBtb2RlbCBpcyBhIGNydWNpYWwgY29tcG9uZW50IG9mIGEgdGV4dCByZXRyaWV2YWwgc3lzdGVtLCBhcyBpdCB0cmFuc2Zvcm1zIHRleHR1YWwgaW5mb3JtYXRpb24gaW50byBkZW5zZSB2ZWN0b3IgcmVwcmVzZW50YXRpb25zLiBUaGV5IGFyZSB0eXBpY2FsbHkgdHJhbnNmb3JtZXIgZW5jb2RlcnMgdGhhdCBwcm9jZXNzIHRva2VucyBvZiBpbnB1dCB0ZXh0IChmb3IgZXhhbXBsZTogcXVlc3Rpb24sIHBhc3NhZ2UpIHRvIG91dHB1dCBhbiBlbWJlZGRpbmcuXG5cblRoaXMgbW9kZWwgaXMgcmVhZHkgZm9yIGNvbW1lcmNpYWwgdXNlLlxuXG5UaGUgTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIEVtYmVkZGluZyAxQiBtb2RlbCBpcyBhIHBhcnQgb2YgdGhlIE5WSURJQSBOZU1vIFJldHJpZXZlciBjb2xsZWN0aW9uIG9mIE5JTSwgd2hpY2ggcHJvdmlkZSBzdGF0ZS1vZi10aGUtYXJ0LCBjb21tZXJjaWFsbHktcmVhZHkgbW9kZWxzIGFuZCBtaWNyb3NlcnZpY2VzLCBvcHRpbWl6ZWQgZm9yIHRoZSBsb3dlc3QgbGF0ZW5jeSBhbmQgaGlnaGVzdCB0aHJvdWdocHV0LiBJdCBmZWF0dXJlcyBhIHByb2R1Y3Rpb24tcmVhZHkgaW5mb3JtYXRpb24gcmV0cmlldmFsIHBpcGVsaW5lIHdpdGggZW50ZXJwcmlzZSBzdXBwb3J0LiBUaGUgbW9kZWxzIHRoYXQgZm9ybSB0aGUgY29yZSBvZiB0aGlzIHNvbHV0aW9uIGhhdmUgYmVlbiB0cmFpbmVkIHVzaW5nIHJlc3BvbnNpYmx5IHNlbGVjdGVkLCBhdWRpdGFibGUgZGF0YSBzb3VyY2VzLiBXaXRoIG11bHRpcGxlIHByZS10cmFpbmVkIG1vZGVscyBhdmFpbGFibGUgYXMgc3RhcnRpbmcgcG9pbnRzLCBkZXZlbG9wZXJzIGNhbiBhbHNvIHJlYWRpbHkgY3VzdG9taXplIHRoZW0gZm9yIGRvbWFpbi1zcGVjaWZpYyB1c2UgY2FzZXMsIHN1Y2ggYXMgaW5mb3JtYXRpb24gdGVjaG5vbG9neSwgaHVtYW4gcmVzb3VyY2UgaGVscCBhc3Npc3RhbnRzLCBhbmQgcmVzZWFyY2ggJiBkZXZlbG9wbWVudCByZXNlYXJjaCBhc3Npc3RhbnRzLlxuXG4jIyMgKipJbnRlbmRlZCB1c2UqKlxuXG5UaGUgTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIEVtYmVkZGluZyAxQiBtb2RlbCBpcyBtb3N0IHN1aXRhYmxlIGZvciB1c2VycyB3aG8gd2FudCB0byBidWlsZCBhIG11bHRpbGluZ3VhbCBxdWVzdGlvbi1hbmQtYW5zd2VyIGFwcGxpY2F0aW9uIG92ZXIgYSBsYXJnZSB0ZXh0IGNvcnB1cywgbGV2ZXJhZ2luZyB0aGUgbGF0ZXN0IGRlbnNlIHJldHJpZXZhbCB0ZWNobm9sb2dpZXMuXG5cbiMjIyAqKkxpY2Vuc2UvVGVybXMgb2YgdXNlKipcblxuVGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pIGFuZCBMbGFtYSAzLjIgaXMgbGljZW5zZWQgdW5kZXIgdGhlIFtMbGFtYSAzLjIgQ29tbXVuaXR5IExpY2Vuc2VdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMi9saWNlbnNlLyksIENvcHlyaWdodCBcdTAwYTkgTWV0YSBQbGF0Zm9ybXMsIEluYy4gQWxsIFJpZ2h0cyBSZXNlcnZlZC5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuIyMjICoqUmVsZWFzZSBEYXRlOiAgXG5cbkJ1aWxkLk52aWRpYS5jb206IE1hcmNoIDE3LCAyMDI1IHZpYSBidWlsZC5udmlkaWEuY29tL252aWRpYS9sbGFtYS0zXzItbnYtZW1iZWRxYS0xYi12MiA8YnI+XG5PcmlnaW5hbCBOR0MgUmVsZWFzZTogTWFyY2ggMTcsIDIwMjUgPGJyPlxuTGFzdCBVcGRhdGVkIE5HQyBSZWxlYXNlOiBKdWx5IDExLCAyMDI1IDxicj5cblxuIyMjICoqRGVwbG95bWVudCBHZW9ncmFwaHkqKlxuR2xvYmFsIDxicj5cblxuXG4jIyMgKipNb2RlbCBBcmNoaXRlY3R1cmUqKlxuXG4qKkFyY2hpdGVjdHVyZSBUeXBlOioqIFRyYW5zZm9ybWVyPGJyPlxuKipOZXR3b3JrIEFyY2hpdGVjdHVyZToqKiBGaW5lLXR1bmVkIExsYW1hMy4yIDFCIFJldHJpZXZlcjxicj5cblxuVGhpcyBOZU1vIFJldHJpZXZlciBlbWJlZGRpbmcgbW9kZWwgaXMgYSB0cmFuc2Zvcm1lciBlbmNvZGVyIC0gYSBmaW5lLXR1bmVkIHZlcnNpb24gb2YgTGxhbWEzLjIgMWIsIHdpdGggMTYgbGF5ZXJzIGFuZCBhbiBlbWJlZGRpbmcgc2l6ZSBvZiAyMDQ4LCB3aGljaCBpcyB0cmFpbmVkIG9uIHB1YmxpYyBkYXRhc2V0cy4gVGhlIEFkYW1XIG9wdGltaXplciBpcyBlbXBsb3llZCBpbmNvcnBvcmF0aW5nIDEwMCB3YXJtIHVwIHN0ZXBzIGFuZCA1ZS02IGxlYXJuaW5nIHJhdGUgd2l0aCBXYXJtdXBEZWNheUxSIHNjaGVkdWxlci4gRW1iZWRkaW5nIG1vZGVscyBmb3IgdGV4dCByZXRyaWV2YWwgYXJlIHR5cGljYWxseSB0cmFpbmVkIHVzaW5nIGEgYmktZW5jb2RlciBhcmNoaXRlY3R1cmUuIFRoaXMgaW52b2x2ZXMgZW5jb2RpbmcgYSBwYWlyIG9mIHNlbnRlbmNlcyAoZm9yIGV4YW1wbGUsIHF1ZXJ5IGFuZCBjaHVua2VkIHBhc3NhZ2VzKSBpbmRlcGVuZGVudGx5IHVzaW5nIHRoZSBlbWJlZGRpbmcgbW9kZWwuIENvbnRyYXN0aXZlIGxlYXJuaW5nIGlzIHVzZWQgdG8gbWF4aW1pemUgdGhlIHNpbWlsYXJpdHkgYmV0d2VlbiB0aGUgcXVlcnkgYW5kIHRoZSBwYXNzYWdlIHRoYXQgY29udGFpbnMgdGhlIGFuc3dlciwgd2hpbGUgbWluaW1pemluZyB0aGUgc2ltaWxhcml0eSBiZXR3ZWVuIHRoZSBxdWVyeSBhbmQgc2FtcGxlZCBuZWdhdGl2ZSBwYXNzYWdlcyBub3QgdXNlZnVsIHRvIGFuc3dlciB0aGUgcXVlc3Rpb24uXG5cbiMjIyAqKklucHV0KipcblxuKipJbnB1dCBUeXBlOioqIFRleHQ8YnI+XG4qKklucHV0IEZvcm1hdDoqKiBMaXN0IG9mIHN0cmluZ3M8YnI+XG4qKklucHV0IFBhcmFtZXRlcjoqKiAxRDxicj5cbioqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIElucHV0OioqIFRoZSBtb2RlbCdzIG1heGltdW0gY29udGV4dCBsZW5ndGggaXMgODE5MiB0b2tlbnMuIFRleHRzIGxvbmdlciB0aGFuIG1heGltdW0gbGVuZ3RoIG11c3QgZWl0aGVyIGJlIGNodW5rZWQgb3IgdHJ1bmNhdGVkLjxicj5cblxuIyMjICoqT3V0cHV0KipcblxuKipPdXRwdXQgVHlwZToqKiBGbG9hdHM8YnI+XG4qKk91dHB1dCBGb3JtYXQ6KiogTGlzdCBvZiBmbG9hdCBhcnJheXM8YnI+XG4qKk91dHB1dDoqKiBNb2RlbCBvdXRwdXRzIGVtYmVkZGluZyB2ZWN0b3JzIG9mIG1heGltdW0gZGltZW5zaW9uIDIwNDggZm9yIGVhY2ggdGV4dCBzdHJpbmcgKGNhbiBiZSBjb25maWd1cmVkIGJhc2VkIG9uIDM4NCwgNTEyLCA3NjgsIDEwMjQsIG9yIDIwNDgpLjxicj5cbioqT3RoZXIgUHJvcGVydGllcyBSZWxhdGVkIHRvIE91dHB1dDoqKiBOL0E8YnI+XG5cbk91ciBBSSBtb2RlbHMgYXJlIGRlc2lnbmVkIGFuZC9vciBvcHRpbWl6ZWQgdG8gcnVuIG9uIE5WSURJQSBHUFUtYWNjZWxlcmF0ZWQgc3lzdGVtcy4gQnkgbGV2ZXJhZ2luZyBOVklESUFcdTIwMTlzIGhhcmR3YXJlIChlLmcuIEdQVSBjb3JlcykgYW5kIHNvZnR3YXJlIGZyYW1ld29ya3MgKGUuZy4sIENVREEgbGlicmFyaWVzKSwgdGhlIG1vZGVsIGFjaGlldmVzIGZhc3RlciB0cmFpbmluZyBhbmQgaW5mZXJlbmNlIHRpbWVzIGNvbXBhcmVkIHRvIENQVS1vbmx5IHNvbHV0aW9ucy5cblxuIyMjICoqU29mdHdhcmUgSW50ZWdyYXRpb24qKlxuXG4qKlJ1bnRpbWUgRW5naW5lOioqIE5lTW8gUmV0cmlldmVyIGVtYmVkZGluZyBOSU08YnI+XG4qKlN1cHBvcnRlZCBIYXJkd2FyZSBNaWNyb2FyY2hpdGVjdHVyZSBDb21wYXRpYmlsaXR5Kio6IE5WSURJQSBBbXBlcmUsIE5WSURJQSBIb3BwZXIsIE5WSURJQSBMb3ZlbGFjZTxicj5cbioqU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6KiogTGludXg8YnI+XG5cbiMjIyAqKk1vZGVsIFZlcnNpb24ocykqKlxuXG5MbGFtYSAzLjIgTmVNbyBSZXRyaWV2ZXIgRW1iZWRkaW5nIDFCIHYyPGJyPlxuU2hvcnQgTmFtZTogbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjI8YnI+XG5cbiMjICoqVHJhaW5pbmcgRGF0YXNldCAmIEV2YWx1YXRpb24qKlxuXG4jIyMgKipUcmFpbmluZyBEYXRhc2V0KipcblxuVGhlIGRldmVsb3BtZW50IG9mIGxhcmdlLXNjYWxlIHB1YmxpYyBvcGVuLVFBIGRhdGFzZXRzIGhhcyBlbmFibGVkIHRyZW1lbmRvdXMgcHJvZ3Jlc3MgaW4gcG93ZXJmdWwgZW1iZWRkaW5nIG1vZGVscy4gSG93ZXZlciwgb25lIHBvcHVsYXIgZGF0YXNldCBuYW1lZCBNUyBNQVJDTyByZXN0cmljdHMgXHUyMDBjY29tbWVyY2lhbCBsaWNlbnNpbmcsIGxpbWl0aW5nIHRoZSB1c2Ugb2YgdGhlc2UgbW9kZWxzIGluIGNvbW1lcmNpYWwgc2V0dGluZ3MuIFRvIGFkZHJlc3MgdGhpcywgTlZJRElBIGNyZWF0ZWQgaXRzIG93biB0cmFpbmluZyBkYXRhc2V0IGJsZW5kIGJhc2VkIG9uIHB1YmxpYyBRQSBkYXRhc2V0cywgd2hpY2ggZWFjaCBoYXZlIGEgbGljZW5zZSBmb3IgY29tbWVyY2lhbCBhcHBsaWNhdGlvbnMuXG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiwgU3ludGhldGljXG5cblxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldCoqOiBIeWJyaWQ6IEF1dG9tYXRlZCwgSHVtYW4sIFN5bnRoZXRpY1xuXG5cbioqUHJvcGVydGllczoqKiBTZW1pLXN1cGVydmlzZWQgcHJlLXRyYWluaW5nIG9uIDEyTSBzYW1wbGVzIGZyb20gcHVibGljIGRhdGFzZXRzIGFuZCBmaW5lLXR1bmluZyBvbiAxTSBzYW1wbGVzIGZyb20gcHVibGljIGRhdGFzZXRzLlxuXG5cbiMjIyAqKkV2YWx1YXRpb24gUmVzdWx0cyoqXG5cblByb3BlcnRpZXM6IFdlIGV2YWx1YXRlZCB0aGUgTmVNbyBSdHJpZXZlciBlbWJkZGluZyBtb2RlbCBpbiBjb21wYXJpc29uIHRvIGxpdGVyYXR1cmUgb3BlbiAmIGNvbW1lcmNpYWwgcmV0cmlldmVyIG1vZGVscyBvbiBhY2FkZW1pYyBiZW5jaG1hcmtzIGZvciBxdWVzdGlvbi1hbnN3ZXJpbmcgLSBbTlFdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZGF0YXNldHMvQmVJUi9ucSksIFtIb3Rwb3RRQV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9ob3Rwb3RfcWEpIGFuZCBbRmlRQSAoRmluYW5jZSBRXFwmQSldKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZGF0YXNldHMvQmVJUi9maXFhKSBmcm9tIEJlSVIgYmVuY2htYXJrIGFuZCBUZWNoUUEgZGF0YXNldC4gTm90ZSB0aGF0IHRoZSBtb2RlbCB3YXMgZXZhbHVhdGVkIG9mZmxpbmUgb24gQTEwMCBHUFVzIHVzaW5nIHRoZSBtb2RlbCdzIFB5VG9yY2ggY2hlY2twb2ludC4gIEluIHRoaXMgYmVuY2htYXJrLCB0aGUgbWV0cmljIHVzZWQgd2FzIFJlY2FsbEA1LlxuXG58IE9wZW4gJiBDb21tZXJjaWFsIFJldHJpZXZhbCBNb2RlbHMgfCBBdmVyYWdlIFJlY2FsbEA1IG9uIE5RLCBIb3Rwb3RRQSwgRmlRQSwgVGVjaFFBIGRhdGFzZXQgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjIgKGVtYmVkZGluZyBkaW0gMjA0OCkgfCA2OC42MCUgfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiAoZW1iZWRkaW5nIGRpbSAzODQpIHwgNjQuNDglIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjEgKGVtYmVkZGluZyBkaW0gMjA0OCkgfCA2OC45NyUgfFxufCBudi1lbWJlZHFhLW1pc3RyYWwtN2ItdjIgfCA3Mi45NyUgfFxufCBudi1lbWJlZHFhLW1pc3RyYWwtN0ItdjEgfCA2NC45MyUgfFxufCBudi1lbWJlZHFhLWU1LXY1IHwgNjIuMDclIHxcbnwgbnYtZW1iZWRxYS1lNS12NCB8IDU3LjY1JSB8XG58IGU1LWxhcmdlLXVuc3VwZXJ2aXNlZCB8IDQ4LjAzJSB8XG58IEJNMjUgfCA0NC42NyUgIHxcblxuV2UgZXZhbHVhdGVkIHRoZSBtdWx0aWxpbmd1YWwgY2FwYWJpbGl0aWVzIG9uIHRoZSBhY2FkZW1pYyBiZW5jaG1hcmsgW01JUkFDTF0oaHR0cHM6Ly9naXRodWIuY29tL3Byb2plY3QtbWlyYWNsL21pcmFjbCkgYWNyb3NzIDE1IGxhbmd1YWdlcyBhbmQgdHJhbnNsYXRlZCB0aGUgRW5nbGlzaCBhbmQgU3BhbmlzaCB2ZXJzaW9uIG9mIE1JUkFDTCBpbnRvIGFkZGl0aW9uYWwgMTEgbGFuZ3VhZ2VzLiBUaGUgcmVwb3J0ZWQgc2NvcmVzIGFyZSBiYXNlZCBvbiBhbiBpbnRlcm5hbCB2ZXJzaW9uIG9mIE1JUkFDTCBieSBzZWxlY3RpbmcgaGFyZCBuZWdhdGl2ZXMgZm9yIGVhY2ggcXVlcnkgdG8gcmVkdWNlIHRoZSBjb3JwdXMgc2l6ZS5cblxufCBPcGVuICYgQ29tbWVyY2lhbCBSZXRyaWV2YWwgTW9kZWxzIHwgQXZlcmFnZSBSZWNhbGxANSBvbiBtdWx0aWxpbmd1YWwgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjIgKGVtYmVkZGluZyBkaW0gMjA0OCkgfCA2MC43NSUgfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiAoZW1iZWRkaW5nIGRpbSAzODQpIHwgNTguNjIlIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjEgfCA2MC4wNyUgfFxufCBudi1lbWJlZHFhLW1pc3RyYWwtN2ItdjIgfCA1MC40MiUgfFxufCBCTTI1IHwgMjYuNTElIHxcblxuV2UgZXZhbHVhdGVkIHRoZSBjcm9zcy1saW5ndWFsIGNhcGFiaWxpdGllcyBvbiB0aGUgYWNhZGVtaWMgYmVuY2htYXJrIFtNTFFBXShodHRwczovL2dpdGh1Yi5jb20vZmFjZWJvb2tyZXNlYXJjaC9NTFFBLykgYmFzZWQgb24gNyBsYW5ndWFnZXMgKEFyYWJpYywgQ2hpbmVzZSwgRW5nbGlzaCwgR2VybWFuLCBIaW5kaSwgU3BhbmlzaCwgVmlldG5hbWVzZSkuIFdlIGNvbnNpZGVyIG9ubHkgZXZhbHVhdGlvbiBkYXRhc2V0cyB3aGVuIHRoZSBxdWVyeSBhbmQgZG9jdW1lbnRzIGFyZSBpbiBkaWZmZXJlbnQgbGFuZ3VhZ2VzLiBXZSBjYWxjdWxhdGUgdGhlIGF2ZXJhZ2UgUmVjYWxsQDUgYWNyb3NzIHRoZSA0MiBkaWZmZXJlbnQgbGFuZ3VhZ2UgcGFpcnMuXG5cbnwgT3BlbiAmIENvbW1lcmNpYWwgUmV0cmlldmFsIE1vZGVscyB8IEF2ZXJhZ2UgUmVjYWxsQDUgb24gTUxRQSBkYXRhc2V0IHdpdGggZGlmZmVyZW50IGxhbmd1YWdlcyB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiAoZW1iZWRkaW5nIGRpbSAyMDQ4KSB8IDc5Ljg2JSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyIChlbWJlZGRpbmcgZGltIDM4NCkgfCA3MS42MSUgfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MSAoZW1iZWRkaW5nIGRpbSAyMDQ4KSB8IDc4Ljc3JSB8XG58IG52LWVtYmVkcWEtbWlzdHJhbC03Yi12MiB8IDY4LjM4JSB8XG58IEJNMjUgfCAxMy4wMSUgfFxuXG5XZSBldmFsdWF0ZWQgdGhlIHN1cHBvcnQgb2YgbG9uZyBkb2N1bWVudHMgb24gdGhlIGFjYWRlbWljIGJlbmNobWFyayBbTXVsdGlsaW5ndWFsIExvbmctRG9jdW1lbnQgUmV0cmlldmFsIChNTERSKV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9TaGl0YW8vTUxEUikgYnVpbHQgb24gV2lraXBlZGlhIGFuZCBtQzQsIGNvdmVyaW5nIDEyIHR5cG9sb2dpY2FsbHkgZGl2ZXJzZSBsYW5ndWFnZXMuIFRoZSBFbmdsaXNoIHZlcnNpb24gaGFzIGEgbWVkaWFuIGxlbmd0aCBvZiAyMzk5IHRva2VucyBhbmQgOTB0aCBwZXJjZW50aWxlIG9mIDc0ODMgdG9rZW5zIHVzaW5nIHRoZSBsbGFtYSAzLjIgdG9rZW5pemVyLiBUaGUgTUxEUiBkYXRhc2V0IGlzIGJhc2VkIG9uIHN5bnRoZXRpYyBnZW5lcmF0ZWQgcXVlc3Rpb25zIHdpdGggYSBMTE0sIHdoaWNoIGhhcyB0aGUgdGVuZGVuY3kgdG8gY3JlYXRlIHF1ZXN0aW9ucyB3aXRoIHNpbWlsYXIga2V5d29yZHMgdGhhbiB0aGUgcG9zaXRpdmUgZG9jdW1lbnQsIGJ1dCBtaWdodCBub3QgYmUgcmVwcmVzZW50YXRpdmUgZm9yIHJlYWwgdXNlciBxdWVyaWVzLiBUaGlzIGNoYXJhY3RlcmlzdGljIG9mIHRoZSBkYXRhc2V0IGJlbmVmaXRzIHNwYXJzZSBlbWJlZGRpbmdzIGxpa2UgQk0yNS5cblxufCBPcGVuICYgQ29tbWVyY2lhbCBSZXRyaWV2YWwgTW9kZWxzIHwgQXZlcmFnZSBSZWNhbGxANSBvbiBNTERSIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyIChlbWJlZGRpbmcgZGltIDIwNDgpIHwgNTkuNTUlIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjIgKGVtYmVkZGluZyBkaW0gMzg0KSB8IDU0Ljc3JSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYxIChlbWJlZGRpbmcgZGltIDIwNDgpIHwgNjAuNDklIHxcbnwgbnYtZW1iZWRxYS1taXN0cmFsLTdiLXYyIHwgNDMuMjQlIHxcbnwgQk0yNSB8IDcxLjM5JSB8XG5cbioqRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0Kio6IEh5YnJpZDogQXV0b21hdGVkLCBIdW1hbiwgU3ludGhldGljXG5cbioqTGFiZWxpbmcgTWV0aG9kIGJ5IGRhdGFzZXQ6KiogSHlicmlkOiBBdXRvbWF0ZWQsIEh1bWFuLCBTeW50aGV0aWNcblxuKipQcm9wZXJ0aWVzOioqIFRoZSBldmFsdWF0aW9uIGRhdGFzZXRzIGFyZSBiYXNlZCBvbiBbTVRFQi9CRUlSXShodHRwczovL2dpdGh1Yi5jb20vYmVpci1jZWxsYXIvYmVpciksIFRleHRRQSwgVGVjaFFBLCBbTUlSQUNMXShodHRwczovL2dpdGh1Yi5jb20vcHJvamVjdC1taXJhY2wvbWlyYWNsKSwgW01MUUFdKGh0dHBzOi8vZ2l0aHViLmNvbS9mYWNlYm9va3Jlc2VhcmNoL01MUUEpLCBhbmQgW01MRFJdKGh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28vZGF0YXNldHMvU2hpdGFvL01MRFIpLiBUaGUgc2l6ZSByYW5nZXMgYmV0d2VlbiAxMCwwMDBzIHVwIHRvIDVNIGRlcGVuZGluZyBvbiB0aGUgZGF0YXNldC5cblxuKipJbmZlcmVuY2UqKjxicj5cbioqRW5naW5lOioqIFRlbnNvclJUPGJyPlxuKipUZXN0IEhhcmR3YXJlOioqIEgxMDAgUENJZS9TWE0sIEExMDAgUENJZS9TWE0sIEw0MHMsIEw0LCBhbmQgQTEwRzxicj5cblxuIyMgKipFdGhpY2FsIENvbnNpZGVyYXRpb25zKipcblxuTlZJRElBIGJlbGlldmVzIFRydXN0d29ydGh5IEFJIGlzIGEgc2hhcmVkIHJlc3BvbnNpYmlsaXR5IGFuZCB3ZSBoYXZlIGVzdGFibGlzaGVkIHBvbGljaWVzIGFuZCBwcmFjdGljZXMgdG8gZW5hYmxlIGRldmVsb3BtZW50IGZvciBhIHdpZGUgYXJyYXkgb2YgQUkgYXBwbGljYXRpb25zLiBXaGVuIGRvd25sb2FkZWQgb3IgdXNlZCBpbiBhY2NvcmRhbmNlIHdpdGggb3VyIHRlcm1zIG9mIHNlcnZpY2UsIGRldmVsb3BlcnMgc2hvdWxkIHdvcmsgd2l0aCB0aGVpciBzdXBwb3J0aW5nIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS5cblxuRm9yIG1vcmUgZGV0YWlsZWQgaW5mb3JtYXRpb24gb24gZXRoaWNhbCBjb25zaWRlcmF0aW9ucyBmb3IgdGhpcyBtb2RlbCwgcGxlYXNlIHNlZSB0aGUgTW9kZWwgQ2FyZCsrIHRhYiBmb3IgdGhlIEV4cGxhaW5hYmlsaXR5LCBCaWFzLCBTYWZldHkgJiBTZWN1cml0eSwgYW5kIFByaXZhY3kgc3ViY2FyZHMuXG5cblBsZWFzZSByZXBvcnQgc2VjdXJpdHkgdnVsbmVyYWJpbGl0aWVzIG9yIE5WSURJQSBBSSBDb25jZXJucyBbaGVyZV0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9zdXBwb3J0L3N1Ym1pdC1zZWN1cml0eS12dWxuZXJhYmlsaXR5LykuIiwKICAgICJkaXNwbGF5TmFtZSI6ICJMbGFtYSAzLjIgTmVNbyBSZXRyaWV2ZXIgRW1iZWRkaW5nIDFCIiwKICAgICJleHBsYWluYWJpbGl0eSI6ICJ8IEZpZWxkIHwgUmVzcG9uc2UgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgSW50ZW5kZWQgQXBwbGljYXRpb24gJiBEb21haW46IHwgUGFzc2FnZSBhbmQgcXVlcnkgZW1iZWRkaW5nIGZvciBxdWVzdGlvbiBhbmQgYW5zd2VyIHJldHJpZXZhbCB8XG58IE1vZGVsIFR5cGU6IHwgVHJhbnNmb3JtZXIgZW5jb2RlciB8XG58IEludGVuZGVkIFVzZXI6IHwgR2VuZXJhdGl2ZSBBSSBjcmVhdG9ycyB3b3JraW5nIHdpdGggY29udmVyc2F0aW9uYWwgQUkgbW9kZWxzIC0gdXNlcnMgd2hvIHdhbnQgdG8gYnVpbGQgYSBtdWx0aWxpbmd1YWwgcXVlc3Rpb24gYW5kIGFuc3dlciBhcHBsaWNhdGlvbiBvdmVyIGEgbGFyZ2UgdGV4dCBjb3JwdXMsIGxldmVyYWdpbmcgdGhlIGxhdGVzdCBkZW5zZSByZXRyaWV2YWwgdGVjaG5vbG9naWVzLiB8XG58IE91dHB1dDogfCBBcnJheSBvZiBmbG9hdCBudW1iZXJzIChEZW5zZSBWZWN0b3IgUmVwcmVzZW50YXRpb24gZm9yIHRoZSBpbnB1dCB0ZXh0KSB8XG58IERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6IHwgTW9kZWwgdHJhbnNmb3JtcyB0aGUgdG9rZW5pemVkIGlucHV0IHRleHQgaW50byBhIGRlbnNlIHZlY3RvciByZXByZXNlbnRhdGlvbi4gfFxufCBQZXJmb3JtYW5jZSBNZXRyaWNzOiB8IEFjY3VyYWN5LCBUaHJvdWdocHV0LCBhbmQgTGF0ZW5jeSB8XG58IFBvdGVudGlhbCBLbm93biBSaXNrczogfCBUaGlzIG1vZGVsIGRvZXMgbm90IGFsd2F5cyBndWFyYW50ZWUgdG8gcmV0cmlldmUgdGhlIGNvcnJlY3QgcGFzc2FnZShzKSBmb3IgYSBnaXZlbiBxdWVyeS4gfFxufCBMaWNlbnNpbmcgJiBUZXJtcyBvZiBVc2U6IHwgVGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIEFJIEZvdW5kYXRpb24gTW9kZWxzIENvbW11bml0eSBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pIGFuZCBMbGFtYSAzLjIgaXMgbGljZW5zZWQgdW5kZXIgdGhlIFtMbGFtYSAzLjIgQ29tbXVuaXR5IExpY2Vuc2VdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMi9saWNlbnNlLyksIENvcHlyaWdodCBcdTAwYTkgTWV0YSBQbGF0Zm9ybXMsIEluYy4gQWxsIFJpZ2h0cyBSZXNlcnZlZC4gfFxufCBUZWNobmljYWwgTGltaXRhdGlvbnMgfCBUaGUgbW9kZWxcdTIwMTlzIG1heCBzZXF1ZW5jZSBsZW5ndGggaXMgODE5Mi4gVGhlcmVmb3JlLCB0aGUgbG9uZ2VyIHRleHQgaW5wdXRzIHNob3VsZCBiZSB0cnVuY2F0ZWQuICAgfFxufCBOYW1lIHRoZSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIHRoaXMgaGFzIGJlZW4gdGVzdGVkIHRvIGRlbGl2ZXIgY29tcGFyYWJsZSBvdXRjb21lcyByZWdhcmRsZXNzIG9mOiB8IE4vQSB8XG58IFZlcmlmaWVkIHRvIGhhdmUgbWV0IHByZXNjcmliZWQgTlZJRElBIHF1YWxpdHkgc3RhbmRhcmRzOiB8IFllcyB8IiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5TUEVDVC0zMVVKLVM4WDQiLAogICAgICAgICJOVklESUEgQUkgRW50ZXJwcmlzZSBTdXBwb3J0ZWQiLAogICAgICAgICJOVklESUEgTklNIiwKICAgICAgICAibGxhbWEtMy0yLW52LWVtYmVkcWEtMWItdjIiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJydHg1MDkweDEtdHJ0LWZwOC1iLWctcWFhOXJhIiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxNjQ4NTEzNTQ0LAogICAgImxvZ28iOiAiaHR0cHM6Ly9kZXZlbG9wZXItYmxvZ3MubnZpZGlhLmNvbS93cC1jb250ZW50L3VwbG9hZHMvMjAyNC8wMy9uZW1vLXJldHJpZXZlci1ncmFwaGljLnBuZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiTi9BIiwKICAgICJuYW1lIjogImxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyIiwKICAgICJvcmdOYW1lIjogIm5pbSIsCiAgICAicHJlY2lzaW9uIjogIk4vQSIsCiAgICAicHJpdmFjeSI6ICJ8IEZpZWxkIHwgUmVzcG9uc2UgfFxufCAtLS0tLSB8IC0tLS0tIHxcbnwgR2VuZXJhdGFibGUgb3IgcmV2ZXJzZSBlbmdpbmVlcmFibGUgcGVyc29uYWwgZGF0YT8gfCBOb25lIHxcbnwgUGVyc29uYWwgZGF0YSB1c2VkIHRvIGNyZWF0ZSB0aGlzIG1vZGVsPyB8IE5vbmUgfFxufCBIb3cgb2Z0ZW4gaXMgZGF0YXNldCByZXZpZXdlZD8gfCBEYXRhc2V0IGlzIGluaXRpYWxseSByZXZpZXdlZCB1cG9uIGFkZGl0aW9uLCBhbmQgc3Vic2VxdWVudCByZXZpZXdzIGFyZSBjb25kdWN0ZWQgYXMgbmVlZGVkIG9yIHVwb24gcmVxdWVzdCBmb3IgY2hhbmdlcy4gfFxufCBJcyB0aGVyZSBwcm92ZW5hbmNlIGZvciBhbGwgZGF0YXNldHMgdXNlZCBpbiB0cmFpbmluZz8gfCBZZXMgfFxufCBEb2VzIGRhdGEgbGFiZWxpbmcgKGFubm90YXRpb24sIG1ldGFkYXRhKSBjb21wbHkgd2l0aCBwcml2YWN5IGxhd3M/IHwgWWVzIHxcbnwgSXMgZGF0YSBjb21wbGlhbnQgd2l0aCBkYXRhIHN1YmplY3QgcmVxdWVzdHMgZm9yIGRhdGEgY29ycmVjdGlvbiBvciByZW1vdmFsLCBpZiBzdWNoIGEgcmVxdWVzdCB3YXMgbWFkZT8gfCBObywgbm90IHBvc3NpYmxlIHdpdGggZXh0ZXJuYWxseS1zb3VyY2VkIGRhdGEuIHxcbnwgQXBwbGljYWJsZSBQcml2YWN5IFBvbGljeSB8IGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWJvdXQtbnZpZGlhL3ByaXZhY3ktcG9saWN5LyB8IiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJOVklESUEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogInwgRmllbGQgfCBSZXNwb25zZSB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBNb2RlbCBBcHBsaWNhdGlvbihzKTogfCBUZXh0IEVtYmVkZGluZyBmb3IgUmV0cmlldmFsIHxcbnwgVXNlIENhc2UgUmVzdHJpY3Rpb25zOiB8IEFiaWRlIGJ5IFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykuICAgfFxufCBNb2RlbCBhbmQgZGF0YXNldCByZXN0cmljdGlvbnM6IHwgVGhlIFByaW5jaXBsZSBvZiBsZWFzdCBwcml2aWxlZ2UgKFBvTFApIGlzIGFwcGxpZWQgbGltaXRpbmcgYWNjZXNzIGZvciBkYXRhc2V0IGdlbmVyYXRpb24gYW5kIG1vZGVsIGRldmVsb3BtZW50LiBSZXN0cmljdGlvbnMgZW5mb3JjZSBkYXRhc2V0IGFjY2VzcyBkdXJpbmcgdHJhaW5pbmcsIGFuZCBkYXRhc2V0IGxpY2Vuc2UgY29uc3RyYWludHMgYWRoZXJlZCB0by4gfFxufCBEZXNjcmliZSB0aGUgbGlmZSBjcml0aWNhbCBpbXBhY3QgKGlmIHByZXNlbnQpOiB8IE5vdCBhcHBsaWNhYmxlLiB8IiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIldvcmxkLWNsYXNzIG11bHRpbGluZ3VhbCBhbmQgY3Jvc3MtbGluZ3VhbCBxdWVzdGlvbi1hbnN3ZXJpbmcgcmV0cmlldmFsLiIsCiAgICAidGVhbU5hbWUiOiAibnZpZGlhIiwKICAgICJ1cGRhdGVkRGF0ZSI6ICIyMDI1LTA4LTI5VDE4OjAxOjU3LjI3OVoiCn0= source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama-3.2-nv-embedqa-1b-v2 optimizationProfiles: - profileId: nim/nvidia/llama-3.2-nv-embedqa-1b-v2:onnx-precision.fp16-7c7a1c17 framework: ONNX displayName: Llama 3.2 NV Embedqa 1B V2 ONNX FP16 ngcMetadata: f7391ddbcb95b2406853526b8e489fedf20083a2420563ca3e65358ff417b10f: model: nvidia/llama-3.2-nv-embedqa-1b-v2 release: 1.10.0 tags: backend: onnx model_type: onnx precision: fp16 tp: '1' modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.10.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: ONNX - key: MODEL TYPE value: ONNX - key: MAX TOKENS value: 8192 - key: TOTAL PARAMETERS value: 1236 - key: Embedding Dimension value: 2048 labels: - Llama - Meta - Chat - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Llama 3.2 NV RerankQA 1b V2 displayName: Llama 3.2 NV RerankQA 1b V2 modelHubID: llama-3.2-nv-rerankqa-v2 category: Retrieval type: NGC description: Reranking model that scores document relevance to improve retrieval accuracy. Fine-tuned for multilingual and cross-lingual use across 26 languages. requireLicense: true licenseAgreements: - label: Use Policy url: https://llama.meta.com/llama3/use-policy/ - label: License Agreement url: https://llama.meta.com/llama3/license/ modelVariants: - variantId: Llama 3.2 NV RerankQA 1b V2 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IFBhcnRpY2lwYXRpb24gY29uc2lkZXJhdGlvbnMgZnJvbSBhZHZlcnNlbHkgaW1wYWN0ZWQgZ3JvdXBzIFtwcm90ZWN0ZWQgY2xhc3Nlc10oaHR0cHM6Ly93d3cuc2VuYXRlLmNhLmdvdi9jb250ZW50L3Byb3RlY3RlZC1jbGFzc2VzKSBpbiBtb2RlbCBkZXNpZ24gYW5kIHRlc3RpbmcgfCBOb25lIHxcbnwgTWVhc3VyZXMgdGFrZW4gdG8gbWl0aWdhdGUgYWdhaW5zdCB1bndhbnRlZCBiaWFzIHwgTm9uZSB8IiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wMy0xNFQwMDoyNTo1MC4wNTFaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyAqKk1vZGVsIE92ZXJ2aWV3KipcblxuIyMjICoqRGVzY3JpcHRpb24qKlxuXG5UaGUgTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIFJlcmFua2luZyAxQiBtb2RlbCBpcyBvcHRpbWl6ZWQgZm9yIHByb3ZpZGluZyBhIGxvZ2l0IHNjb3JlIHRoYXQgcmVwcmVzZW50cyBob3cgcmVsZXZhbnQgYSBkb2N1bWVudChzKSBpcyB0byBhIGdpdmVuIHF1ZXJ5LiBUaGUgbW9kZWwgd2FzIGZpbmUtdHVuZWQgZm9yICoqbXVsdGlsaW5ndWFsLCBjcm9zcy1saW5ndWFsKiogdGV4dCBxdWVzdGlvbi1hbnN3ZXJpbmcgcmV0cmlldmFsLCB3aXRoIHN1cHBvcnQgZm9yICoqbG9uZyBkb2N1bWVudHMgKHVwIHRvIDgxOTIgdG9rZW5zKSoqLiAgVGhpcyBtb2RlbCB3YXMgZXZhbHVhdGVkIG9uIDI2IGxhbmd1YWdlczogRW5nbGlzaCwgQXJhYmljLCBCZW5nYWxpLCBDaGluZXNlLCBDemVjaCwgRGFuaXNoLCBEdXRjaCwgRmlubmlzaCwgRnJlbmNoLCBHZXJtYW4sIEhlYnJldywgSGluZGksIEh1bmdhcmlhbiwgSW5kb25lc2lhbiwgSXRhbGlhbiwgSmFwYW5lc2UsIEtvcmVhbiwgTm9yd2VnaWFuLCBQZXJzaWFuLCBQb2xpc2gsIFBvcnR1Z3Vlc2UsIFJ1c3NpYW4sIFNwYW5pc2gsIFN3ZWRpc2gsIFRoYWksIGFuZCBUdXJraXNoLlxuXG5cblRoaXMgbW9kZWwgaXMgYSBjb21wb25lbnQgaW4gYSB0ZXh0IHJldHJpZXZhbCBzeXN0ZW0gdG8gaW1wcm92ZSB0aGUgb3ZlcmFsbCBhY2N1cmFjeS4gQSB0ZXh0IHJldHJpZXZhbCBzeXN0ZW0gb2Z0ZW4gdXNlcyBhbiBlbWJlZGRpbmcgbW9kZWwgKGRlbnNlKSBvciBsZXhpY2FsIHNlYXJjaCAoc3BhcnNlKSBpbmRleCB0byByZXR1cm4gcmVsZXZhbnQgdGV4dCBwYXNzYWdlcyBnaXZlbiB0aGUgaW5wdXQuIEEgcmVyYW5raW5nIG1vZGVsIGNhbiBiZSB1c2VkIHRvIHJlcmFuayB0aGUgcG90ZW50aWFsIGNhbmRpZGF0ZSBpbnRvIGEgZmluYWwgb3JkZXIuIFRoZSByZXJhbmtpbmcgbW9kZWwgaGFzIHRoZSBxdWVzdGlvbi1wYXNzYWdlIHBhaXJzIGFzIGFuIGlucHV0IGFuZCB0aGVyZWZvcmUsIGNhbiBwcm9jZXNzIGNyb3NzIGF0dGVudGlvbiBiZXR3ZWVuIHRoZSB3b3Jkcy4gSXRcdTIwMTlzIG5vdCBmZWFzaWJsZSB0byBhcHBseSBhIFJhbmtpbmcgbW9kZWwgb24gYWxsIGRvY3VtZW50cyBpbiB0aGUga25vd2xlZGdlIGJhc2UsIHRoZXJlZm9yZSwgcmFua2luZyBtb2RlbHMgYXJlIG9mdGVuIGRlcGxveWVkIGluIGNvbWJpbmF0aW9uIHdpdGggZW1iZWRkaW5nIG1vZGVscy5cblxuXG5UaGlzIG1vZGVsIGlzIHJlYWR5IGZvciBjb21tZXJjaWFsIHVzZS5cblxuXG5UaGUgTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIFJlcmFua2luZyAxQiBtb2RlbCBpcyBhIHBhcnQgb2YgdGhlIE5lTW8gUmV0cmlldmVyIGNvbGxlY3Rpb24gb2YgTklNLCB3aGljaCBwcm92aWRlIHN0YXRlLW9mLXRoZS1hcnQsIGNvbW1lcmNpYWxseS1yZWFkeSBtb2RlbHMgYW5kIG1pY3Jvc2VydmljZXMsIG9wdGltaXplZCBmb3IgdGhlIGxvd2VzdCBsYXRlbmN5IGFuZCBoaWdoZXN0IHRocm91Z2hwdXQuIEl0IGZlYXR1cmVzIGEgcHJvZHVjdGlvbi1yZWFkeSBpbmZvcm1hdGlvbiByZXRyaWV2YWwgcGlwZWxpbmUgd2l0aCBlbnRlcnByaXNlIHN1cHBvcnQuIFRoZSBtb2RlbHMgdGhhdCBmb3JtIHRoZSBjb3JlIG9mIHRoaXMgc29sdXRpb24gaGF2ZSBiZWVuIHRyYWluZWQgdXNpbmcgcmVzcG9uc2libHkgc2VsZWN0ZWQsIGF1ZGl0YWJsZSBkYXRhIHNvdXJjZXMuIFdpdGggbXVsdGlwbGUgcHJlLXRyYWluZWQgbW9kZWxzIGF2YWlsYWJsZSBhcyBzdGFydGluZyBwb2ludHMsIGRldmVsb3BlcnMgY2FuIGFsc28gcmVhZGlseSBjdXN0b21pemUgdGhlbSBmb3IgdGhlaXIgZG9tYWluLXNwZWNpZmljIHVzZSBjYXNlcywgc3VjaCBhcyBpbmZvcm1hdGlvbiB0ZWNobm9sb2d5LCBodW1hbiByZXNvdXJjZSBoZWxwIGFzc2lzdGFudHMsIGFuZCByZXNlYXJjaCAmIGRldmVsb3BtZW50IHJlc2VhcmNoIGFzc2lzdGFudHMuXG5cblxuIyMjICoqTGljZW5zZS9UZXJtcyBvZiB1c2UqKlxuXG5UaGUgdXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgQ29tbXVuaXR5IExpY2Vuc2UgQWdyZWVtZW50XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9udmlkaWEtY29tbXVuaXR5LW1vZGVscy1saWNlbnNlLykgIGFuZCBMbGFtYSAzLjIgaXMgbGljZW5zZWQgdW5kZXIgdGhlIFtMbGFtYSAzLjIgQ29tbXVuaXR5IExpY2Vuc2VdKGh0dHBzOi8vd3d3LmxsYW1hLmNvbS9sbGFtYTNfMi9saWNlbnNlLyksIENvcHlyaWdodCBcdTAwYTkgTWV0YSBQbGF0Zm9ybXMsIEluYy4gQWxsIFJpZ2h0cyBSZXNlcnZlZC5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBjb21wbGllcyB3aXRoIGFsbCBhcHBsaWNhYmxlIGxhd3MuKipcblxuIyMjICoqSW50ZW5kZWQgdXNlKipcblxuVGhlIExsYW1hIDMuMiBOZU1vIFJldHJpZXZlciBSZXJhbmtpbmcgMUIgbW9kZWwgaXMgbW9zdCBzdWl0YWJsZSBmb3IgdXNlcnMgd2hvIHdhbnQgdG8gaW1wcm92ZSB0aGVpciBtdWx0aWxpbmd1YWwgcmV0cmlldmFsIHRhc2tzIGJ5IHJlcmFua2luZyBhIHNldCBvZiBjYW5kaWRhdGVzIGZvciBhIGdpdmVuIHF1ZXN0aW9uLlxuXG4jIyMgKipNb2RlbCBBcmNoaXRlY3R1cmU6IExsYW1hLTMuMiAxQiBSYW5rZXIqKlxuXG4qKkFyY2hpdGVjdHVyZSBUeXBlOioqIFRyYW5zZm9ybWVyXG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIEZpbmUtdHVuZWQgbWV0YS1sbGFtYS9MbGFtYS0zLjItMUJcblxuVGhlIExsYW1hIDMuMiBOZU1vIFJldHJpZXZlciBSZXJhbmtpbmcgMUIgbW9kZWwgaXMgYSB0cmFuc2Zvcm1lciBlbmNvZGVyIGZpbmUtdHVuZWQgZm9yIGNvbnRyYXN0aXZlIGxlYXJuaW5nLiBXZSBlbXBsb3kgYmktZGlyZWN0aW9uYWwgYXR0ZW50aW9uIHdoZW4gZmluZS10dW5pbmcgZm9yIGhpZ2hlciBhY2N1cmFjeS4gVGhlIGxhc3QgZW1iZWRkaW5nIG91dHB1dCBieSB0aGUgZGVjb2RlciBtb2RlbCBpcyB1c2VkIHdpdGggYSBtZWFuIHBvb2xpbmcgc3RyYXRlZ3ksIGFuZCBhIGJpbmFyeSBjbGFzc2lmaWNhdGlvbiBoZWFkIGlzIGZpbmUtdHVuZWQgZm9yIHRoZSByYW5raW5nIHRhc2suXG5cblJhbmtpbmcgbW9kZWxzIGZvciB0ZXh0IHJhbmtpbmcgYXJlIHR5cGljYWxseSB0cmFpbmVkIGFzIGEgY3Jvc3MtZW5jb2RlciBmb3Igc2VudGVuY2UgY2xhc3NpZmljYXRpb24uIFRoaXMgaW52b2x2ZXMgcHJlZGljdGluZyB0aGUgcmVsZXZhbmN5IG9mIGEgc2VudGVuY2UgcGFpciAoZm9yIGV4YW1wbGUsIHF1ZXN0aW9uIGFuZCBjaHVua2VkIHBhc3NhZ2VzKS4gVGhlIENyb3NzRW50cm9weSBsb3NzIGlzIHVzZWQgdG8gbWF4aW1pemUgdGhlIGxpa2VsaWhvb2Qgb2YgcGFzc2FnZXMgY29udGFpbmluZyBpbmZvcm1hdGlvbiB0byBhbnN3ZXIgdGhlIHF1ZXN0aW9uIGFuZCBtaW5pbWl6ZSB0aGUgbGlrZWxpaG9vZCBmb3IgKG5lZ2F0aXZlKSBwYXNzYWdlcyB0aGF0IGRvIG5vdCBjb250YWluIGluZm9ybWF0aW9uIHRvIGFuc3dlciB0aGUgcXVlc3Rpb24uXG5cbldlIHRyYWluZWQgdGhlIG1vZGVsIG9uIHB1YmxpYyBkYXRhc2V0cyBkZXNjcmliZWQgaW4gdGhlIERhdGFzZXQgYW5kIFRyYWluaW5nIHNlY3Rpb24uXG5cbiMjIyAqKklucHV0KipcblxuKipJbnB1dCBUeXBlOioqIFBhaXIgb2YgVGV4dHNcbioqSW5wdXQgRm9ybWF0OioqIExpc3Qgb2YgdGV4dCBwYWlyc1xuKipJbnB1dCBQYXJhbWV0ZXJzOioqIDFEXG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBJbnB1dDoqKiBUaGUgbW9kZWwgd2FzIHRyYWluZWQgb24gcXVlc3Rpb24gYW5kIGFuc3dlcmluZyBvdmVyIHRleHQgZG9jdW1lbnRzIGZyb20gbXVsdGlwbGUgbGFuZ3VhZ2VzLiBJdCB3YXMgZXZhbHVhdGVkIHRvIHdvcmsgc3VjY2Vzc2Z1bGx5IHdpdGggdXAgdG8gYSBzZXF1ZW5jZSBsZW5ndGggb2YgODE5MiB0b2tlbnMuIExvbmdlciB0ZXh0cyBhcmUgcmVjb21tZW5kZWQgdG8gYmUgZWl0aGVyIGNodW5rZWQgb3IgdHJ1bmNhdGVkLlxuXG4qKk91dHB1dCoqXG4qKk91dHB1dCBUeXBlOioqIEZsb2F0c1xuKipPdXRwdXQgRm9ybWF0OioqIExpc3Qgb2YgZmxvYXRzXG4qKk91dHB1dCBQYXJhbWV0ZXJzOioqIDFEXG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBPdXRwdXQ6KiogRWFjaCB0aGUgcHJvYmFiaWxpdHkgc2NvcmUgKG9yIHJhdyBsb2dpdHMpLiBVc2VycyBjYW4gZGVjaWRlIHRvIGltcGxlbWVudCBhIFNpZ21vaWQgYWN0aXZhdGlvbiBmdW5jdGlvbiBhcHBsaWVkIHRvIHRoZSBsb2dpdHMgaW4gdGhlaXIgdXNhZ2Ugb2YgdGhlIG1vZGVsLlxuXG4jIyMgKipTb2Z0d2FyZSBJbnRlZ3JhdGlvbioqXG5cbioqUnVudGltZToqKiBMbGFtYSAzLjIgTmVNbyBSZXRyaWV2ZXIgUmVyYW5raW5nIDFCIE5JTVxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eSoqOiBOVklESUEgQW1wZXJlLCBOVklESUEgSG9wcGVyLCBOVklESUEgTG92ZWxhY2VcbioqU3VwcG9ydGVkIE9wZXJhdGluZyBTeXN0ZW0ocyk6KiogTGludXhcblxuIyMjICoqTW9kZWwgVmVyc2lvbihzKSoqXG5cbkxsYW1hIDMuMiBOZU1vIFJldHJpZXZlciBSZXJhbmtpbmcgMUJcblNob3J0IE5hbWU6IGxsYW1hLTMuMi1udi1yZXJhbmtxYS0xYi12MlxuXG4jIyAqKlRyYWluaW5nIERhdGFzZXQgJiBFdmFsdWF0aW9uKipcblxuIyMjICoqVHJhaW5pbmcgRGF0YXNldCoqXG5cblRoZSBkZXZlbG9wbWVudCBvZiBsYXJnZS1zY2FsZSBwdWJsaWMgb3Blbi1RQSBkYXRhc2V0cyBoYXMgZW5hYmxlZCB0cmVtZW5kb3VzIHByb2dyZXNzIGluIHBvd2VyZnVsIGVtYmVkZGluZyBtb2RlbHMuIEhvd2V2ZXIsIG9uZSBwb3B1bGFyIGRhdGFzZXQgbmFtZWQgW01TTUFSQ09dKGh0dHBzOi8vbWljcm9zb2Z0LmdpdGh1Yi5pby9tc21hcmNvLykgcmVzdHJpY3RzIFx1MjAwY2NvbW1lcmNpYWwgbGljZW5zaW5nLCBsaW1pdGluZyB0aGUgdXNlIG9mIHRoZXNlIG1vZGVscyBpbiBjb21tZXJjaWFsIHNldHRpbmdzLiBUbyBhZGRyZXNzIHRoaXMsIE5WSURJQSBjcmVhdGVkIGl0cyBvd24gdHJhaW5pbmcgZGF0YXNldCBibGVuZCBiYXNlZCBvbiBwdWJsaWMgUUEgZGF0YXNldHMsIHdoaWNoIGVhY2ggaGF2ZSBhIGxpY2Vuc2UgZm9yIGNvbW1lcmNpYWwgYXBwbGljYXRpb25zLlxuXG4qKkRhdGEgQ29sbGVjdGlvbiBNZXRob2QgYnkgZGF0YXNldCoqOiBBdXRvbWF0ZWQsIFVua25vd25cblxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKiBBdXRvbWF0ZWQsIFVua25vd25cblxuKipQcm9wZXJ0aWVzOioqIFRoaXMgbW9kZWwgd2FzIHRyYWluZWQgb24gODAwayBzYW1wbGVzIGZyb20gcHVibGljIGRhdGFzZXRzLlxuXG4jIyMgKipFdmFsdWF0aW9uIFJlc3VsdHMqKlxuXG5XZSBldmFsdWF0ZSB0aGUgcGlwZWxpbmVzIG9uIGEgc2V0IG9mIGV2YWx1YXRpb24gYmVuY2htYXJrcy4gV2UgYXBwbGllZCB0aGUgcmFua2luZyBtb2RlbCB0byB0aGUgY2FuZGlkYXRlcyByZXRyaWV2ZWQgZnJvbSBhIHJldHJpZXZhbCBlbWJlZGRpbmcgbW9kZWwuXG5cbk92ZXJhbGwsIHRoZSBwaXBlbGluZSBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiArIGxsYW1hLTMuMi1udi1yZXJhbmtxYS0xYi12MiBwcm92aWRlcyBoaWdoIEJFSVIrVGVjaFFBIGFjY3VyYWN5IHdpdGggbXVsdGlsaW5ndWFsIGFuZCBjcm9zc2xpbmd1YWwgc3VwcG9ydC4gVGhlIGxsYW1hLTMuMi1udi1yZXJhbmtxYS0xQi12MiAgcmFua2luZyBtb2RlbCBpcyAzLjV4IHNtYWxsZXIgdGhhbiB0aGUgbnYtcmVyYW5rcWEtbWlzdHJhbC00Yi12MyBtb2RlbC5cblxuV2UgZXZhbHVhdGVkIHRoZSBOVklESUEgUmV0cmlldmFsIFFBIEVtYmVkZGluZyBNb2RlbCBpbiBjb21wYXJpc29uIHRvIGxpdGVyYXR1cmUgb3BlbiAmIGNvbW1lcmNpYWwgcmV0cmlldmVyIG1vZGVscyBvbiBhY2FkZW1pYyBiZW5jaG1hcmtzIGZvciBxdWVzdGlvbi1hbnN3ZXJpbmcgXFwtIFtOUV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9CZUlSL25xKSwgW0hvdHBvdFFBXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL2RhdGFzZXRzL2hvdHBvdF9xYSkgYW5kIFtGaVFBIChGaW5hbmNlIFFcXCZBKV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9CZUlSL2ZpcWEpIGZyb20gQmVJUiBiZW5jaG1hcmsgYW5kIFRlY2hRQSBkYXRhc2V0LiBJbiB0aGlzIGJlbmNobWFyaywgdGhlIG1ldHJpYyB1c2VkIHdhcyBSZWNhbGxANS4gQXMgZGVzY3JpYmVkLCB3ZSBuZWVkIHRvIGFwcGx5IHRoZSByYW5raW5nIG1vZGVsIG9uIHRoZSBvdXRwdXQgb2YgYW4gZW1iZWRkaW5nIG1vZGVsLlxuXG58IE9wZW4gJiBDb21tZXJjaWFsIFJlcmFua2VyIE1vZGVscyB8IEF2ZXJhZ2UgUmVjYWxsQDUgb24gTlEsIEhvdHBvdFFBLCBGaVFBLCBUZWNoUUEgZGF0YXNldCB8XG58IC0tLS0tIHwgLS0tLS0gfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiArIGxsYW1hLTMuMi1udi1yZXJhbmtxYS0xYi12MiB8IDczLjY0JSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyIHwgNjguNjAlIHxcbnwgbnYtZW1iZWRxYS1lNS12NSBcXCsgbnYtcmVyYW5rUUEtbWlzdHJhbC00Yi12MyB8IDc1LjQ1JSB8XG58IG52LWVtYmVkcWEtZTUtdjUgfCA2Mi4wNyUgfFxufCBudi1lbWJlZHFhLWU1LXY0IHwgNTcuNjUlIHxcbnwgZTUtbGFyZ2VcXF91bnN1cGVydmlzZWQgfCA0OC4wMyUgfFxufCBCTTI1IHwgNDQuNjclIHxcblxuV2UgZXZhbHVhdGVkIHRoZSBtb2RlbFx1MjAxOXMgbXVsdGlsaW5ndWFsIGNhcGFiaWxpdGllcyBvbiB0aGUgW01JUkFDTF0oaHR0cHM6Ly9naXRodWIuY29tL3Byb2plY3QtbWlyYWNsL21pcmFjbCkgYWNhZGVtaWMgYmVuY2htYXJrIFxcLSBhIG11bHRpbGluZ3VhbCByZXRyaWV2YWwgZGF0YXNldCwgYWNyb3NzIDE1IGxhbmd1YWdlcywgYW5kIG9uIGFuIGFkZGl0aW9uYWwgMTEgbGFuZ3VhZ2VzIHRoYXQgd2VyZSB0cmFuc2xhdGVkIGZyb20gdGhlIEVuZ2xpc2ggYW5kIFNwYW5pc2ggdmVyc2lvbnMgb2YgTUlSQUNMLiBUaGUgcmVwb3J0ZWQgc2NvcmVzIGFyZSBiYXNlZCBvbiBhIGN1c3RvbSBzdWJzYW1wbGVkIHZlcnNpb24gYnkgc2VsZWN0aW5nIGhhcmQgbmVnYXRpdmVzIGZvciBlYWNoIHF1ZXJ5IHRvIHJlZHVjZSB0aGUgY29ycHVzIHNpemUuXG5cbnwgT3BlbiAmIENvbW1lcmNpYWwgUmV0cmlldmFsIE1vZGVscyB8IEF2ZXJhZ2UgUmVjYWxsQDUgb24gTUlSQUNMIG11bHRpbGluZ3VhbCBkYXRhc2V0cyB8XG58IDotLS0tIHwgOi0tLS0gfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiArIGxsYW1hLTMuMi1udi1yZXJhbmtxYS0xYi12MiB8IDY1LjgwJSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyIHwgNjAuNzUlIHxcbnwgbnYtZW1iZWRxYS1taXN0cmFsLTdiLXYyIHwgNTAuNDIlIHxcbnwgQk0yNSB8IDI2LjUxJSB8XG5cbldlIGV2YWx1YXRlZCB0aGUgY3Jvc3MtbGluZ3VhbCBjYXBhYmlsaXRpZXMgb24gdGhlIGFjYWRlbWljIGJlbmNobWFyayBbTUxRQV0oaHR0cHM6Ly9naXRodWIuY29tL2ZhY2Vib29rcmVzZWFyY2gvTUxRQS8pIGJhc2VkIG9uIDcgbGFuZ3VhZ2VzIChBcmFiaWMsIENoaW5lc2UsIEVuZ2xpc2gsIEdlcm1hbiwgSGluZGksIFNwYW5pc2gsIFZpZXRuYW1lc2UpLiBXZSBjb25zaWRlciBvbmx5IGV2YWx1YXRpb24gZGF0YXNldHMgd2hlbiB0aGUgcXVlcnkgYW5kIGRvY3VtZW50cyBhcmUgaW4gZGlmZmVyZW50IGxhbmd1YWdlcy4gV2UgY2FsY3VsYXRlIHRoZSBhdmVyYWdlIFJlY2FsbEA1IGFjcm9zcyB0aGUgNDIgZGlmZmVyZW50IGxhbmd1YWdlIHBhaXJzLlxuXG58IE9wZW4gJiBDb21tZXJjaWFsIFJldHJpZXZhbCBNb2RlbHMgfCBBdmVyYWdlIFJlY2FsbEA1IG9uIE1MUUEgZGF0YXNldCB3aXRoIGRpZmZlcmVudCBsYW5ndWFnZXMgfFxufCA6LS0tLSB8IDotLS0tIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjIgKyBsbGFtYS0zLjItbnYtcmVyYW5rcWEtMWItdjIgfCA4Ni44MyUgfFxufCBsbGFtYS0zLjItbnYtZW1iZWRxYS0xYi12MiB8IDc5Ljg2JSB8XG58IG52LWVtYmVkcWEtbWlzdHJhbC03Yi12MiB8IDY4LjM4JSB8XG58IEJNMjUgfCAxMy4wMSUgfFxuXG5XZSBldmFsdWF0ZWQgdGhlIHN1cHBvcnQgb2YgbG9uZyBkb2N1bWVudHMgb24gdGhlIGFjYWRlbWljIGJlbmNobWFyayBbTXVsdGlsaW5ndWFsIExvbmctRG9jdW1lbnQgUmV0cmlldmFsIChNTERSKV0oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9kYXRhc2V0cy9TaGl0YW8vTUxEUikgYnVpbHQgb24gV2lraXBlZGlhIGFuZCBtQzQsIGNvdmVyaW5nIDEyIHR5cG9sb2dpY2FsbHkgZGl2ZXJzZSBsYW5ndWFnZXMgLiBUaGUgRW5nbGlzaCB2ZXJzaW9uIGhhcyBhIG1lZGlhbiBsZW5ndGggb2YgMjM5OSB0b2tlbnMgYW5kIDkwdGggcGVyY2VudGlsZSBvZiA3NDgzIHRva2VucyB1c2luZyB0aGUgbGxhbWEgMy4yIHRva2VuaXplci5cblxufCBPcGVuICYgQ29tbWVyY2lhbCBSZXRyaWV2YWwgTW9kZWxzIHwgQXZlcmFnZSBSZWNhbGxANSBvbiBNTERSIHxcbnwgOi0tLS0gfCA6LS0tLSB8XG58IGxsYW1hLTMuMi1udi1lbWJlZHFhLTFiLXYyICsgbGxhbWEtMy4yLW52LXJlcmFua3FhLTFiLXYyIHwgNzAuNjklIHxcbnwgbGxhbWEtMy4yLW52LWVtYmVkcWEtMWItdjIgfCA1OS41NSUgfFxufCBudi1lbWJlZHFhLW1pc3RyYWwtN2ItdjIgfCA0My4yNCUgfFxufCBCTTI1IHwgNzEuMzklIHxcblxuKipEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQqKjpcblVua25vd25cblxuKipMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldDoqKlxuVW5rbm93blxuXG4qKlByb3BlcnRpZXMqKlxuVGhlIGV2YWx1YXRpb24gZGF0YXNldHMgYXJlIGJhc2VkIG9uIHRocmVlIFtNVEVCL0JFSVJdKGh0dHBzOi8vZ2l0aHViLmNvbS9iZWlyLWNlbGxhci9iZWlyKSBUZXh0UUEgZGF0YXNldHMsIHRoZSBUZWNoUUEgZGF0YXNldCwgYW5kIE1JUkFDTCBtdWx0aWxpbmd1YWwgcmV0cmlldmFsIGRhdGFzZXRzLCB3aGljaCBhcmUgYWxsIHB1YmxpYyBkYXRhc2V0cy4gVGhlIHNpemVzIHJhbmdlIGJldHdlZW4gMTAsMDAwcyB1cCB0byA1TSBkZXBlbmRpbmcgb24gdGhlIGRhdGFzZXQuXG5cbioqSW5mZXJlbmNlKipcbioqRW5naW5lOioqIFRlbnNvclJUXG4qKlRlc3QgSGFyZHdhcmU6KiogIEgxMDAgUENJZS9TWE0sIEExMDAgUENJZS9TWE0sIEw0MHMsIEw0LCBhbmQgQTEwR1xuXG4jIyAqKkV0aGljYWwgQ29uc2lkZXJhdGlvbnMqKlxuXG5OVklESUEgYmVsaWV2ZXMgVHJ1c3R3b3J0aHkgQUkgaXMgYSBzaGFyZWQgcmVzcG9uc2liaWxpdHkgYW5kIHdlIGhhdmUgZXN0YWJsaXNoZWQgcG9saWNpZXMgYW5kIHByYWN0aWNlcyB0byBlbmFibGUgZGV2ZWxvcG1lbnQgZm9yIGEgd2lkZSBhcnJheSBvZiBBSSBhcHBsaWNhdGlvbnMuIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIHN1cHBvcnRpbmcgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLlxuXG5Gb3IgbW9yZSBkZXRhaWxlZCBpbmZvcm1hdGlvbiBvbiBldGhpY2FsIGNvbnNpZGVyYXRpb25zIGZvciB0aGlzIG1vZGVsLCBwbGVhc2Ugc2VlIHRoZSBNb2RlbCBDYXJkKysgdGFiIGZvciB0aGUgRXhwbGFpbmFiaWxpdHksIEJpYXMsIFNhZmV0eSAmIFNlY3VyaXR5LCBhbmQgUHJpdmFjeSBzdWJjYXJkcy5cblxuUGxlYXNlIHJlcG9ydCBzZWN1cml0eSB2dWxuZXJhYmlsaXRpZXMgb3IgTlZJRElBIEFJIENvbmNlcm5zIFtoZXJlXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL3N1cHBvcnQvc3VibWl0LXNlY3VyaXR5LXZ1bG5lcmFiaWxpdHkvKS5cblxuIyMgR2V0IEhlbHBcblxuIyMjIEVudGVycHJpc2UgU3VwcG9ydFxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciAgc3VibWl0IGEgdGlja2V0IGF0IHRoZSBbTlZJRElBIEFJIEVudGVycHJpc2UgU3VwcG9ydCBTZXJ2aWNlcyBwYWdlLl0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS5cblxuIyMjIE5WSURJQSBOSU0gRG9jdW1lbnRhdGlvblxuVmlzaXQgdGhlIFtOZU1vIFJldHJpZXZlciBkb2NzIHBhZ2VdKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25lbW8vcmV0cmlldmVyL2luZGV4Lmh0bWwpIGZvciByZWxlYXNlIGRvY3VtZW50YXRpb24sIGRlcGxveW1lbnQgZ3VpZGVzIGFuZCBtb3JlLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiTGxhbWEgMy4yIE5lTW8gUmV0cmlldmVyIFJlcmFua2luZyAxQiIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IEludGVuZGVkIEFwcGxpY2F0aW9uICYgRG9tYWluOiB8IFBhc3NhZ2UgcmFua2luZyBmb3IgcXVlc3Rpb24gYW5kIGFuc3dlciByZXRyaWV2YWwuIHxcbnwgTW9kZWwgVHlwZTogfCBUcmFuc2Zvcm1lciBlbmNvZGVyIHxcbnwgSW50ZW5kZWQgVXNlcjogfCBHZW5lcmF0aXZlIEFJIGNyZWF0b3JzIHdvcmtpbmcgd2l0aCBjb252ZXJzYXRpb25hbCBBSSBtb2RlbHMgLSBtb3N0IHN1aXRhYmxlIGZvciB1c2VycyB3aG8gd2FudCB0byBpbXByb3ZlIHRoZWlyIG11bHRpbGluZ3VhbCByZXRyaWV2YWwgdGFza3MgYnkgcmVyYW5raW5nIGEgc2V0IG9mIGNhbmRpZGF0ZXMgZm9yIGEgZ2l2ZW4gcXVlc3Rpb24uIHxcbnwgT3V0cHV0OiB8IExpc3Qgb2YgRmxvYXRzIChTY29yZS9Mb2dpdCBpbmRpY2F0aW5nIGlmIGEgcGFzc2FnZSByZWxldmFudCB0byBhIHF1ZXN0aW9uKSB8XG58IERlc2NyaWJlIGhvdyB0aGUgbW9kZWwgd29ya3M6IHwgTW9kZWwgcHJvdmlkZXMgYSBzY29yZSBhYm91dCB0aGUgbGlrZWxpaG9vZCB0aGUgcGFzc2FnZSBjb250YWlucyB0aGUgaW5mb3JtYXRpb24gdG8gYW5zd2VyIHRoZSBxdWVzdGlvbi4gfFxufCBWZXJpZmllZCB0byBoYXZlIG1ldCBwcmVzY3JpYmVkIHF1YWxpdHkgc3RhbmRhcmRzOiB8IFllcyB8XG58IFBlcmZvcm1hbmNlIE1ldHJpY3M6IHwgQWNjdXJhY3ksIFRocm91Z2hwdXQsIGFuZCBMYXRlbmN5IHxcbnwgUG90ZW50aWFsIEtub3duIFJpc2tzOiB8IFRoaXMgbW9kZWwgZG9lcyBub3QgYWx3YXlzIGd1YXJhbnRlZSB0byBwcm92aWRlIGEgbWVhbmluZ2Z1bCByYW5raW5nIG9mIHBhc3NhZ2UocykgZm9yIGEgZ2l2ZW4gcXVlc3Rpb24uIHxcbnwgTGljZW5zaW5nOiB8IFRoZSB1c2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKSAgYW5kIExsYW1hIDMuMiBpcyBsaWNlbnNlZCB1bmRlciB0aGUgW0xsYW1hIDMuMiBDb21tdW5pdHkgTGljZW5zZV0oaHR0cHM6Ly93d3cubGxhbWEuY29tL2xsYW1hM18yL2xpY2Vuc2UvKSwgQ29weXJpZ2h0IFx1MDBhOSBNZXRhIFBsYXRmb3JtcywgSW5jLiBBbGwgUmlnaHRzIFJlc2VydmVkLiB8XG58IFRlY2huaWNhbCBMaW1pdGF0aW9ucyB8IFRoZSBtb2RlbFx1MjAxOXMgbWF4IHNlcXVlbmNlIGxlbmd0aCBpcyA4MTkyLiBUaGVyZWZvcmUsIHRoZSBsb25nZXIgdGV4dCBpbnB1dHMgc2hvdWxkIGJlIHRydW5jYXRlZC4gfCIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtMzFVSi1TOFg0IiwKICAgICAgICAiTlNQRUNULVZaWTItV000VSIsCiAgICAgICAgIk5WSURJQSBBSSBFbnRlcnByaXNlIFN1cHBvcnRlZCIsCiAgICAgICAgIk5WSURJQSBOSU0iLAogICAgICAgICJsbGFtYS0zLTItbnYtcmVyYW5rcWEtMWItdjIiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJiMjAweDEtdHJ0LWZwOC15aWtqcXF5cnF3IiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxNjYyMDMzMTQ4LAogICAgImxvZ28iOiAiaHR0cHM6Ly9kZXZlbG9wZXItYmxvZ3MubnZpZGlhLmNvbS93cC1jb250ZW50L3VwbG9hZHMvMjAyNC8wMy9uZW1vLXJldHJpZXZlci1ncmFwaGljLnBuZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiTi9BIiwKICAgICJuYW1lIjogImxsYW1hLTMuMi1udi1yZXJhbmtxYS0xYi12MiIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJOL0EiLAogICAgInByaXZhY3kiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IEdlbmVyYXRhYmxlIG9yIHJldmVyc2UgZW5naW5lZXJhYmxlIHBlcnNvbmFsbHktaWRlbnRpZmlhYmxlIGluZm9ybWF0aW9uIChQSUkpPyB8IE5vbmUgfFxufCBXYXMgY29uc2VudCBvYnRhaW5lZCBmb3IgYW55IHBlcnNvbmFsIGRhdGEgdXNlZD8gfCBOb3QgQXBwbGljYWJsZSB8XG58IFBlcnNvbmFsIGRhdGEgdXNlZCB0byBjcmVhdGUgdGhpcyBtb2RlbD8gfCBOb25lIHxcbnwgSG93IG9mdGVuIGlzIHRoZSBkYXRhc2V0IHJldmlld2VkPyB8IEJlZm9yZSBFdmVyeSBSZWxlYXNlIHxcbnwgSXMgYSBtZWNoYW5pc20gaW4gcGxhY2UgdG8gaG9ub3IgZGF0YSBzdWJqZWN0IHJpZ2h0IG9mIGFjY2VzcyBvciBkZWxldGlvbiBvZiBwZXJzb25hbCBkYXRhPyB8IE4vQSB8XG58IElmIHBlcnNvbmFsIGRhdGEgd2FzIGNvbGxlY3RlZCBmb3IgdGhlIGRldmVsb3BtZW50IG9mIHRoZSBtb2RlbCwgd2FzIGl0IGNvbGxlY3RlZCBkaXJlY3RseSBieSBOVklESUE/IHwgTm90IEFwcGxpY2FibGUgfFxufCBJZiBwZXJzb25hbCBkYXRhIHdhcyBjb2xsZWN0ZWQgZm9yIHRoZSBkZXZlbG9wbWVudCBvZiB0aGUgbW9kZWwgYnkgTlZJRElBLCBkbyB5b3UgbWFpbnRhaW4gb3IgaGF2ZSBhY2Nlc3MgdG8gZGlzY2xvc3VyZXMgbWFkZSB0byBkYXRhIHN1YmplY3RzPyB8IE5vdCBBcHBsaWNhYmxlIHxcbnwgSWYgcGVyc29uYWwgZGF0YSBjb2xsZWN0ZWQgZm9yIHRoZSBkZXZlbG9wbWVudCBvZiB0aGlzIEFJIG1vZGVsLCB3YXMgaXQgbWluaW1pemVkIHRvIG9ubHkgd2hhdCB3YXMgcmVxdWlyZWQ/IHwgTm90IEFwcGxpY2FibGUgfFxufCBJcyB0aGVyZSBwcm92ZW5hbmNlIGZvciBhbGwgZGF0YXNldHMgdXNlZCBpbiB0cmFpbmluZz8gfCBZZXMgfFxufCBEb2VzIGRhdGEgbGFiZWxpbmcgKGFubm90YXRpb24sIG1ldGFkYXRhKSBjb21wbHkgd2l0aCBwcml2YWN5IGxhd3M/IHwgWWVzIHxcbnwgSXMgZGF0YSBjb21wbGlhbnQgd2l0aCBkYXRhIHN1YmplY3QgcmVxdWVzdHMgZm9yIGRhdGEgY29ycmVjdGlvbiBvciByZW1vdmFsLCBpZiBzdWNoIGEgcmVxdWVzdCB3YXMgbWFkZT8gfCBObywgbm90IHBvc3NpYmxlIHdpdGggZXh0ZXJuYWxseS1zb3VyY2VkIGRhdGEuIHwiLAogICAgInByb2R1Y3ROYW1lcyI6IFsKICAgICAgICAibmltLWRldiIsCiAgICAgICAgIm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgInB1YmxpY0RhdGFzZXRVc2VkIjoge30sCiAgICAicHVibGlzaGVyIjogIk5WSURJQSIsCiAgICAic2FmZXR5QW5kU2VjdXJpdHkiOiAifCBGaWVsZCB8IFJlc3BvbnNlIHxcbnwgLS0tLS0gfCAtLS0tLSB8XG58IE1vZGVsIEFwcGxpY2F0aW9uKHMpOiB8IFRleHQgUmVyYW5raW5nIGZvciBSZXRyaWV2YWwgfFxufCBEZXNjcmliZSB0aGUgcGh5c2ljYWwgc2FmZXR5IGltcGFjdCAoaWYgcHJlc2VudCkuIHwgTm90IEFwcGxpY2FibGUgfFxufCBVc2UgQ2FzZSBSZXN0cmljdGlvbnM6IHwgQWJpZGUgYnkgW05WSURJQSBBSSBGb3VuZGF0aW9uIE1vZGVscyBDb21tdW5pdHkgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS4gICB8XG58IE1vZGVsIGFuZCBkYXRhc2V0IHJlc3RyaWN0aW9uczogfCBUaGUgUHJpbmNpcGxlIG9mIGxlYXN0IHByaXZpbGVnZSAoUG9MUCkgaXMgYXBwbGllZCBsaW1pdGluZyBhY2Nlc3MgZm9yIGRhdGFzZXQgZ2VuZXJhdGlvbiBhbmQgbW9kZWwgZGV2ZWxvcG1lbnQuIFJlc3RyaWN0aW9ucyBlbmZvcmNlIGRhdGFzZXQgYWNjZXNzIGR1cmluZyB0cmFpbmluZywgYW5kIGRhdGFzZXQgbGljZW5zZSBjb25zdHJhaW50cyBhZGhlcmVkIHRvLiB8IiwKICAgICJzaG9ydERlc2NyaXB0aW9uIjogIkdQVS1hY2NlbGVyYXRlZCBtb2RlbCBvcHRpbWl6ZWQgZm9yIHByb3ZpZGluZyBhIHByb2JhYmlsaXR5IHNjb3JlIHRoYXQgYSBnaXZlbiBwYXNzYWdlIGNvbnRhaW5zIHRoZSBpbmZvcm1hdGlvbiB0byBhbnN3ZXIgYSBxdWVzdGlvbi4iLAogICAgInRlYW1OYW1lIjogIm52aWRpYSIsCiAgICAidXBkYXRlZERhdGUiOiAiMjAyNS0wOS0wM1QyMTozMDozNS4yODFaIgp9 source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/nvidia/containers/llama-3.2-nv-rerankqa-1b-v2 optimizationProfiles: - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:h100x1-trt-fp16--ckqlv3j2g framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA H100 NVLx1 FP16 ngcMetadata: 3b1e767e41d02ed0ffa5aa6b46a2edfdd1540edaec2eeda4c00278c838bba38b: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2321:10de gpu: NVIDIA H100 NVL gpu_key: h100-nvl model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100-NVL - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 5GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:a100x1-trt-fp16-dxtbz8wstg framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA A100-SXM4-40GBx1 FP16 ngcMetadata: 477500a740ea33ea1419289866bbfd598ce51a806fe034b48dc176db32155f59: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 20b0:10de gpu: NVIDIA A100-SXM4-40GB gpu_key: a100-sxm4-40gb model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100-SXM4-40GB - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:l40sx1-trt-fp16-20qsn53gag framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA L40Sx1 FP16 ngcMetadata: 49d14b4eaebc6b1f61e48afb3d88535f4ad3758ea55036f5ab3815d1c5a927fc: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 26b9:10de gpu: NVIDIA L40S gpu_key: l40s model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:a100x1-trt-fp16-dxtbz8wstg__2 framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA A100-SXM4-80GBx1 FP16 ngcMetadata: 4ea4624dcc114adeeb29272322897800cddf5dfa873dac467f67d827b7dd9c4d: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 20b2:10de gpu: NVIDIA A100-SXM4-80GB gpu_key: a100-sxm4-80gb model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A100-SXM4-80GB - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:l40sx1-trt-fp8-4nwnajwq4g framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA L40Sx1 FP8 ngcMetadata: 5036ebf412fba4e54511ab4b3822ec7dfb9fd2c256c3100ad2ed9d2b4bda9f79: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 26b9:10de gpu: NVIDIA L40S gpu_key: l40s model_type: tensorrt precision: fp8 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP8 - key: GPU value: L40S - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 2GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:a10gx1-trt-fp16-fxo3knzn8w framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA A10Gx1 FP16 ngcMetadata: 6f21ae4169cfe3c03cc92eb194713f5a3044ac2f61526edf632d0f9a5155b538: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2237:10de gpu: NVIDIA A10G gpu_key: a10g model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: A10G - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:b200x1-trt-fp16-jiw0-uharg framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA B200x1 FP16 ngcMetadata: 75b659320dada86548fb6af5d3adfe386df6c515969d71db4e76cd64375777e1: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2901:10de gpu: NVIDIA B200 gpu_key: b200 model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 4GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:h100x1-trt-fp8-bm87q6egvq framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA H100 80GB HBM3x1 FP8 ngcMetadata: 774e4d699d318f41630b51b4280cadecb184b9b2755b707aa74232f1ea642b2c: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2330:10de gpu: NVIDIA H100 80GB HBM3 gpu_key: h100-hbm3-80gb model_type: tensorrt precision: fp8 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP8 - key: GPU value: H100-HBM3-80GB - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 2GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:l4x1-trt-fp16-bajefiwkra framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA L4x1 FP16 ngcMetadata: 9278eac727396c9f6ab9b3d421748889b0686afd20a9cef12d1d16c39fcd6a9d: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 27b8:10de gpu: NVIDIA L4 gpu_key: l4 model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: L4 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:l4x1-trt-fp8-vk0qdpls2w framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA L4x1 FP8 ngcMetadata: a344745c8dbe62413a4e95b4e5718a689c155dfb8743868fb5d13956a621b31e: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 27b8:10de gpu: NVIDIA L4 gpu_key: l4 model_type: tensorrt precision: fp8 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP8 - key: GPU value: L4 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 2GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:h100x1-trt-fp8-bm87q6egvq__2 framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA H100 NVLx1 FP8 ngcMetadata: b469c56c1a9ac1001151765527d3c7de77f590255b08eea4aa064ee1abf0ef3f: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2321:10de gpu: NVIDIA H100 NVL gpu_key: h100-nvl model_type: tensorrt precision: fp8 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP8 - key: GPU value: H100-NVL - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 2GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:h100x1-trt-fp16--ckqlv3j2g__2 framework: TensorRT-LLM displayName: Llama 3.2 NV Rerankqa 1B V2 NVIDIA H100 80GB HBM3x1 FP16 ngcMetadata: ddd9c5d1430631c0bd75c04b0c18e9b620219ad82c808a30d019be9cbcd618bd: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: tensorrt device_id: 2330:10de gpu: NVIDIA H100 80GB HBM3 gpu_key: h100-hbm3-80gb model_type: tensorrt precision: fp16 tp: '1' modelFormat: trt-llm spec: - key: PRECISION value: FP16 - key: GPU value: H100-HBM3-80GB - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 5GB - key: BACKEND value: TENSORRT - key: MODEL TYPE value: TENSORRT - profileId: nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:onnx-precision.fp16-d03bf375 framework: ONNX displayName: Llama 3.2 NV Rerankqa 1B V2 ONNX FP16 ngcMetadata: f7391ddbcb95b2406853526b8e489fedf20083a2420563ca3e65358ff417b10f: model: nvidia/llama-3.2-nv-rerankqa-1b-v2 release: 1.8.0 tags: backend: onnx model_type: onnx precision: fp16 tp: '1' modelFormat: onnx spec: - key: PRECISION value: FP16 - key: COUNT value: 1 - key: NIM VERSION value: 1.8.0 - key: DOWNLOAD SIZE value: 3GB - key: BACKEND value: ONNX - key: MODEL TYPE value: ONNX labels: - Llama - Meta - Chat - NIM - Large Language Model - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Riva ASR Whisper Large v3 displayName: Riva ASR Whisper Large v3 modelHubID: riva-asr-whisper-large-v3 category: Speech type: NGC description: Automatic speech recognition and speech translation model trained on 680K hours of labeled audio. Generalizes well across diverse datasets and domains without fine-tuning. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Riva ASR Whisper Large v3 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJidWlsdEJ5IjogIk9wZW5BSSIsCiAgICAiY2FuR3Vlc3REb3dubG9hZCI6IGZhbHNlLAogICAgImNyZWF0ZWREYXRlIjogIjIwMjQtMTAtMjhUMTY6NDU6MjAuOTkwWiIsCiAgICAiZGVzY3JpcHRpb24iOiAiT3ZlcnZpZXdcbj09PT09PT09PT1cblxuTW9yZSBkZXRhaWxzXG49PT09PT09PT09PT09XG5cbkRvY3VtZW50YXRpb25cbj09PT09PT09PT09PT09PSIsCiAgICAiZGlzcGxheU5hbWUiOiAiV2hpc3Blci1MYXJnZS12MyIsCiAgICAiZXhwbGFpbmFiaWxpdHkiOiAiIiwKICAgICJmcmFtZXdvcmsiOiAiT3RoZXIiLAogICAgImhhc1BsYXlncm91bmQiOiBmYWxzZSwKICAgICJoYXNTaWduZWRWZXJzaW9uIjogdHJ1ZSwKICAgICJpc1BsYXlncm91bmRFbmFibGVkIjogZmFsc2UsCiAgICAiaXNQdWJsaWMiOiBmYWxzZSwKICAgICJpc1JlYWRPbmx5IjogdHJ1ZSwKICAgICJsYWJlbHMiOiBbCiAgICAgICAgIk5JTSIsCiAgICAgICAgIk5TUEVDVC1GNVBWLVNHQU8iLAogICAgICAgICJXaGlzcGVyLUxhcmdlLXYzIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiaDEwMHgxLW9mbC0yNS4wOC1mcDE2LW1uejRwbm4wcHciLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDE1MzI4NjU4OTIsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvcmFkdHRzLWhpZmlnYW4tcml2YS5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIlJNSVIiLAogICAgIm5hbWUiOiAid2hpc3Blci1sYXJnZS12MyIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJBTVAiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJOVklESUEiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJXaGlzcGVyIGxhcmdlIHYzIHRyYWluZWQgYnkgT3BlbkFJIiwKICAgICJ0ZWFtTmFtZSI6ICJudmlkaWEiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDktMDZUMDQ6MTU6MzYuNzIzWiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/riva/models/whisper_large optimizationProfiles: - profileId: nim/nvidia/whisper-large-v3:ofl-rmir-25.06 framework: TensorRT-LLM displayName: Riva ASR Whisper Large v3 Generic NVIDIA GPUx1 ngcMetadata: 5e44fa6d8cd80ad46a089089157ff4565974f0a64fd37c594265c61f00418ae0: model: nvidia/riva-asr/whisper release: 1.3.1 tags: mode: ofl model_type: rmir name: whisper-large-v3 tp: '1' modelFormat: trt-llm spec: - key: COUNT value: 1 - key: NIM VERSION value: 1.3.1 - key: DOWNLOAD SIZE value: 3GB - key: MODEL TYPE value: RMIR - key: MODE value: OFL - profileId: nim/nvidia/whisper-large-v3:h100x1-ofl-25.08-fp16-mnz4pnn0pw framework: TensorRT-LLM displayName: Riva ASR Whisper Large v3 H100 FP16 ngcMetadata: 72232937075119887298deb92b5e58f4d98a0ce0948df60d424f0d97b05da55e: model: nvidia/riva-asr/whisper release: 1.3.1 tags: gpu_device: '2330' mode: ofl model_type: prebuilt name: whisper-large-v3 gpu: H100 tp: '1' modelFormat: trt-llm spec: - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330 - key: NIM VERSION value: 1.3.1 - key: DOWNLOAD SIZE value: 2GB - key: MODEL TYPE value: PREBUILT - key: MODE value: OFL labels: - Transformer - TensorRT-LLM - Audio - NVIDIA Validated config: architectures: - Other modelType: llama license: NVIDIA AI Foundation Models Community License - name: Boltz2 displayName: Boltz2 modelHubID: boltz2 category: Science type: NGC description: Structural biology foundation model for protein structure prediction and binding affinity estimation. Approaches the accuracy of gold-standard computational methods at a fraction of the cost. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: Boltz2 modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wNi0wNVQxNjowOTozOS4wNTZaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIyBNb2RlbCBPdmVydmlld1xuXG4jIyMgRGVzY3JpcHRpb246XG5cbkJvbHR6LTIgTklNIGlzIGEgbmV4dC1nZW5lcmF0aW9uIHN0cnVjdHVyYWwgYmlvbG9neSBmb3VuZGF0aW9uIG1vZGVsIHRoYXQgc2hvd3Mgc3Ryb25nIHBlcmZvcm1hbmNlIGZvciBib3RoIHN0cnVjdHVyZSBhbmQgYWZmaW5pdHkgcHJlZGljdGlvbi4gQm9sdHotMiBpcyB0aGUgZmlyc3QgZGVlcCBsZWFybmluZyBtb2RlbCB0byBhcHByb2FjaCB0aGUgYWNjdXJhY3kgb2YgZnJlZSBlbmVyZ3kgcGVydHVyYmF0aW9uIChGRVApIG1ldGhvZHMgaW4gcHJlZGljdGluZyBiaW5kaW5nIGFmZmluaXRpZXMgb2Ygc21hbGwgbW9sZWN1bGVzIGFuZCBwcm90ZWluc1x1MjAxNGFjaGlldmluZyBzdHJvbmcgY29ycmVsYXRpb25zIG9uIGJlbmNobWFya3Mgd2hpbGUgYmVpbmcgbmVhcmx5IDEwMDBcdTAwZDcgbW9yZSBjb21wdXRhdGlvbmFsbHkgZWZmaWNpZW50LiBOb3RlIHRoYXQgYmluZGluZyBhZmZpbml0eSBpcyBub3QgeWV0IGF2YWlsYWJsZSBpbiB0aGUgTklNLCBidXQgd2lsbCBiZSBhdmFpbGFibGUgdmVyeSBzb29uIVxuPGJyPlxuS2V5IEZlYXR1cmVzOiA8YnI+XG4gKipUcnVuayBvcHRpbWl6YXRpb25zOioqIE1peGVkLXByZWNpc2lvbiAoYmZsb2F0MTYpIGFuZCB0cmlmYXN0IHRyaWFuZ2xlIGF0dGVudGlvbiBjdXQgcnVudGltZS9tZW1vcnk7IGVuYWJsZXMgdHJhaW5pbmcgd2l0aCA3NjgtdG9rZW4gY3JvcHMgKGFzIGluIEFscGhhRm9sZDMpLiA8YnI+XG4qKlBoeXNpY2FsIHF1YWxpdHk6KiogSW50ZWdyYXRlcyBCb2x0ei1zdGVlcmluZyBhdCBpbmZlcmVuY2UgKEJvbHR6LTJ4KSB0byByZWR1Y2Ugc3RlcmljIGNsYXNoZXMgYW5kIHN0ZXJlb2NoZW1pc3RyeSBlcnJvcnMgd2l0aG91dCBsb3NpbmcgYWNjdXJhY3kuIDxicj5cbioqQ29udHJvbGxhYmlsaXR5OioqIDxicj5cbiogKipNZXRob2QgY29uZGl0aW9uaW5nOioqIFN0ZWVycyBwcmVkaWN0aW9ucyB0byByZXNlbWJsZSBYLXJheSwgTk1SLCBvciBNRC1zdHlsZSBzdHJ1Y3R1cmVzLiA8YnI+XG4qICoqVGVtcGxhdGUgY29uZGl0aW9uaW5nICsgc3RlZXJpbmc6KiogVXNlcyBzaW5nbGUgb3IgbXVsdGltZXJpYyB0ZW1wbGF0ZXM7IHN1cHBvcnRzIHN0cmljdCB0ZW1wbGF0ZSBlbmZvcmNlbWVudCBvciBzb2Z0IGd1aWRhbmNlLiA8YnI+XG4qICoqQ29udGFjdC9wb2NrZXQgY29uZGl0aW9uaW5nOioqIEFjY2VwdHMgZGlzdGFuY2UgY29uc3RyYWludHMgZnJvbSBleHBlcmltZW50cyBvciBleHBlcnQgcHJpb3JzLiA8YnI+XG5cbioqQWZmaW5pdHkgbW9kdWxlOioqIFBhaXJGb3JtZXIgcmVmaW5lcyBwcm90ZWluXHUyMDEzbGlnYW5kIGFuZCBpbnRyYS1saWdhbmQgaW50ZXJhY3Rpb25zOyBwcmVkaWN0cyBib3RoIGJpbmRpbmcgbGlrZWxpaG9vZCBhbmQgYSBjb250aW51b3VzIGFmZmluaXR5IG9uIGxvZyBcdTAwYjVNIHNjYWxlICh0cmFpbmVkIG9uIG1peGVkIEtpLCBLZCwgSUM1MCkuIE91dHB1dCBpcyBhbiBJQzUwLWxpa2UgbWVhc3VyZSBzdWl0YWJsZSBmb3IgcmFua2luZy4gPGJyPlxuKipLZXkgYWR2YW5jZXMgdnMgQm9sdHotMS8xeDoqKiBGYXN0ZXIvbW9yZSBtZW1vcnktZWZmaWNpZW50IHRydW5rLCBpbXByb3ZlZCBwaHlzaWNhbCBwbGF1c2liaWxpdHkgdmlhIGludGVncmF0ZWQgc3RlZXJpbmcsIG1hcmtlZGx5IGVuaGFuY2VkIGNvbnRyb2xsYWJpbGl0eSwgYW5kIGFkZGVkIGFmZmluaXR5IHByZWRpY3Rpb24gaGVhZC4gPGJyPlxuXG5cblRoaXMgTklNIGlzIHJlYWR5IGZvciBjb21tZXJjaWFsIHVzZS5cbjxicj5cblxuIyMjIFRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uXG5cblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlLlxuXG4jIyMjIExpY2Vuc2UgLyBUZXJtcyBvZiBVc2VcblxuR09WRVJOSU5HIFRFUk1TOiBUaGlzIHRyaWFsIHNlcnZpY2UgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQVBJIFRyaWFsIFRlcm1zIG9mIFNlcnZpY2VdKGh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2xlZ2FsL05WSURJQSUyMEFQSSUyMFRyaWFsJTIwVGVybXMlMjBvZiUyMFNlcnZpY2UucGRmKS4gVXNlIG9mIHRoaXMgbW9kZWwgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgQ29tbXVuaXR5IE1vZGVsIExpY2Vuc2VdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS4gQWRkaXRpb25hbCBJbmZvcm1hdGlvbjogW01JVF0oaHR0cHM6Ly9naXRodWIuY29tL2p3b2hsd2VuZC9ib2x0ej90YWI9TUlULTEtb3YtZmlsZSNyZWFkbWUpLlxuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgQUkgRm91bmRhdGlvbiBNb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLioqXG5cbiMjIyBEZXBsb3ltZW50IEdlb2dyYXBoeVxuR2xvYmFsXG5cbiMjIyBVc2UgQ2FzZVxuQm9sdHotMiBOSU0gZW5hYmxlcyByZXNlYXJjaGVycyBhbmQgY29tbWVyY2lhbCBlbnRpdGllcyBpbiB0aGUgRHJ1ZyBEaXNjb3ZlcnksIExpZmUgU2NpZW5jZXMsIGFuZCBEaWdpdGFsIEJpb2xvZ3kgZmllbGRzIHRvIHByZWRpY3QgdGhlIHRocmVlLWRpbWVuc2lvbmFsIHN0cnVjdHVyZSBvZiBiaW9tb2xlY3VsYXIgY29tcGxleGVzIGFuZCBwcmVkaWN0IHNtYWxsLW1vbGVjdWxlIGJpbmRpbmcgYWZmaW5pdGllcy4gVHJhaW5lZCBvbiBtaWxsaW9ucyBvZiBjdXJhdGVkIGV4cGVyaW1lbnRhbCBkYXRhcG9pbnRzIHdpdGggYSBub3ZlbCB0cmFpbmluZyBzdHJhdGVneSB0YWlsb3JlZCBmb3Igbm9pc3kgYmlvY2hlbWljYWwgYXNzYXkgZGF0YSwgQm9sdHotMiBkZW1vbnN0cmF0ZXMgcm9idXN0IHBlcmZvcm1hbmNlIGFjcm9zcyBoaXQtZGlzY292ZXJ5LCBoaXQtdG8tbGVhZCwgYW5kIGxlYWQgb3B0aW1pemF0aW9uLlxuXG4jIyMgUmVsZWFzZSBEYXRlXG5idWlsZC5udmlkaWEuY29tIFNlcHRlbWJlciAzMCwgMjAyNSB2aWEgW2J1aWxkLm52aWRpYS5jb21dKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9taXQvYm9sdHoyKVxuXG5OR0MgU2VwdGVtYmVyIDMwLCAyMDI1XG5cbiMjIyBSZWZlcmVuY2VzOlxuXG5gYGBcbkBhcnRpY2xle3dvaGx3ZW5kMjAyNGJvbHR6LFxuICAgIHRpdGxlID0ge0JvbHR6LTE6IERlbW9jcmF0aXppbmcgQmlvbW9sZWN1bGFyIEludGVyYWN0aW9uIE1vZGVsaW5nfSxcbiAgICBhdXRob3IgPSB7V29obHdlbmQsIEplcmVteSBhbmQgQ29yc28sIEdhYnJpZWxlIGFuZCBQYXNzYXJvLCBTYXJvIGFuZCBHZXR6LCBOb2FoIGFuZCBSZXZlaXosIE1hdGVvIGFuZCBMZWlkYWwsIEtlbiBhbmQgU3dpZGVyc2tpLCBXb2p0ZWsgYW5kIEF0a2luc29uLCBMaWFtIGFuZCBQb3J0bm9pLCBUYWxseSBhbmQgQ2hpbm4sIEl0YW1hciBhbmQgU2lsdGVycmEsIEphY29iIGFuZCBKYWFra29sYSwgVG9tbWkgYW5kIEJhcnppbGF5LCBSZWdpbmF9LFxuICAgIGpvdXJuYWwgPSB7YmlvUnhpdn0sXG4gICAgeWVhciA9IHsyMDI0fSxcbiAgICBkb2kgPSB7MTAuMTEwMS8yMDI0LjExLjE5LjYyNDE2N30sXG4gICAgbGFuZ3VhZ2UgPSBcImVuXCJcbn1cbmBgYFxuXG48YnI+XG5cbiMjIyBNb2RlbCBBcmNoaXRlY3R1cmU6XG5cbioqQXJjaGl0ZWN0dXJlIFR5cGU6KiogRm91ciBjb21wb25lbnRzIFx1MjAxNCB0cnVuaywgZGVub2lzaW5nIG1vZHVsZSAod2l0aCBzdGVlcmluZyksIGNvbmZpZGVuY2UgbW9kdWxlLCBhbmQgYSBuZXcgYWZmaW5pdHkgbW9kdWxlIDxicj5cbioqTmV0d29yayBBcmNoaXRlY3R1cmU6KiogUGFpckZvcm1lciA8YnI+XG5cbioqSW5wdXQgVHlwZShzKToqKiBCaW9tb2xlY3VsYXIgc2VxdWVuY2VzIChwcm90ZWluLCBETkEsIFJOQSksIGxpZ2FuZCBTTUlMRVMgb3IgQ0NEIHN0cmluZ3MsIG1vbGVjdWxhciBtb2RpZmljYXRpb25zLCBzdHJ1Y3R1cmFsIGNvbnN0cmFpbnRzLCBjb25kaXRpb25pbmcgcGFyYW1ldGVycywgb3B0aW9uYWwgYm9vbGVhbnMgPGJyPlxuKipJbnB1dCBGb3JtYXQocyk6KiogRGljdGlvbmFyeSBjb250YWluaW5nIHNlcXVlbmNlIHN0cmluZ3MsIG1vZGlmaWNhdGlvbiByZWNvcmRzLCBhbmQgY29uc3RyYWludCBwYXJhbWV0ZXJzIDxicj5cbioqSW5wdXQgUGFyYW1ldGVyczoqKiBTZXF1ZW5jZXMgKHN0cmluZ3MpLCBwcmVkaWN0X2FmZmluaXR5KGJvb2xlYW4pLCBtb2RpZmljYXRpb25zIChsaXN0IG9mIHJlc2lkdWUtc3BlY2lmaWMgY2hhbmdlcyksIGNvbnN0cmFpbnRzIChkaWN0aW9uYXJ5IG9mIHN0cnVjdHVyYWwgcGFyYW1ldGVycykgPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQ6KiogTWF4aW11bSBzZXF1ZW5jZSBsZW5ndGggb2YgNDA5NiByZXNpZHVlcyBwZXIgY2hhaW4uIE1heGltdW0gb2YgMTIgaW5wdXQgcG9seW1lcnMuIE1heGltdW0gb2YgMjAgaW5wdXQgbGlnYW5kcy4gUGFzc2luZyBib29sZWFuIG9wdGlvbnMgc3VjaCBhcyBwcmVkaWN0X2FmZmluaXR5IHdpbGwgaW5jcmVhc2UgdGhlIHJ1bnRpbWUgb2YgdGhlIHJlcXVlc3QuIDxicj5cbioqTW9kZWwgUGFyYW1ldGVyczoqKlxuVGFibGVzIDEgYW5kIDIgcmVjb3JkIHNvbWUgb2YgdGhlIGh5cGVycGFyYW1ldGVycyBvZiBCb2x0ei0yXHUyMDE5cyBhcmNoaXRlY3R1cmUsIHRyYWluaW5nIGFuZCBpbmZlcmVuY2UgcHJvY2VkdXJlcyB0aGF0IGRpZmZlciBmcm9tIEJvbHR6LTFcdTIwMTlzIGFuZCB3ZXJlIG5vdCBwcmV2aW91c2x5IG1lbnRpb25lZCBpbiB0aGUgbWFudXNjcmlwdC4gIFxuXG48dGFibGU+XG48dHI+XG48dGQ+XG5cbjxiPlRhYmxlIDE6PC9iPiBFeHRyYSBtb2RlbCBhcmNoaXRlY3R1cmUgYW5kIHRyYWluaW5nIGh5cGVycGFyYW1ldGVycyAgXG50aGF0IGRpZmZlciBmcm9tIEJvbHR6LTEgYW5kIHdlcmUgbm90IHByZXZpb3VzbHkgbWVudGlvbmVkIGluIHRoZSBtYW51c2NyaXB0LiAgXG5cbnwgUGFyYW1ldGVyIHwgVmFsdWUgfFxufC0tLS0tLS0tLS0tfC0tLS0tLS18XG58IE1heCBudW1iZXIgb2YgTVNBIHNlcXVlbmNlcyBkdXJpbmcgdHJhaW5pbmcgfCA4MTkyIHxcbnwgVGVtcGxhdGUgcGFpcndpc2UgZGltIHwgNjQgfFxufCBOdW0gdGVtcGxhdGUgYmxvY2tzIHwgMiB8XG58IFRyYWluaW5nIGRpZmZ1c2lvbiBtdWx0aXBsaWNpdHkgfCAzMiB8XG58IGJmYWN0b3IgbG9zcyB3ZWlnaHQgfCAxIFx1MDBkNyAxMFx1MjA3Ylx1MDBiMyB8XG5cbjwvdGQ+XG48dGQ+XG5cbjxiPlRhYmxlIDI6PC9iPiBEaWZmdXNpb24gcHJvY2VzcyBoeXBlcnBhcmFtZXRlcnMgIFxudGhhdCBkaWZmZXIgZnJvbSBCb2x0ei0xLCB3aXRoIHRoZSBleGNlcHRpb24gb2Ygc2lnbWFfbWluIHdlIG9wdGVkIGZvciBBbHBoYUZvbGQzXHUyMDE5cyBkZWZhdWx0IGh5cGVycGFyYW1ldGVycywgc2VlIEFicmFtc29uIGV0IGFsLiAoMjAyNCkgZm9yIG1vcmUgZGV0YWlscy4gIFxuXG58IFBhcmFtZXRlciAgIHwgVmFsdWUgICB8XG58LS0tLS0tLS0tLS0tLXwtLS0tLS0tLS18XG58IHNpZ21hX21pbiAgIHwgMC4wMDAxICB8XG58IHJobyAgICAgICAgIHwgNyAgICAgICB8XG58IGdhbW1hXzAgICAgIHwgMC44ICAgICB8XG58IGdhbW1hX21pbiAgIHwgMS4wICAgICB8XG58IG5vaXNlX3NjYWxlIHwgMS4wMDMgICB8XG58IHN0ZXBfc2NhbGUgIHwgMS41ICAgICB8XG5cbjwvdGQ+XG48L3RyPlxuPC90YWJsZT5cblxuIyMjIE91dHB1dDpcblxuKipPdXRwdXQgVHlwZShzKToqKiBTdHJ1Y3R1cmUgcHJlZGljdGlvbiBpbiBtbWNpZiBmb3JtYXQ7IHNjb3JlcyBpbiBudW1lcmljIGFycmF5czsgcnVudGltZSBtZXRyaWNzIGFzIGEgZGljdGlvbmFyeSA8YnI+XG4qKk91dHB1dCBGb3JtYXQ6KiogbW1jaWYgKHRleHQgZmlsZSk7IG51bWVyaWMgYXJyYXlzOyBzY2FsYXIgbnVtZXJpYyB2YWx1ZXMgPGJyPlxuKipPdXRwdXQgUGFyYW1ldGVyczoqKiAzRCBhdG9taWMgY29vcmRpbmF0ZXMsIHByZWRpY3RlZCBzY29yZXMsIGFuZCBtZXRhZGF0YSA8YnI+XG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBPdXRwdXQ6KiogQWxsIEJvbHR6LTIgc2NvcmVzIGFyZSByZXR1cm5lZCBieSBkZWZhdWx0LiBSdW50aW1lIG1ldHJpY3MgYXJlIG9wdGlvbmFsLiA8YnI+XG5PdXIgQUkgbW9kZWxzIGFyZSBkZXNpZ25lZCBhbmQvb3Igb3B0aW1pemVkIHRvIHJ1biBvbiBOVklESUEgR1BVLWFjY2VsZXJhdGVkIHN5c3RlbXMuIEJ5IGxldmVyYWdpbmcgTlZJRElBJ3MgaGFyZHdhcmUgKGUuZy4gR1BVIGNvcmVzKSBhbmQgc29mdHdhcmUgZnJhbWV3b3JrcyAoZS5nLiwgQ1VEQSBsaWJyYXJpZXMpLCB0aGUgbW9kZWwgYWNoaWV2ZXMgZmFzdGVyIHRyYWluaW5nIGFuZCBpbmZlcmVuY2UgdGltZXMgY29tcGFyZWQgdG8gQ1BVLW9ubHkgc29sdXRpb25zLiA8YnI+XG5cbiMjIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvbjpcblxuKipSdW50aW1lIEVuZ2luZShzKToqKlxuKiBQeVRvcmNoLCBUZW5zb3JSVCA8YnI+XG5cbioqU3VwcG9ydGVkIEhhcmR3YXJlIE1pY3JvYXJjaGl0ZWN0dXJlIENvbXBhdGliaWxpdHk6KiogPGJyPlxuKiBOVklESUEgQW1wZXJlLCBOVklESUEgSG9wcGVyLCBOVklESUEgTG92ZWxhY2UgPGJyPlxuXG4qKltQcmVmZXJyZWQvU3VwcG9ydGVkXSBPcGVyYXRpbmcgU3lzdGVtKHMpOioqIDxicj5cbiogW0xpbnV4XSA8YnI+XG4qIFRoZSBpbnRlZ3JhdGlvbiBvZiBmb3VuZGF0aW9uIGFuZCBmaW5lLXR1bmVkIG1vZGVscyBpbnRvIEFJIHN5c3RlbXMgcmVxdWlyZXMgYWRkaXRpb25hbCB0ZXN0aW5nIHVzaW5nIHVzZS1jYXNlLXNwZWNpZmljIGRhdGEgdG8gZW5zdXJlIHNhZmUgYW5kIGVmZmVjdGl2ZSBkZXBsb3ltZW50LiBGb2xsb3dpbmcgdGhlIFYtbW9kZWwgbWV0aG9kb2xvZ3ksIGl0ZXJhdGl2ZSB0ZXN0aW5nIGFuZCB2YWxpZGF0aW9uIGF0IGJvdGggdW5pdCBhbmQgc3lzdGVtIGxldmVscyBhcmUgZXNzZW50aWFsIHRvIG1pdGlnYXRlIHJpc2tzLCBtZWV0IHRlY2huaWNhbCBhbmQgZnVuY3Rpb25hbCByZXF1aXJlbWVudHMsIGFuZCBlbnN1cmUgY29tcGxpYW5jZSB3aXRoIHNhZmV0eSBhbmQgZXRoaWNhbCBzdGFuZGFyZHMgYmVmb3JlIGRlcGxveW1lbnQuXG5cbiMjIyBNb2RlbCBWZXJzaW9uKHMpOlxuXG5Cb2x0ejIgdmVyc2lvbiAxLjIgPGJyPlxuXG4jIyBUcmFpbmluZyAmIEV2YWx1YXRpb246XG5cbiMjIyBUcmFpbmluZyBEYXRhc2V0OlxuKiogRGF0YSBNb2RhbGl0eSA8YnI+XG4qIFtUZXh0XVxuXG5cbioqTGluazoqKiBbUHJvdGVpbiBEYXRhIEJhbmsgYXMgdXNlZCBieSBBbHBoYUZvbGQzXShodHRwczovL2dpdGh1Yi5jb20vandvaGx3ZW5kL2JvbHR6L2Jsb2IvbWFpbi9kb2NzL3RyYWluaW5nLm1kKSAgPGJyPlxuKiogRGF0YSBDb2xsZWN0aW9uIE1ldGhvZCBieSBkYXRhc2V0IDxicj5cbiogSHVtYW4gPGJyPlxuXG4qKiBMYWJlbGluZyBNZXRob2QgYnkgZGF0YXNldCA8YnI+XG4qIEh1bWFuIDxicj5cblxuKipQcm9wZXJ0aWVzOioqXG5BbGwgUHJvdGVpbiBEYXRhIEJhbmsgc3RydWN0dXJlcyBiZWZvcmUgMjAyMS0wOS0zMCB3aXRoIGEgcmVzb2x1dGlvbiBvZiBhdCBsZWFzdCA5IEFuZ3N0cm9tcywgcHJlcHJvY2Vzc2VkIHRvIG1hdGNoIGVhY2ggc3RydWN0dXJlIHRvIGl0cyBzZXF1ZW5jZS4gTGlnYW5kcyB3ZXJlIHByb2Nlc3NlZCBzaW1pbGFybHkuIEFsbCBkYXRhIHdhcyBjbGVhbmVkIGFzIGRlc2NyaWJlZCBpbiBBbHBoYUZvbGQzLlxuXG4jIyMgRXZhbHVhdGlvbiBEYXRhc2V0OlxuXG4qKkxpbms6KiogW0JvbHR6IEV2YWx1YXRpb24gUGVyZm9ybWVkIG9uIDc0NCBTdHJ1Y3R1cmVzIGZyb20gdGhlIFByb3RlaW4gRGF0YSBCYW5rXShodHRwczovL2dpdGh1Yi5jb20vandvaGx3ZW5kL2JvbHR6L2Jsb2IvbWFpbi9kb2NzL2V2YWx1YXRpb24ubWQpICA8YnI+XG4qKiBEYXRhIENvbGxlY3Rpb24gTWV0aG9kIGJ5IGRhdGFzZXQgPGJyPlxuKiBIdW1hbiA8YnI+XG5cbioqIExhYmVsaW5nIE1ldGhvZCBieSBkYXRhc2V0IDxicj5cbiogSHlicmlkOiBIdW1hbiBhbmQgQXV0b21hdGVkIDxicj5cblxuKipQcm9wZXJ0aWVzOioqXG5UaGUgdGVzdCBhbmQgdmFsaWRhdGlvbiBkYXRhc2V0cyB3ZXJlIGdlbmVyYXRlZCBieSBleHRlbnNpdmUgZmlsdGVyaW5nIG9mIFBEQiBzZXF1ZW5jZXMgZGVwb3NpdGVkIGJldHdlZW4gMjAyMS0wOS0zMSBhbmQgMjAyMy0wMS0xMy4gSW4gdG90YWwsIDU5MyBzdHJ1Y3R1cmVzIHBhc3NlZCBmaWx0ZXJzIGFuZCB3ZXJlIHVzZWQgZm9yIHZhbGlkYXRpb24uXG48YnI+XG5cbiMjIyBJbmZlcmVuY2U6XG5cbioqQWNjZWxlcmF0aW9uIEVuZ2luZToqKiBQeVRvcmNoLCBUZW5zb3JSVCA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogPGJyPlxuKiBOVklESUEgQTEwMCA8YnI+XG4qIE5WSURJQSBCMjAwIDxicj5cbiogTlZJRElBIEw0MCA8YnI+XG4qIE5WSURJQSBIMTAwIDxicj5cbiogTlZJRElBIFJUWDYwMDAtQWRhIDxicj5cbiogTlZJRElBIEdCMjAwIDxicj5cblxuIyMjIEV0aGljYWwgQ29uc2lkZXJhdGlvbnM6XG5cbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIHN1cHBvcnRpbmcgbW9kZWwgdGVhbSB0byBlbnN1cmUgdGhpcyBtb2RlbCBtZWV0cyByZXF1aXJlbWVudHMgZm9yIHRoZSByZWxldmFudCBpbmR1c3RyeSBhbmQgdXNlIGNhc2UgYW5kIGFkZHJlc3NlcyB1bmZvcmVzZWVuIHByb2R1Y3QgbWlzdXNlLiBQbGVhc2UgcmVwb3J0IG1vZGVsIHF1YWxpdHksIHJpc2ssIHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLlxuXG4qKllvdSBhcmUgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIGZvciBlbnN1cmluZyB0aGUgcGh5c2ljYWwgcHJvcGVydGllcyBvZiBtb2RlbC1nZW5lcmF0ZWQgbW9sZWN1bGVzIGFyZSBhcHByb3ByaWF0ZWx5IGV2YWx1YXRlZCwgYW5kIGNvbXBseSB3aXRoIGFwcGxpY2FibGUgc2FmZXR5IHJlZ3VsYXRpb25zIGFuZCBldGhpY2FsIHN0YW5kYXJkcy4qKlxuXG4jIEdldCBoZWxwXG4jIyBFbnRlcnByaXNlIFN1cHBvcnRcbkdldCBhY2Nlc3MgdG8ga25vd2xlZGdlIGJhc2UgYXJ0aWNsZXMgYW5kIHN1cHBvcnQgY2FzZXMgb3IgW3N1Ym1pdCBhIHRpY2tldF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9kYXRhLWNlbnRlci9wcm9kdWN0cy9haS1lbnRlcnByaXNlLXN1aXRlL3N1cHBvcnQvKS4iLAogICAgImRpc3BsYXlOYW1lIjogIkJvbHR6LTIiLAogICAgImV4cGxhaW5hYmlsaXR5IjogIiIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOSU0iLAogICAgICAgICJOU1BFQ1QtUzlYRy1MMFNBIiwKICAgICAgICAibnZhaWU6bW9kZWw6bnZhaWVfc3VwcG9ydGVkIiwKICAgICAgICAibnZpZGlhX25pbTptb2RlbDpuaW1tY3JvX252aWRpYV9uaW0iLAogICAgICAgICJwcm9kdWN0TmFtZXM6bmltLWRldiIsCiAgICAgICAgInByb2R1Y3ROYW1lczpudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJsYXRlc3RWZXJzaW9uSWRTdHIiOiAiMS4zLjAtZ3B1Z2IyMDBfc20xMDBfdjEiLAogICAgImxhdGVzdFZlcnNpb25TaXplSW5CeXRlcyI6IDEzMDg5Mzk2OTU5LAogICAgImxvZ28iOiAiaHR0cHM6Ly9hc3NldHMubmdjLm52aWRpYS5jb20vcHJvZHVjdHMvYXBpLWNhdGFsb2cvaW1hZ2VzL2JvbHR6Mi5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIlNBVkVEX01PREVMIiwKICAgICJuYW1lIjogImJvbHR6MiIsCiAgICAib3JnTmFtZSI6ICJuaW0iLAogICAgInByZWNpc2lvbiI6ICJGUDE2IiwKICAgICJwcml2YWN5IjogIiIsCiAgICAicHJvZHVjdE5hbWVzIjogWwogICAgICAgICJuaW0tZGV2IiwKICAgICAgICAibnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAicHVibGljRGF0YXNldFVzZWQiOiB7fSwKICAgICJwdWJsaXNoZXIiOiAibWl0IiwKICAgICJzYWZldHlBbmRTZWN1cml0eSI6ICIiLAogICAgInNob3J0RGVzY3JpcHRpb24iOiAiQm9sdHotMiBOSU0gaXMgYSBuZXh0LWdlbmVyYXRpb24gc3RydWN0dXJhbCBiaW9sb2d5IGZvdW5kYXRpb24gbW9kZWwgdGhhdCBzaG93cyBzdHJvbmcgcGVyZm9ybWFuY2UgZm9yIGJvdGggc3RydWN0dXJlIGFuZCBhZmZpbml0eSBwcmVkaWN0aW9uLiIsCiAgICAidGVhbU5hbWUiOiAibWl0IiwKICAgICJ1cGRhdGVkRGF0ZSI6ICIyMDI1LTEwLTMwVDA1OjEyOjMyLjMxN1oiCn0= source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/mit/containers/boltz2 optimizationProfiles: - profileId: nim/mit/boltz2:1.3.0-gpuh100_sm90_v1 framework: TensorRT-LLM displayName: Boltz2 H100x1 SM90 V1 FP16 Trt ngcMetadata: 0901e344383119d8d4a5160d4d63933fd350e6aa92a56b925a77ecc32378d4a5: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: H100 gpu_device: 2330:10de nim_workspace_hash_v1: 41c01d6bb5cc24cc98a2e59b7a367d197951ad5684f03ed939a35c45dbafd514 number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '90' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: H100 - key: COUNT value: 1 - key: GPU DEVICE value: 2330:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '90' - key: V value: '1' - profileId: nim/mit/boltz2:1.3.0-gpua100_sm80_v1 framework: TensorRT-LLM displayName: Boltz2 A100x1 SM80 V1 FP16 Trt ngcMetadata: 3fbc1c2eb885b24f631f8a1d0c58704cca1c7cf1cd2db4b791c7e6d7201aaa5c: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: A100 gpu_device: 20b2:10de nim_workspace_hash_v1: 1cbe7ff69de2ff435540d9ba81052291e9d9f6fdcd6c580b4db556b5e0adf542 number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '80' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: A100 - key: COUNT value: 1 - key: GPU DEVICE value: 20B2:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '80' - key: V value: '1' - profileId: nim/mit/boltz2:1.3.0-gpurtx6000_ada_sm86_v1 framework: TensorRT-LLM displayName: Boltz2 RTX6000_ADAx1 SM86 V1 FP16 Trt ngcMetadata: a49907753de80032ade9659c95ef20be5e93af4166b4451531ecac61247ae4b3: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: RTX6000_ADA gpu_device: 26b1:10de nim_workspace_hash_v1: 8d2989817b603a609a1da17a59010e28c15dd22b51a047d48596d892ff4a1d1a number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '86' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: RTX6000_ADA - key: COUNT value: 1 - key: GPU DEVICE value: 26B1:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '86' - key: V value: '1' - profileId: nim/mit/boltz2:1.3.0-gpul40s_sm89_v1 framework: TensorRT-LLM displayName: Boltz2 L40Sx1 SM89 V1 FP16 Trt ngcMetadata: baffed15a6e497b2a6a18437bca323a2f9c42f269d3f733a1b7fba0020eb9b02: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: L40S gpu_device: 26b9:10de nim_workspace_hash_v1: 41fcfb105bfe999210b6cf66cc28a8ecfaa4e513ca13b7b2616c88cd80094bf5 number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '89' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: L40S - key: COUNT value: 1 - key: GPU DEVICE value: 26B9:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '89' - key: V value: '1' - profileId: nim/mit/boltz2:1.3.0-gpub200_sm100_v1 framework: TensorRT-LLM displayName: Boltz2 B200x1 SM100 V1 FP16 Trt ngcMetadata: ca0fa87fc9c52aea7475339eab9fbcec7637a304b261b4ba4450c085a7af4c4d: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: B200 gpu_device: 2901:10de nim_workspace_hash_v1: 9bf86f1e8426e435b6319e0e0d1b6e0a954aced6b59aaa4ed5075de4a7fc52d0 number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '100' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: B200 - key: COUNT value: 1 - key: GPU DEVICE value: 2901:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '100' - key: V value: '1' - profileId: nim/mit/boltz2:1.3.0-gpugb200_sm100_v1 framework: TensorRT-LLM displayName: Boltz2 GB200x1 SM100 V1 FP16 Trt ngcMetadata: f27c6b6a5dc860324bcc06dcc0ae502d9840546188e69238ebf58376d26f0539: model: mit/boltz2 release: 1.3.0 tags: feat_lora: 'False' gpu: GB200 gpu_device: 2941:10de nim_workspace_hash_v1: 9b199cebb2c954abbc94f5ebf37b0052988a7aa8987617c9271605d5e2e2f0b5 number_of_gpus: '1' pp: '1' precision: fp16 profile: trt sm: '100' tp: '1' v: '1' modelFormat: trt-llm spec: - key: PROFILE value: TRT - key: PRECISION value: FP16 - key: GPU value: GB200 - key: COUNT value: 1 - key: GPU DEVICE value: 2941:10DE - key: NIM VERSION value: 1.3.0 - key: DOWNLOAD SIZE value: 13GB - key: SM value: '100' - key: V value: '1' labels: - Biology Foundation Model - signed images - NSPECT-D4IX-8I2O - NVIDIA AI Enterprise Supported - NVIDIA NIM config: architectures: - Other modelType: NIM license: NVIDIA AI Foundation Models Community License - name: GPT-OSS displayName: GPT-OSS modelHubID: gpt-oss category: Language type: NGC description: OpenAI's open-weight Mixture-of-Experts models for reasoning and agentic tasks. Both 20B and 120B variants support chain-of-thought reasoning, tuned for different latency and throughput tradeoffs. requireLicense: true licenseAgreements: - label: Use Policy url: https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/ - label: License Agreement url: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/ modelVariants: - variantId: GPT-OSS 120B modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wOC0wNVQxOTozNzowNi4zMzBaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIEdQVCBPU1MgMTIwQiBPdmVydmlld1xuXG4jIyBEZXNjcmlwdGlvbjogPGJyPlxuT3BlbkFJIHJlbGVhc2VzIHRoZSBncHQtb3NzIGZhbWlseSBvZiBvcGVuLXdlaWdodCBtb2RlbHMgZGVzaWduZWQgZm9yIHBvd2VyZnVsIHJlYXNvbmluZywgYWdlbnRpYyB0YXNrcywgYW5kIHZlcnNhdGlsZSBkZXZlbG9wZXIgdXNlIGNhc2VzLiBUaGUgZmFtaWx5IGNvbnNpc3RzIG9mIHRoZTpcbi0gYGdwdC1vc3MtMTIwYmAgXHUyMDE0IGZvciBwcm9kdWN0aW9uLCBnZW5lcmFsIHB1cnBvc2UsIGhpZ2ggcmVhc29uaW5nIHVzZS1jYXNlcyB0aGF0IGZpdHMgaW50byBhIHNpbmdsZSBIMTAwIEdQVSAoMTE3QiBwYXJhbWV0ZXJzIHdpdGggNS4xQiBhY3RpdmUgcGFyYW1ldGVycylcbi0gYGdwdC1vc3MtMjBiYCBcdTIwMTQgZm9yIGxvd2VyIGxhdGVuY3ksIGFuZCBsb2NhbCBvciBzcGVjaWFsaXplZCB1c2UtY2FzZXMgKDIxQiBwYXJhbWV0ZXJzIHdpdGggMy42QiBhY3RpdmUgcGFyYW1ldGVycykuXG5cblRoZSBgZ3B0LW9zcy0xMjBiYCBtb2RlbCBpcyBhcmNoaXRlY3R1cmFsbHkgZGVzaWduZWQgYXMgYSBNaXh0dXJlLW9mLUV4cGVydHMgKE1vRSkgbW9kZWwuIFRoaXMgbW9kZWwgZmVhdHVyZXMgU3dpR0xVIGFjdGl2YXRpb25zIGFuZCBsZWFybmVkIGF0dGVudGlvbiBzaW5rcyB3aXRoaW4gaXRzIGFyY2hpdGVjdHVyZS4gSXQgZnVuY3Rpb25zIGFzIGEgcmVhc29uaW5nIG1vZGVsLCBzdXBwb3J0aW5nIGNhcGFiaWxpdGllcyBzdWNoIGFzIGNoYWluLW9mLXRob3VnaHQgcHJvY2Vzc2luZywgYWRqdXN0YWJsZSByZWFzb25pbmcgZWZmb3J0IGxldmVscywgaW5zdHJ1Y3Rpb24gZm9sbG93aW5nLCBhbmQgdG9vbCB1c2UuIFRoaXMgbW9kZWwgaXMgdGV4dC1vbmx5IGZvciBib3RoIGlucHV0IGFuZCBvdXRwdXQgbW9kYWxpdGllcywgZW5hYmxpbmcgZW50ZXJwcmlzZXMgYW5kIGdvdmVybm1lbnRzIHRvIGRlcGxveSBpdCBvbi1wcmVtaXNlcyBvciBpbiBwcml2YXRlIGNsb3VkIGVudmlyb25tZW50cyBmb3IgZW5oYW5jZWQgZGF0YSBzZWN1cml0eSBhbmQgcHJpdmFjeS5cblxuTW9kZWwgSGlnaGxpZ2h0czogIFxuLSAqKlBlcm1pc3NpdmUgQXBhY2hlIDIuMCBsaWNlbnNlOioqIEJ1aWxkIGZyZWVseSB3aXRob3V0IGNvcHlsZWZ0IHJlc3RyaWN0aW9ucyBvciBwYXRlbnQgcmlza1x1MjAxNGlkZWFsIGZvciBleHBlcmltZW50YXRpb24sIGN1c3RvbWl6YXRpb24sIGFuZCBjb21tZXJjaWFsIGRlcGxveW1lbnQuXG4tICoqQ29uZmlndXJhYmxlIHJlYXNvbmluZyBlZmZvcnQ6KiogRWFzaWx5IGFkanVzdCB0aGUgcmVhc29uaW5nIGVmZm9ydCAobG93LCBtZWRpdW0sIGhpZ2gpIGJhc2VkIG9uIHlvdXIgc3BlY2lmaWMgdXNlIGNhc2UgYW5kIGxhdGVuY3kgbmVlZHMuXG4tICoqRnVsbCBjaGFpbi1vZi10aG91Z2h0OioqIEdhaW4gY29tcGxldGUgYWNjZXNzIHRvIHRoZSBtb2RlbCdzIHJlYXNvbmluZyBwcm9jZXNzLCBmYWNpbGl0YXRpbmcgZWFzaWVyIGRlYnVnZ2luZyBhbmQgaW5jcmVhc2VkIHRydXN0IGluIG91dHB1dHMuIEl0J3Mgbm90IGludGVuZGVkIHRvIGJlIHNob3duIHRvIGVuZCB1c2Vycy5cbi0gKipGaW5lLXR1bmFibGU6KiogRnVsbHkgY3VzdG9taXplIG1vZGVscyB0byB5b3VyIHNwZWNpZmljIHVzZSBjYXNlIHRocm91Z2ggcGFyYW1ldGVyIGZpbmUtdHVuaW5nLlxuLSAqKkFnZW50aWMgY2FwYWJpbGl0aWVzOioqIFVzZSB0aGUgbW9kZWxzJyBuYXRpdmUgY2FwYWJpbGl0aWVzIGZvciBmdW5jdGlvbiBjYWxsaW5nLCB3ZWIgYnJvd3NpbmcsIHB5dGhvbiBjb2RlIGV4ZWN1dGlvbiwgYW5kIHN0cnVjdHVyZWQgb3V0cHV0cy5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbC9ub24tY29tbWVyY2lhbCB1c2UuXG5cblxuIyMgVGhpcmQtUGFydHkgQ29tbXVuaXR5IENvbnNpZGVyYXRpb24gPGJyPlxuVGhpcyBtb2RlbCBpcyBub3Qgb3duZWQgb3IgZGV2ZWxvcGVkIGJ5IE5WSURJQS4gVGhpcyBtb2RlbCBoYXMgYmVlbiBkZXZlbG9wZWQgYW5kIGJ1aWx0IHRvIGEgdGhpcmQtcGFydHlcdTIwMTlzIHJlcXVpcmVtZW50cyBmb3IgdGhpcyBhcHBsaWNhdGlvbiBhbmQgdXNlIGNhc2U7IHNlZSBsaW5rIHRvIE5vbi1OVklESUEgW2dwdC1vc3MtMTIwYiBtb2RlbCBjYXJkXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL29wZW5haS9ncHQtb3NzLTEyMGIpLlxuXG5cbiMjIyBMaWNlbnNlIGFuZCBUZXJtcyBvZiBVc2U6IDxicj5cbkdPVkVSTklORyBURVJNUzogVGhlIE5JTSBjb250YWluZXIgaXMgZ292ZXJuZWQgYnkgdGhlIFtOVklESUEgU29mdHdhcmUgTGljZW5zZSBBZ3JlZW1lbnRdKGF0IGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1zb2Z0d2FyZS1saWNlbnNlLWFncmVlbWVudC8pIGFuZCB0aGUgW1Byb2R1Y3QtU3BlY2lmaWMgVGVybXMgZm9yIE5WSURJQSBBSSBQcm9kdWN0c10oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvcHJvZHVjdC1zcGVjaWZpYy10ZXJtcy1mb3ItYWktcHJvZHVjdHMvKTsgYW5kIHRoZSB1c2Ugb2YgdGhpcyBtb2RlbCBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBDb21tdW5pdHkgTW9kZWwgTGljZW5zZSBBZ3JlZW1lbnRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvYWdyZWVtZW50cy9lbnRlcnByaXNlLXNvZnR3YXJlL252aWRpYS1jb21tdW5pdHktbW9kZWxzLWxpY2Vuc2UvKS5cbkFkZGl0aW9uYWwgSW5mb3JtYXRpb246IFtBcGFjaGUgTGljZW5zZSBWZXJzaW9uIDIuMF0oaHR0cHM6Ly93d3cuYXBhY2hlLm9yZy9saWNlbnNlcy9MSUNFTlNFLTIuMCkuXG5cbioqWW91IGFyZSByZXNwb25zaWJsZSBmb3IgZW5zdXJpbmcgdGhhdCB5b3VyIHVzZSBvZiBOVklESUEgcHJvdmlkZWQgbW9kZWxzIGNvbXBsaWVzIHdpdGggYWxsIGFwcGxpY2FibGUgbGF3cyoqXG5cbiMjIEdldCBIZWxwXG5cbiMjIyBFbnRlcnByaXNlIFN1cHBvcnRcblxuR2V0IGFjY2VzcyB0byBrbm93bGVkZ2UgYmFzZSBhcnRpY2xlcyBhbmQgc3VwcG9ydCBjYXNlcyBvciBbc3VibWl0IGEgdGlja2V0XShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2RhdGEtY2VudGVyL3Byb2R1Y3RzL2FpLWVudGVycHJpc2Utc3VpdGUvc3VwcG9ydC8pLlxuXG4jIyMgTlZJRElBIE5JTSBEb2N1bWVudGF0aW9uXG5cblZpc2l0IHRoZSBbTklNIENvbnRhaW5lciBMTE1dKGh0dHBzOi8vZG9jcy5udmlkaWEuY29tL25pbS9sYXJnZS1sYW5ndWFnZS1tb2RlbHMvbGF0ZXN0L2ludHJvZHVjdGlvbi5odG1sKSBwYWdlIGZvciByZWxlYXNlIGRvY3VtZW50YXRpb24sIGRlcGxveW1lbnQgZ3VpZGVzIGFuZCBtb3JlLlxuXG4jIyMgRGVwbG95bWVudCBHZW9ncmFwaHk6XG5HbG9iYWxcblxuIyMjIFVzZSBDYXNlOiA8YnI+XG5JbnRlbmRlZCBmb3IgdXNlIGFzIGEgcmVhc29uaW5nIG1vZGVsIHdpdGggZmVhdHVyZXMgbGlrZSBjaGFpbi1vZi10aG91Z2h0IGFuZCBhZGp1c3RhYmxlIHJlYXNvbmluZyBlZmZvcnQgbGV2ZWxzLiBJdCBzdXBwb3J0cyBpbnN0cnVjdGlvbiBmb2xsb3dpbmcgYW5kIHRvb2wgdXNlLCBvZmZlcmluZyB0cmFuc3BhcmVuY3ksIGN1c3RvbWl6YXRpb24sIGFuZCBkZXBsb3ltZW50IGZsZXhpYmlsaXR5IGZvciBkZXZlbG9wZXJzLCByZXNlYXJjaGVycywgYW5kIHN0YXJ0dXBzLiBBZGRpdGlvbmFsbHksIGl0IGVuYWJsZXMgZW50ZXJwcmlzZXMgYW5kIGdvdmVybm1lbnRzIHRvIGRlcGxveSBvbi1wcmVtaXNlcyBvciBpbiBwcml2YXRlIGNsb3VkcyB0byBlbnN1cmUgZGF0YSBzZWN1cml0eSBhbmQgcHJpdmFjeS5cblxuIyMjIFJlbGVhc2UgRGF0ZTogIDxicj5cbkJ1aWxkLk5WSURJQS5jb20gLSAwOC8wNS8yMDI1IHZpYSBbbGlua10oaHR0cHM6Ly9idWlsZC5udmlkaWEuY29tL29wZW5haS9ncHQtb3NzLTEyMGIpIDxicj4gXG5IdWdnaW5nIEZhY2UgLSAwOC8wNS8yMDI1IHZpYSBbbGlua10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9vcGVuYWkvZ3B0LW9zcy0xMjBiKSA8YnI+XG5cbiMjIFJlZmVyZW5jZShzKTpcbi0gW09wZW5BSSBDb29rYm9va10oaHR0cHM6Ly9jb29rYm9vay5vcGVuYWkuY29tLylcbi0gW09wZW4gQUkgQ29vYmtib29rIC0tIFNlcnZpbmcgTW9kZWwgd2l0aCBUZW5zb3JSVC1MTE1dKGh0dHBzOi8vY29va2Jvb2sub3BlbmFpLmNvbS9hcnRpY2xlcy9ncHQtb3NzL3J1bi1udmlkaWEpXG5cblxuIyMgTW9kZWwgQXJjaGl0ZWN0dXJlOiA8YnI+IFxuKipBcmNoaXRlY3R1cmUgVHlwZToqKiBUcmFuc2Zvcm1lciA8YnI+XG4qKk5ldHdvcmsgQXJjaGl0ZWN0dXJlOioqIE1peHR1cmUtb2YtRXhwZXJ0cyAoTW9FKSA8YnI+XG4qKlRvdGFsIFBhcmFtZXRlcnM6KiogMTE3QiA8YnI+XG4qKkFjdGl2ZSBQYXJhbWV0ZXJzOioqIDUuN0IgPGJyPlxuKipWb2NhYnVsYXJ5IFNpemU6KiogMjAxLDA4OCA8YnI+XG5cblxuIyMgSW5wdXQ6IDxicj5cbioqSW5wdXQgVHlwZShzKToqKiBUZXh0IDxicj5cbioqSW5wdXQgRm9ybWF0KHMpOioqIFN0cmluZyA8YnI+XG4qKklucHV0IFBhcmFtZXRlcnM6KiogT25lIERpbWVuc2lvbmFsICgxRCkgPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQ6KiogVXNlcyBSb1BFIHdpdGggYSAxMjhrIGNvbnRleHQgbGVuZ3RoLCB3aXRoIGF0dGVudGlvbiBsYXllcnMgYWx0ZXJuYXRpbmcgYmV0d2VlbiBmdWxsIGNvbnRleHQgYW5kIGEgc2xpZGluZyAxMjgtdG9rZW4gd2luZG93LiBJbmNsdWRlcyBhIGxlYXJuZWQgYXR0ZW50aW9uIHNpbmsgcGVyLWhlYWQuIEVtcGxveXMgU3dpR0xVIGFjdGl2YXRpb25zIGluIHRoZSBNb0UgbGF5ZXJzLCBhbmQgdGhlIHJvdXRlciBwZXJmb3JtcyBhIFRvcC1LIG9wZXJhdGlvbiAoSz00KSBmb2xsb3dlZCBieSBhIFNpZ21vaWQgZnVuY3Rpb24uIEdFTU1zIGluIHRoZSBNb0UgaW5jbHVkZSBhIHBlci1leHBlcnQgYmlhcy4gVXRpbGl6ZXMgdGlrdG9rZW4gZm9yIHRva2VuaXphdGlvbi4gSW5wdXQgQ29udGV4dCBMZW5ndGggKElTTCk6IDEyODAwMCA8YnI+XG5cbiMjIE91dHB1dDogPGJyPlxuKipPdXRwdXQgVHlwZShzKToqKiBUZXh0IDxicj5cbioqT3V0cHV0IEZvcm1hdDoqKiBTdHJpbmcgPGJyPlxuKipPdXRwdXQgUGFyYW1ldGVyczoqKiBPbmUgRGltZW5zaW9uYWwgKDFEKSA8YnI+XG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBPdXRwdXQ6KiogVGhlIG1vZGVsIGlzIGRlc2lnbmVkIHRvIGJlIGNvbXBhdGlibGUgd2l0aCB0aGUgT3BlbkFJIFJlc3BvbnNlcyBBUEkgYW5kIHN1cHBvcnRzIFN0cnVjdHVyZWQgT3V0cHV0LiA8YnI+IFxuXG5PdXIgQUkgbW9kZWxzIGFyZSBkZXNpZ25lZCBhbmQvb3Igb3B0aW1pemVkIHRvIHJ1biBvbiBOVklESUEgR1BVLWFjY2VsZXJhdGVkIHN5c3RlbXMgW29yIG5hbWUgZXF1aXZhbGVudCBoYXJkd2FyZSBwcmVmZXJlbmNlXS4gQnkgbGV2ZXJhZ2luZyBOVklESUFcdTIwMTlzIGhhcmR3YXJlIChlLmcuIEdQVSBjb3JlcykgYW5kIHNvZnR3YXJlIGZyYW1ld29ya3MgKGUuZy4sIENVREEgbGlicmFyaWVzKSwgdGhlIG1vZGVsIGFjaGlldmVzIGZhc3RlciB0cmFpbmluZyBhbmQgaW5mZXJlbmNlIHRpbWVzIGNvbXBhcmVkIHRvIENQVS1vbmx5IHNvbHV0aW9ucy4gPGJyPiAgIFxuXG4jIyBTb2Z0d2FyZSBJbnRlZ3JhdGlvbjogPGJyPlxuKipSdW50aW1lIEVuZ2luZShzKToqKiA8YnI+XG4qIE5lTW8gRnJhbWV3b3JrIChiYXNlZCBvbiAyNS4wNyk8YnI+XG5cblxuKipTdXBwb3J0ZWQgSGFyZHdhcmUgTWljcm9hcmNoaXRlY3R1cmUgQ29tcGF0aWJpbGl0eToqKiA8YnI+XG4qIE5WSURJQSBCbGFja3dlbGw6IEIyMDAgPGJyPlxuKiBOVklESUEgSG9wcGVyOiBIMjAwXG5cblxuKipPcGVyYXRpbmcgU3lzdGVtKHMpOioqIExpbnV4IFxuXG4jIyBNb2RlbCBWZXJzaW9uKHMpOiBcbmBncHQtb3NzLTEyMGJgIHYxLjAgKEF1Z3VzdCA1LCAyMDI1KVxuXG5cbiMjIFRyYWluaW5nLCBUZXN0aW5nLCBhbmQgRXZhbHVhdGlvbiBEYXRhc2V0czogPGJyPiAgIFxuIyMjIFRyYWluaW5nIERhdGFzZXQ6XG5cbiogKipUcmFpbmluZyBEYXRhIENvbGxlY3Rpb246KiogVW5kaXNjbG9zZWQgPGJyPlxuKiAqKlRyYWluaW5nIExhYmVsaW5nOioqIFVuZGlzY2xvc2VkIDxicj5cbiogKipUcmFpbmluZyBQcm9wZXJ0aWVzOioqIFRoZSBtb2RlbCBoYXMgYXBwcm94aW1hdGVseSAxMTcgYmlsbGlvbiBwYXJhbWV0ZXJzLiBXZWlnaHRzIGZvciBhbGwgbGF5ZXJzIGFyZSBpbiBCRjE2LCBleGNlcHQgZm9yIE1vRSBwcm9qZWN0aW9uIHdlaWdodHMsIHdoaWNoIGFyZSBpbiBNWEZQNC4gVGhlIHJlZmVyZW5jZSBpbXBsZW1lbnRhdGlvbiBjdXJyZW50bHkgdXBjYXN0cyBhbGwgd2VpZ2h0cyB0byBCRjE2LiBBY3RpdmF0aW9ucyBhcmUgZXhwZWN0ZWQgdG8gYmUgaW4gQkYxNiBvciBGUDguXG5cblxuIyMjIFRlc3RpbmcgRGF0YXNldDpcbiogKipUZXN0aW5nIERhdGEgQ29sbGVjdGlvbjoqKiBVbmRpc2Nsb3NlZCA8YnI+XG4qICoqVGVzdGluZyBMYWJlbGluZzoqKiBVbmRpc2Nsb3NlZCA8YnI+XG4qICoqVGVzdGluZyBQcm9wZXJ0aWVzOioqIFRoZSBtb2RlbCBpcyB0ZXN0ZWQgYWdhaW5zdCBiZW5jaG1hcmtzIHN1Y2ggYXMgTU1MVSBhbmQgR1BRQSwgYW1vbmcgb3RoZXJzIGluY2x1ZGluZyBMaXZlQ29kZUJlbmNoLCBBSU1FIDIwMjQsIGFuZCBNQVRILTUwMC4gXG5cbiMjIyBFdmFsdWF0aW9uIERhdGFzZXQ6XG5cbiogKipFdmFsdWF0aW9uIERhdGEgQ29sbGVjdGlvbjoqKiBVbmRpc2Nsb3NlZCA8YnI+XG4qICoqRXZhbHVhdGlvbiBMYWJlbGluZzoqKiBVbmRpc2Nsb3NlZCA8YnI+XG4qICoqRXZhbHVhdGlvbiBCZW5jaG1hcmsgU2NvcmU6KiogXG5cbnwgQmVuY2htYXJrICB8IGdwdC1vc3MtMTIwYiB8IGdwdC1vc3MtMjBiIHxcbnwtLS0tLS0tLS0tfC0tLS0tLS0tLS0tfCAtLS0tLS0tLS0tLXxcbnwgQUlNRSAyMDI0IChubyB0b29scykgfCA5NS44ICAgfCA5Mi4xIHxcbnwgQUlNRSAyMDI0ICh3aXRoIHRvb2xzKSB8IDk2LjYgfCA5Ni4wIHxcbnwgQUlNRSAyMDI1IChubyB0b29scykgfCA5Mi41ICB8IDkxLjcgfFxufCBBSU1FIDIwMjUgKHdpdGggdG9vbHMpIHwgOTcuOSB8IDk4LjcgfFxufCBHUFFBIERpYW1vbmQgKG5vIHRvb2xzKSB8IDgwLjEgfCA3MS41IHxcbnwgR1BRQSBEaWFtb25kICh3aXRoIHRvb2xzKSB8IDgwLjkgfCA3NC4yIHxcbnwgSExFIChubyB0b29scykgfCAxNC45IHwgMTAuOSB8XG58IEhMRSAod2l0aCB0b29scykgfCAxOS4wIHwgMTcuMyB8XG58IE1NTFUgfCA5MC4wIHwgODUuMyB8XG58IFNXRS1CZW5jaCBWZXJpZmllZCB8IDYyLjQgfCA2MC43IHxcbnwgVGF1LUJlbmNoIFJldGFpbCB8IDY3LjggfCA1NC40IHxcbnwgVGF1LUJlbmNoIEFpcmxpbmUgfCA0OS4yIHwgMzguMCB8XG58IEFpZGVyIFBvbHlnbG90IHwgNDQuNCB8IDM0LjIgfFxufCBNTU1MVSAoQXZlcmFnZSkgfCA4MS4zIHwgNzUuNiB8XG58IEhlYWx0aEJlbmNoIHwgNTcuNiB8IDQyLjUgfFxufCBIZWFsdGhCZW5jaCBIYXJkIHwgMzAuMCB8IDEwLjggfFxufCBIZWFsdGhCZW5jaCBDb25zZW5zdXMgfCA4OS45IHwgODIuNiB8XG58IENvZGVmb3JjZXMgKG5vIHRvb2xzKSBbZWxvXSB8IDI0NjMgfCAyMjMwIHxcbnwgQ29kZWZvcmNlcyAod2l0aCB0b29scykgW2Vsb10gfCAyNjIyIHwgMjUxNiB8XG5cbkFib3ZlIHNjb3JlcyB3ZXJlIG1lYXN1cmVkIGZvciB0aGUgaGlnaCByZWFzb25pbmcgbGV2ZWwuXG5cbiMjIyBTYWZldHkgUmVzdWx0czpcblxuVGhlIGZvbGxvd2luZyBldmFsdWF0aW9ucyBjaGVjayB0aGF0IHRoZSBtb2RlbCBkb2VzIG5vdCBjb21wbHkgd2l0aCByZXF1ZXN0cyBmb3IgY29udGVudCB0aGF0IGlzXG5kaXNhbGxvd2VkIHVuZGVyIE9wZW5BSVx1MjAxOXMgc2FmZXR5IHBvbGljaWVzLCBpbmNsdWRpbmcgaGF0ZWZ1bCBjb250ZW50IG9yIGlsbGljaXQgYWR2aWNlLlxuXG58IENhdGVnb3J5ICB8IGdwdC1vc3MtMTIwYiB8IGdwdC1vc3MtMjBiIHxcbnwtLS0tLS0tLS0tfC0tLS0tLS0tLS0tfCAtLS0tLS0tLS0tLXxcbnwgaGF0ZSAoYWdncmVnYXRlKSB8IDAuOTk2ICAgfCAwLjk5NiB8XG58IHNlbGYtaGFybS9pbnRlbnQgYW5kIHNlbGZoYXJtL2luc3RydWN0aW9ucyB8IDAuOTk1IHwgMC45ODQgfFxufCBwZXJzb25hbCBkYXRhL3NlbWkgcmVzdHJpY3RpdmUgfCAwLjk2NyAgfCAwLjk0NyB8XG58IHNleHVhbC9leHBsb2l0YXRpdmUgfCAxLjAwMCB8IDAuOTgwIHxcbnwgc2V4dWFsL21pbm9ycyB8IDEuMDAwIHwgMC45NzEgfFxufCBpbGxpY2l0L25vbi12aW9sZW50IHwgMS4wMDAgfCAwLjk4MyB8XG58IGlsbGljaXQvdmlvbGVudCB8IDEuMDAwIHwgMS4wMDAgfFxufCBwZXJzb25hbCBkYXRhL3Jlc3RyaWN0ZWQgfCAwLjk5NiB8IDAuOTc4IHxcblxuIyMgSW5mZXJlbmNlOlxuKipBY2NlbGVyYXRpb24gRW5naW5lOioqIHZMTE0gPGJyPlxuKipUZXN0IEhhcmR3YXJlOioqIE5WSURJQSBIb3BwZXI6IEIyMDAgPGJyPlxuXG5cbiMjIEFkZGl0aW9uYWwgRGV0YWlsc1xuVGhlIG1vZGVsIGlzIHJlbGVhc2VkIHdpdGggdGhlIG5hdGl2ZSBxdWFudGl6YXRpb24gc3VwcG9ydC4gU3BlY2lmaWNhbGx5LCBbTVhGUDRdKGh0dHBzOi8vd3d3Lm9wZW5jb21wdXRlLm9yZy9kb2N1bWVudHMvb2NwLW1pY3Jvc2NhbGluZy1mb3JtYXRzLW14LXYxLTAtc3BlYy1maW5hbC1wZGYpIGlzIHVzZWQgZm9yIHRoZSBsaW5lYXIgcHJvamVjdGlvbiB3ZWlnaHRzIGluIHRoZSBNb0UgbGF5ZXIuIEl0IGlzIHN0b3JlZCB0aGUgTW9FIHRlbnNvciBpbiB0d28gcGFydHM6XG5cbi0gYHRlbnNvci5ibG9ja3NgIHN0b3JlcyB0aGUgYWN0dWFsIGZwNCB2YWx1ZXMuIEV2ZXJ5IHR3byB2YWx1ZXMgYXJlIHBhY2tlZCBpbiBvbmUgYHVpbnQ4YCB2YWx1ZS5cbi0gYHRlbnNvci5zY2FsZXNgIHN0b3JlcyB0aGUgYmxvY2sgc2NhbGUuIFRoZSBibG9jayBzY2FsaW5nIGlzIGRvbmUgYW1vbmcgdGhlIGxhc3QgZGltZW5zaW9uIGZvciBhbGwgTVhGUDQgdGVuc29ycy5cblxuQWxsIG90aGVyIHRlbnNvcnMgYXJlIHN0b3JlZCBpbiBCRjE2LiBJdCBpcyByZWNvbW1lbmRlZCB0byB1c2UgQkYxNiBhcyB0aGUgYWN0aXZhdGlvbiBwcmVjaXNpb24gZm9yIHRoZSBtb2RlbC5cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9uczpcbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gIFxuXG5QbGVhc2UgcmVwb3J0IHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiR1BULU9TUy0xMjBCIiwKICAgICJleHBsYWluYWJpbGl0eSI6ICIiLAogICAgImZyYW1ld29yayI6ICJPdGhlciIsCiAgICAiaGFzUGxheWdyb3VuZCI6IGZhbHNlLAogICAgImhhc1NpZ25lZFZlcnNpb24iOiB0cnVlLAogICAgImlzUGxheWdyb3VuZEVuYWJsZWQiOiBmYWxzZSwKICAgICJpc1B1YmxpYyI6IGZhbHNlLAogICAgImlzUmVhZE9ubHkiOiB0cnVlLAogICAgImxhYmVscyI6IFsKICAgICAgICAiTlNQRUNULUVFWlMtN0pCTSIsCiAgICAgICAgIlNpZ25lZCBNb2RlbHMiLAogICAgICAgICJudmFpZTptb2RlbDpudmFpZV9zdXBwb3J0ZWQiLAogICAgICAgICJudmlkaWFfbmltOm1vZGVsOm5pbW1jcm9fbnZpZGlhX25pbSIsCiAgICAgICAgInByb2R1Y3ROYW1lczpuaW0tZGV2IiwKICAgICAgICAicHJvZHVjdE5hbWVzOm52LWFpLWVudGVycHJpc2UiCiAgICBdLAogICAgImxhdGVzdFZlcnNpb25JZFN0ciI6ICJoZi04YjE5M2IwLW5pbSIsCiAgICAibGF0ZXN0VmVyc2lvblNpemVJbkJ5dGVzIjogNjUyNzY4NTk4NzUsCiAgICAibG9nbyI6ICJodHRwczovL2Fzc2V0cy5uZ2MubnZpZGlhLmNvbS9wcm9kdWN0cy9hcGktY2F0YWxvZy9pbWFnZXMvZ3B0LW9zcy0xMjBiLmpwZyIsCiAgICAibW9kZWxGb3JtYXQiOiAiU2F2ZWRNb2RlbCIsCiAgICAibmFtZSI6ICJncHQtb3NzLTEyMGIiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiT1RIRVIiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJPcGVuQUkiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJPcGVuQUkgcmVsZWFzZXMgdGhlIGdwdC1vc3MgZmFtaWx5IG9mIG9wZW4td2VpZ2h0IG1vZGVscyBkZXNpZ25lZCBmb3IgcG93ZXJmdWwgcmVhc29uaW5nLCBhZ2VudGljIHRhc2tzLCBhbmQgdmVyc2F0aWxlIGRldmVsb3BlciB1c2UgY2FzZXMuIiwKICAgICJ0ZWFtTmFtZSI6ICJvcGVuYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDktMDRUMjA6MTU6MTguNzQ4WiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/openai/containers/gpt-oss-120b optimizationProfiles: - profileId: nim/openai/gpt-oss-120b:hf-8b193b0-nim-tp8 framework: VLLM displayName: GPT-OSS 120B Generic NVIDIA GPUx8 MXFP4 ngcMetadata: 650450b7f0c9fb164c4e7e03fca53a2e781718930eb23d23b730ffaff2056685: model: openai/gpt-oss-120b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: 8d1357e1888e26523f732140e20c1562434517e6f8e5fa12bc9a67bebf202d33 pp: '1' precision: mxfp4 tp: '8' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 8 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 61GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-120b:hf-8b193b0-nim-tp4 framework: VLLM displayName: GPT-OSS 120B Generic NVIDIA GPUx4 MXFP4 ngcMetadata: 9af7e80ca3e26c05e61e22b2f1f88314f03964a30b1f5ebdbe103704d5e48d8f: model: openai/gpt-oss-120b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: 8d1357e1888e26523f732140e20c1562434517e6f8e5fa12bc9a67bebf202d33 pp: '1' precision: mxfp4 tp: '4' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 4 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 61GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-120b:hf-8b193b0-nim-tp2 framework: VLLM displayName: GPT-OSS 120B Generic NVIDIA GPUx2 MXFP4 ngcMetadata: b8a95a1d502de2bd02c311f4b590ee8b645eaf4b93584c75314d80a4fd719c57: model: openai/gpt-oss-120b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: 8d1357e1888e26523f732140e20c1562434517e6f8e5fa12bc9a67bebf202d33 pp: '1' precision: mxfp4 tp: '2' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 2 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 61GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-120b:hf-8b193b0-nim framework: VLLM displayName: GPT-OSS 120B Generic NVIDIA GPUx1 MXFP4 ngcMetadata: fc1df044c94b466d0ebd561df47556bc23a01ac8147d68dc49f04238a6cfcd7f: model: openai/gpt-oss-120b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: 8d1357e1888e26523f732140e20c1562434517e6f8e5fa12bc9a67bebf202d33 pp: '1' precision: mxfp4 tp: '1' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 1 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 61GB - key: LLM ENGINE value: VLLM - variantId: GPT-OSS 20B modelCard: ewogICAgImFjY2Vzc1R5cGUiOiAiTk9UX0xJU1RFRCIsCiAgICAiYXBwbGljYXRpb24iOiAiT3RoZXIiLAogICAgImJpYXMiOiAiIiwKICAgICJjYW5HdWVzdERvd25sb2FkIjogZmFsc2UsCiAgICAiY3JlYXRlZERhdGUiOiAiMjAyNS0wOC0wNVQxOTozNzoxMi43MzlaIiwKICAgICJkZXNjcmlwdGlvbiI6ICIjIEdQVCBPU1MgMjBCIE92ZXJ2aWV3XG5cbiMjIERlc2NyaXB0aW9uOiA8YnI+XG5PcGVuQUkgcmVsZWFzZXMgdGhlIGdwdC1vc3MgZmFtaWx5IG9mIG9wZW4td2VpZ2h0IG1vZGVscyBkZXNpZ25lZCBmb3IgcG93ZXJmdWwgcmVhc29uaW5nLCBhZ2VudGljIHRhc2tzLCBhbmQgdmVyc2F0aWxlIGRldmVsb3BlciB1c2UgY2FzZXMuIFRoZSBmYW1pbHkgY29uc2lzdHMgb2YgdGhlOlxuLSBgZ3B0LW9zcy0xMjBiYCBcdTIwMTQgZm9yIHByb2R1Y3Rpb24sIGdlbmVyYWwgcHVycG9zZSwgaGlnaCByZWFzb25pbmcgdXNlLWNhc2VzIHRoYXQgZml0cyBpbnRvIGEgc2luZ2xlIEgxMDAgR1BVICgxMTdCIHBhcmFtZXRlcnMgd2l0aCA1LjFCIGFjdGl2ZSBwYXJhbWV0ZXJzKVxuLSBgZ3B0LW9zcy0yMGJgIFx1MjAxNCBmb3IgbG93ZXIgbGF0ZW5jeSwgYW5kIGxvY2FsIG9yIHNwZWNpYWxpemVkIHVzZS1jYXNlcyAoMjFCIHBhcmFtZXRlcnMgd2l0aCAzLjZCIGFjdGl2ZSBwYXJhbWV0ZXJzKS5cblxuVGhlIGBncHQtb3NzLTIwYmAgaXMgZGVzaWduZWQgYXMgYSBNaXh0dXJlLW9mLUV4cGVydHMgKE1vRSkgbW9kZWwsIHN0cnVjdHVyYWxseSBpZGVudGljYWwgdG8gdGhlIGxhcmdlciAxMTdCIHZhcmlhbnQsIGFsYmVpdCB3aXRoIGRpZmZlcmVudCBoeXBlcnBhcmFtZXRlcnMuIFRoaXMgbW9kZWwgbGV2ZXJhZ2VzIFN3aUdMVSBhY3RpdmF0aW9ucyBhbmQgaW5jb3Jwb3JhdGVzIGxlYXJuZWQgYXR0ZW50aW9uIHNpbmtzIHdpdGhpbiBpdHMgYXJjaGl0ZWN0dXJlLiBGdW5jdGlvbmFsbHksIGl0IHNlcnZlcyBhcyBhIHJvYnVzdCByZWFzb25pbmcgbW9kZWwsIHN1cHBvcnRpbmcgYWR2YW5jZWQgY2FwYWJpbGl0aWVzIHN1Y2ggYXMgY2hhaW4tb2YtdGhvdWdodCBwcm9jZXNzaW5nLCBhZGp1c3RhYmxlIHJlYXNvbmluZyBlZmZvcnQgbGV2ZWxzLCBpbnN0cnVjdGlvbiBmb2xsb3dpbmcsIGFuZCB0b29sIHVzZS4gSXQgb3BlcmF0ZXMgc3RyaWN0bHkgd2l0aCB0ZXh0LW9ubHkgbW9kYWxpdGllcyBmb3IgYm90aCBpbnB1dCBhbmQgb3V0cHV0LiBBIGtleSBzdHJhdGVnaWMgYmVuZWZpdCBpcyBpdHMgc3VpdGFiaWxpdHkgZm9yIGVudGVycHJpc2VzIGFuZCBnb3Zlcm5tZW50cywgZmFjaWxpdGF0aW5nIG9uLXByZW1pc2VzIG9yIHByaXZhdGUgY2xvdWQgZGVwbG95bWVudCB0byBlbnN1cmUgZW5oYW5jZWQgZGF0YSBzZWN1cml0eSBhbmQgcHJpdmFjeS5cblxuTW9kZWwgSGlnaGxpZ2h0czogIFxuLSAqKlBlcm1pc3NpdmUgQXBhY2hlIDIuMCBsaWNlbnNlOioqIEJ1aWxkIGZyZWVseSB3aXRob3V0IGNvcHlsZWZ0IHJlc3RyaWN0aW9ucyBvciBwYXRlbnQgcmlza1x1MjAxNGlkZWFsIGZvciBleHBlcmltZW50YXRpb24sIGN1c3RvbWl6YXRpb24sIGFuZCBjb21tZXJjaWFsIGRlcGxveW1lbnQuXG4tICoqQ29uZmlndXJhYmxlIHJlYXNvbmluZyBlZmZvcnQ6KiogRWFzaWx5IGFkanVzdCB0aGUgcmVhc29uaW5nIGVmZm9ydCAobG93LCBtZWRpdW0sIGhpZ2gpIGJhc2VkIG9uIHlvdXIgc3BlY2lmaWMgdXNlIGNhc2UgYW5kIGxhdGVuY3kgbmVlZHMuXG4tICoqRnVsbCBjaGFpbi1vZi10aG91Z2h0OioqIEdhaW4gY29tcGxldGUgYWNjZXNzIHRvIHRoZSBtb2RlbCdzIHJlYXNvbmluZyBwcm9jZXNzLCBmYWNpbGl0YXRpbmcgZWFzaWVyIGRlYnVnZ2luZyBhbmQgaW5jcmVhc2VkIHRydXN0IGluIG91dHB1dHMuIEl0J3Mgbm90IGludGVuZGVkIHRvIGJlIHNob3duIHRvIGVuZCB1c2Vycy5cbi0gKipGaW5lLXR1bmFibGU6KiogRnVsbHkgY3VzdG9taXplIG1vZGVscyB0byB5b3VyIHNwZWNpZmljIHVzZSBjYXNlIHRocm91Z2ggcGFyYW1ldGVyIGZpbmUtdHVuaW5nLlxuLSAqKkFnZW50aWMgY2FwYWJpbGl0aWVzOioqIFVzZSB0aGUgbW9kZWxzJyBuYXRpdmUgY2FwYWJpbGl0aWVzIGZvciBmdW5jdGlvbiBjYWxsaW5nLCB3ZWIgYnJvd3NpbmcsIHB5dGhvbiBjb2RlIGV4ZWN1dGlvbiwgYW5kIHN0cnVjdHVyZWQgb3V0cHV0cy5cblxuVGhpcyBtb2RlbCBpcyByZWFkeSBmb3IgY29tbWVyY2lhbC9ub24tY29tbWVyY2lhbCB1c2UuXG5cbiMjIFRoaXJkLVBhcnR5IENvbW11bml0eSBDb25zaWRlcmF0aW9uIDxicj5cblRoaXMgbW9kZWwgaXMgbm90IG93bmVkIG9yIGRldmVsb3BlZCBieSBOVklESUEuIFRoaXMgbW9kZWwgaGFzIGJlZW4gZGV2ZWxvcGVkIGFuZCBidWlsdCB0byBhIHRoaXJkLXBhcnR5XHUyMDE5cyByZXF1aXJlbWVudHMgZm9yIHRoaXMgYXBwbGljYXRpb24gYW5kIHVzZSBjYXNlOyBzZWUgbGluayB0byBOb24tTlZJRElBIFtncHQtb3NzLTIwYiBtb2RlbCBjYXJkXShodHRwczovL2h1Z2dpbmdmYWNlLmNvL29wZW5haS9ncHQtb3NzLTIwYikuXG5cbiMjIyBMaWNlbnNlIGFuZCBUZXJtcyBvZiBVc2U6IDxicj5cblxuR09WRVJOSU5HIFRFUk1TOiBUaGUgTklNIGNvbnRhaW5lciBpcyBnb3Zlcm5lZCBieSB0aGUgW05WSURJQSBTb2Z0d2FyZSBMaWNlbnNlIEFncmVlbWVudF0oYXQgaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLXNvZnR3YXJlLWxpY2Vuc2UtYWdyZWVtZW50LykgYW5kIHRoZSBbUHJvZHVjdC1TcGVjaWZpYyBUZXJtcyBmb3IgTlZJRElBIEFJIFByb2R1Y3RzXShodHRwczovL3d3dy5udmlkaWEuY29tL2VuLXVzL2FncmVlbWVudHMvZW50ZXJwcmlzZS1zb2Z0d2FyZS9wcm9kdWN0LXNwZWNpZmljLXRlcm1zLWZvci1haS1wcm9kdWN0cy8pOyBhbmQgdGhlIHVzZSBvZiB0aGlzIG1vZGVsIGlzIGdvdmVybmVkIGJ5IHRoZSBbTlZJRElBIENvbW11bml0eSBNb2RlbCBMaWNlbnNlIEFncmVlbWVudF0oaHR0cHM6Ly93d3cubnZpZGlhLmNvbS9lbi11cy9hZ3JlZW1lbnRzL2VudGVycHJpc2Utc29mdHdhcmUvbnZpZGlhLWNvbW11bml0eS1tb2RlbHMtbGljZW5zZS8pLlxuQWRkaXRpb25hbCBJbmZvcm1hdGlvbjogW0FwYWNoZSBMaWNlbnNlIFZlcnNpb24gMi4wXShodHRwczovL3d3dy5hcGFjaGUub3JnL2xpY2Vuc2VzL0xJQ0VOU0UtMi4wKS5cblxuKipZb3UgYXJlIHJlc3BvbnNpYmxlIGZvciBlbnN1cmluZyB0aGF0IHlvdXIgdXNlIG9mIE5WSURJQSBwcm92aWRlZCBtb2RlbHMgY29tcGxpZXMgd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzKipcblxuIyMgR2V0IEhlbHBcblxuIyMjIEVudGVycHJpc2UgU3VwcG9ydFxuXG5HZXQgYWNjZXNzIHRvIGtub3dsZWRnZSBiYXNlIGFydGljbGVzIGFuZCBzdXBwb3J0IGNhc2VzIG9yIFtzdWJtaXQgYSB0aWNrZXRdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvZGF0YS1jZW50ZXIvcHJvZHVjdHMvYWktZW50ZXJwcmlzZS1zdWl0ZS9zdXBwb3J0LykuXG5cbiMjIyBOVklESUEgTklNIERvY3VtZW50YXRpb25cblxuVmlzaXQgdGhlIFtOSU0gQ29udGFpbmVyIExMTV0oaHR0cHM6Ly9kb2NzLm52aWRpYS5jb20vbmltL2xhcmdlLWxhbmd1YWdlLW1vZGVscy9sYXRlc3QvaW50cm9kdWN0aW9uLmh0bWwpIHBhZ2UgZm9yIHJlbGVhc2UgZG9jdW1lbnRhdGlvbiwgZGVwbG95bWVudCBndWlkZXMgYW5kIG1vcmUuXG5cblxuIyMjIERlcGxveW1lbnQgR2VvZ3JhcGh5OlxuR2xvYmFsXG5cbiMjIyBVc2UgQ2FzZTogPGJyPlxuSW50ZW5kZWQgZm9yIHVzZSBhcyBhIHJlYXNvbmluZyBtb2RlbCwgb2ZmZXJpbmcgZmVhdHVyZXMgbGlrZSBjaGFpbi1vZi10aG91Z2h0IGFuZCBhZGp1c3RhYmxlIHJlYXNvbmluZyBlZmZvcnQgbGV2ZWxzLiBJdCBwcm92aWRlcyBjb21wcmVoZW5zaXZlIHN1cHBvcnQgZm9yIGluc3RydWN0aW9uIGZvbGxvd2luZyBhbmQgdG9vbCB1c2UsIGZvc3RlcmluZyB0cmFuc3BhcmVuY3ksIGN1c3RvbWl6YXRpb24sIGFuZCBkZXBsb3ltZW50IGZsZXhpYmlsaXR5IGZvciBkZXZlbG9wZXJzLCByZXNlYXJjaGVycywgYW5kIHN0YXJ0dXBzLiBDcnVjaWFsbHksIGl0IGVuYWJsZXMgZW50ZXJwcmlzZXMgYW5kIGdvdmVybm1lbnRzIHRvIGRlcGxveSBvbi1wcmVtaXNlcyBvciBpbiBwcml2YXRlIGNsb3VkcywgZW5zdXJpbmcgc3RyaW5nZW50IGRhdGEgc2VjdXJpdHkgYW5kIHByaXZhY3kgcmVxdWlyZW1lbnRzIGFyZSBtZXQuXG5cbiMjIyBSZWxlYXNlIERhdGU6ICA8YnI+XG5CdWlsZC5OVklESUEuY29tIC0gMDgvMDUvMjAyNSB2aWEgW2xpbmtdKGh0dHBzOi8vYnVpbGQubnZpZGlhLmNvbS9vcGVuYWkvZ3B0LW9zcy0yMGIpIDxicj4gXG5IdWdnaW5nIEZhY2UgLSAwOC8wNS8yMDI1IHZpYSBbbGlua10oaHR0cHM6Ly9odWdnaW5nZmFjZS5jby9vcGVuYWkvZ3B0LW9zcy0yMGIpIDxicj5cblxuIyMgUmVmZXJlbmNlKHMpOlxuLSBbT3BlbkFJIENvb2tib29rXShodHRwczovL2Nvb2tib29rLm9wZW5haS5jb20vKVxuLSBbT3BlbiBBSSBDb29ia2Jvb2sgLS0gU2VydmluZyBNb2RlbCB3aXRoIFRlbnNvclJULUxMTV0oaHR0cHM6Ly9jb29rYm9vay5vcGVuYWkuY29tL2FydGljbGVzL2dwdC1vc3MvcnVuLW52aWRpYSlcblxuXG4jIyBNb2RlbCBBcmNoaXRlY3R1cmU6IDxicj4gXG4qKkFyY2hpdGVjdHVyZSBUeXBlOioqIFRyYW5zZm9ybWVyIDxicj5cbioqTmV0d29yayBBcmNoaXRlY3R1cmU6KiogTWl4dHVyZS1vZi1FeHBlcnRzIChNb0UpIDxicj5cbioqVG90YWwgUGFyYW1ldGVyczoqKiAyMEIgPGJyPlxuKipBY3RpdmUgUGFyYW1ldGVyczoqKiA0QiA8YnI+XG4qKlZvY2FidWxhcnkgU2l6ZToqKiAyMDEsMDg4IChVdGlsaXplcyB0aGUgc3RhbmRhcmQgdG9rZW5pemVyIHVzZWQgYnkgR1BULTRvKSA8YnI+XG5cblxuIyMgSW5wdXQ6IDxicj5cbioqSW5wdXQgVHlwZShzKToqKiBUZXh0IDxicj5cbioqSW5wdXQgRm9ybWF0KHMpOioqIFN0cmluZyA8YnI+XG4qKklucHV0IFBhcmFtZXRlcnM6KiogT25lIERpbWVuc2lvbmFsICgxRCkgPGJyPlxuKipPdGhlciBQcm9wZXJ0aWVzIFJlbGF0ZWQgdG8gSW5wdXQ6KiogVXNlcyBSb1BFIHdpdGggYSAxMjhrIGNvbnRleHQgbGVuZ3RoLCB3aXRoIGF0dGVudGlvbiBsYXllcnMgYWx0ZXJuYXRpbmcgYmV0d2VlbiBmdWxsIGNvbnRleHQgYW5kIGEgc2xpZGluZyAxMjgtdG9rZW4gd2luZG93LiBJbmNsdWRlcyBhIGxlYXJuZWQgYXR0ZW50aW9uIHNpbmsgcGVyLWhlYWQuIEVtcGxveXMgU3dpR0xVIGFjdGl2YXRpb25zIGluIHRoZSBNb0UgbGF5ZXJzLCBhbmQgdGhlIHJvdXRlciBwZXJmb3JtcyBhIFRvcC1LIG9wZXJhdGlvbiAoSz00KSBmb2xsb3dlZCBieSBhIFNpZ21vaWQgZnVuY3Rpb24uIEdFTU1zIGluIHRoZSBNb0UgaW5jbHVkZSBhIHBlci1leHBlcnQgYmlhcy4gVXRpbGl6ZXMgdGlrdG9rZW4gZm9yIHRva2VuaXphdGlvbi4gSW5wdXQgQ29udGV4dCBMZW5ndGggKElTTCk6IDEyODAwMCA8YnI+XG5cbiMjIE91dHB1dDogPGJyPlxuKipPdXRwdXQgVHlwZShzKToqKiBUZXh0IDxicj5cbioqT3V0cHV0IEZvcm1hdDoqKiBTdHJpbmcgPGJyPlxuKipPdXRwdXQgUGFyYW1ldGVyczoqKiBPbmUgRGltZW5zaW9uYWwgKDFEKSA8YnI+XG4qKk90aGVyIFByb3BlcnRpZXMgUmVsYXRlZCB0byBPdXRwdXQ6KiogVGhlIG1vZGVsIGlzIGFyY2hpdGVjdGVkIHRvIGJlIGNvbXBhdGlibGUgd2l0aCB0aGUgT3BlbkFJIFJlc3BvbnNlcyBBUEkgYW5kIHN1cHBvcnRzIFN0cnVjdHVyZWQgT3V0cHV0LCBhbGlnbmluZyB3aXRoIGtleSBwYXJ0bmVyIGV4cGVjdGF0aW9ucyBmb3IgYWR2YW5jZWQgcmVzcG9uc2UgZm9ybWF0dGluZy4gPGJyPiBcblxuT3VyIEFJIG1vZGVscyBhcmUgZGVzaWduZWQgYW5kL29yIG9wdGltaXplZCB0byBydW4gb24gTlZJRElBIEdQVS1hY2NlbGVyYXRlZCBzeXN0ZW1zIFtvciBuYW1lIGVxdWl2YWxlbnQgaGFyZHdhcmUgcHJlZmVyZW5jZV0uIEJ5IGxldmVyYWdpbmcgTlZJRElBXHUyMDE5cyBoYXJkd2FyZSAoZS5nLiBHUFUgY29yZXMpIGFuZCBzb2Z0d2FyZSBmcmFtZXdvcmtzIChlLmcuLCBDVURBIGxpYnJhcmllcyksIHRoZSBtb2RlbCBhY2hpZXZlcyBmYXN0ZXIgdHJhaW5pbmcgYW5kIGluZmVyZW5jZSB0aW1lcyBjb21wYXJlZCB0byBDUFUtb25seSBzb2x1dGlvbnMuIDxicj4gICBcblxuIyMgU29mdHdhcmUgSW50ZWdyYXRpb246IDxicj5cbioqUnVudGltZSBFbmdpbmUocyk6KiogPGJyPlxuKiBOZU1vIEZyYW1ld29yayAoYmFzZWQgb24gMjUuMDcpPGJyPlxuXG5cbioqU3VwcG9ydGVkIEhhcmR3YXJlIE1pY3JvYXJjaGl0ZWN0dXJlIENvbXBhdGliaWxpdHk6KiogPGJyPlxuKiBOVklESUEgQmxhY2t3ZWxsOiBCMjAwIDxicj5cbiogTlZJRElBIEhvcHBlcjogSDIwMFxuXG5cbioqT3BlcmF0aW5nIFN5c3RlbShzKToqKiBMaW51eCBcblxuIyMgTW9kZWwgVmVyc2lvbihzKTogXG5gZ3B0LW9zcy0yMGJgIHYxLjAgKEF1Z3VzdCA1LCAyMDI1KVxuXG5cbiMjIFRyYWluaW5nLCBUZXN0aW5nLCBhbmQgRXZhbHVhdGlvbiBEYXRhc2V0czogPGJyPiAgIFxuIyMjIFRyYWluaW5nIERhdGFzZXQ6XG5cbiogKipUcmFpbmluZyBEYXRhIENvbGxlY3Rpb246KiogVW5kaXNjbG9zZWQgPGJyPlxuKiAqKlRyYWluaW5nIExhYmVsaW5nOioqIFVuZGlzY2xvc2VkIDxicj5cbiogKipUcmFpbmluZyBQcm9wZXJ0aWVzOioqIFRoZSBncHQtb3NzLTIwYiBtb2RlbCBoYXMgYXBwcm94aW1hdGVseSAyMCBiaWxsaW9uIHRvdGFsIHBhcmFtZXRlcnMsIHdpdGggYXBwcm94aW1hdGVseSA0IGJpbGxpb24gYWN0aXZlIHBhcmFtZXRlcnMgcGVyIGluZmVyZW5jZS4gVGhlIHdlaWdodHMgZm9yIGFsbCBsYXllcnMgYXJlIGluIEJGMTYsIGV4Y2VwdCBmb3IgdGhlIE1vRSBwcm9qZWN0aW9uIHdlaWdodHMsIHdoaWNoIGFyZSBpbiBNWEZQNC4gVGhlIHJlZmVyZW5jZSBpbXBsZW1lbnRhdGlvbiwgZm9yIGluaXRpYWwgYWNjdXJhY3kgdmFsaWRhdGlvbiwgY3VycmVudGx5IHVwY2FzdHMgYWxsIHdlaWdodHMgdG8gQkYxNi4gQWN0aXZhdGlvbnMgYXJlIGV4cGVjdGVkIHRvIGJlIGluIEJGMTYgb3IgRlA4LlxuXG5cbiMjIyBUZXN0aW5nIERhdGFzZXQ6XG4qICoqVGVzdGluZyBEYXRhIENvbGxlY3Rpb246KiogVW5kaXNjbG9zZWQgPGJyPlxuKiAqKlRlc3RpbmcgTGFiZWxpbmc6KiogVW5kaXNjbG9zZWQgPGJyPlxuKiAqKlRlc3RpbmcgUHJvcGVydGllczoqKiBUaGUgbW9kZWwncyBwZXJmb3JtYW5jZSBpcyB0ZXN0ZWQgYWdhaW5zdCByZWNvZ25pemVkIGJlbmNobWFya3Mgc3VjaCBhcyBNTUxVIChNYXNzaXZlIE11bHRpdGFzayBMYW5ndWFnZSBVbmRlcnN0YW5kaW5nKSBhbmQgR1BRQSAoR2VuZXJhbCBQdXJwb3NlIFF1ZXN0aW9uIEFuc3dlcmluZyksIGFsb25nc2lkZSBvdGhlciBiZW5jaG1hcmtzIGluY2x1ZGluZyBMaXZlQ29kZUJlbmNoLCBBSU1FIDIwMjQsIGFuZCBNQVRILTUwMCBcblxuIyMjIEV2YWx1YXRpb24gRGF0YXNldDpcblxuKiAqKkV2YWx1YXRpb24gRGF0YSBDb2xsZWN0aW9uOioqIFVuZGlzY2xvc2VkIDxicj5cbiogKipFdmFsdWF0aW9uIExhYmVsaW5nOioqIFVuZGlzY2xvc2VkIDxicj5cbiogKipFdmFsdWF0aW9uIEJlbmNobWFyayBTY29yZToqKiBcblxufCBCZW5jaG1hcmsgIHwgZ3B0LW9zcy0xMjBiIHwgZ3B0LW9zcy0yMGIgfFxufC0tLS0tLS0tLS18LS0tLS0tLS0tLS18IC0tLS0tLS0tLS0tfFxufCBBSU1FIDIwMjQgKG5vIHRvb2xzKSB8IDk1LjggICB8IDkyLjEgfFxufCBBSU1FIDIwMjQgKHdpdGggdG9vbHMpIHwgOTYuNiB8IDk2LjAgfFxufCBBSU1FIDIwMjUgKG5vIHRvb2xzKSB8IDkyLjUgIHwgOTEuNyB8XG58IEFJTUUgMjAyNSAod2l0aCB0b29scykgfCA5Ny45IHwgOTguNyB8XG58IEdQUUEgRGlhbW9uZCAobm8gdG9vbHMpIHwgODAuMSB8IDcxLjUgfFxufCBHUFFBIERpYW1vbmQgKHdpdGggdG9vbHMpIHwgODAuOSB8IDc0LjIgfFxufCBITEUgKG5vIHRvb2xzKSB8IDE0LjkgfCAxMC45IHxcbnwgSExFICh3aXRoIHRvb2xzKSB8IDE5LjAgfCAxNy4zIHxcbnwgTU1MVSB8IDkwLjAgfCA4NS4zIHxcbnwgU1dFLUJlbmNoIFZlcmlmaWVkIHwgNjIuNCB8IDYwLjcgfFxufCBUYXUtQmVuY2ggUmV0YWlsIHwgNjcuOCB8IDU0LjQgfFxufCBUYXUtQmVuY2ggQWlybGluZSB8IDQ5LjIgfCAzOC4wIHxcbnwgQWlkZXIgUG9seWdsb3QgfCA0NC40IHwgMzQuMiB8XG58IE1NTUxVIChBdmVyYWdlKSB8IDgxLjMgfCA3NS42IHxcbnwgSGVhbHRoQmVuY2ggfCA1Ny42IHwgNDIuNSB8XG58IEhlYWx0aEJlbmNoIEhhcmQgfCAzMC4wIHwgMTAuOCB8XG58IEhlYWx0aEJlbmNoIENvbnNlbnN1cyB8IDg5LjkgfCA4Mi42IHxcbnwgQ29kZWZvcmNlcyAobm8gdG9vbHMpIFtlbG9dIHwgMjQ2MyB8IDIyMzAgfFxufCBDb2RlZm9yY2VzICh3aXRoIHRvb2xzKSBbZWxvXSB8IDI2MjIgfCAyNTE2IHxcblxuQWJvdmUgc2NvcmVzIHdlcmUgbWVhc3VyZWQgZm9yIHRoZSBoaWdoIHJlYXNvbmluZyBsZXZlbC5cblxuIyMjIFNhZmV0eSBSZXN1bHRzOlxuXG5UaGUgZm9sbG93aW5nIGV2YWx1YXRpb25zIGNoZWNrIHRoYXQgdGhlIG1vZGVsIGRvZXMgbm90IGNvbXBseSB3aXRoIHJlcXVlc3RzIGZvciBjb250ZW50IHRoYXQgaXNcbmRpc2FsbG93ZWQgdW5kZXIgT3BlbkFJXHUyMDE5cyBzYWZldHkgcG9saWNpZXMsIGluY2x1ZGluZyBoYXRlZnVsIGNvbnRlbnQgb3IgaWxsaWNpdCBhZHZpY2UuXG5cbnwgQ2F0ZWdvcnkgIHwgZ3B0LW9zcy0xMjBiIHwgZ3B0LW9zcy0yMGIgfFxufC0tLS0tLS0tLS18LS0tLS0tLS0tLS18IC0tLS0tLS0tLS0tfFxufCBoYXRlIChhZ2dyZWdhdGUpIHwgMC45OTYgICB8IDAuOTk2IHxcbnwgc2VsZi1oYXJtL2ludGVudCBhbmQgc2VsZmhhcm0vaW5zdHJ1Y3Rpb25zIHwgMC45OTUgfCAwLjk4NCB8XG58IHBlcnNvbmFsIGRhdGEvc2VtaSByZXN0cmljdGl2ZSB8IDAuOTY3ICB8IDAuOTQ3IHxcbnwgc2V4dWFsL2V4cGxvaXRhdGl2ZSB8IDEuMDAwIHwgMC45ODAgfFxufCBzZXh1YWwvbWlub3JzIHwgMS4wMDAgfCAwLjk3MSB8XG58IGlsbGljaXQvbm9uLXZpb2xlbnQgfCAxLjAwMCB8IDAuOTgzIHxcbnwgaWxsaWNpdC92aW9sZW50IHwgMS4wMDAgfCAxLjAwMCB8XG58IHBlcnNvbmFsIGRhdGEvcmVzdHJpY3RlZCB8IDAuOTk2IHwgMC45NzggfFxuXG4jIyBJbmZlcmVuY2U6XG4qKkFjY2VsZXJhdGlvbiBFbmdpbmU6KiogdkxMTSA8YnI+XG4qKlRlc3QgSGFyZHdhcmU6KiogTlZJRElBIEhvcHBlciAoSDIwMCkgPGJyPlxuXG5cbiMjIEFkZGl0aW9uYWwgRGV0YWlsc1xuVGhlIG1vZGVsIGlzIHJlbGVhc2VkIHdpdGggdGhlIG5hdGl2ZSBxdWFudGl6YXRpb24gc3VwcG9ydC4gU3BlY2lmaWNhbGx5LCBbTVhGUDRdKGh0dHBzOi8vd3d3Lm9wZW5jb21wdXRlLm9yZy9kb2N1bWVudHMvb2NwLW1pY3Jvc2NhbGluZy1mb3JtYXRzLW14LXYxLTAtc3BlYy1maW5hbC1wZGYpIGlzIHVzZWQgZm9yIHRoZSBsaW5lYXIgcHJvamVjdGlvbiB3ZWlnaHRzIGluIHRoZSBNb0UgbGF5ZXIuIEl0IGlzIHN0b3JlZCB0aGUgTW9FIHRlbnNvciBpbiB0d28gcGFydHM6XG5cbi0gYHRlbnNvci5ibG9ja3NgIHN0b3JlcyB0aGUgYWN0dWFsIGZwNCB2YWx1ZXMuIEV2ZXJ5IHR3byB2YWx1ZXMgYXJlIHBhY2tlZCBpbiBvbmUgYHVpbnQ4YCB2YWx1ZS5cbi0gYHRlbnNvci5zY2FsZXNgIHN0b3JlcyB0aGUgYmxvY2sgc2NhbGUuIFRoZSBibG9jayBzY2FsaW5nIGlzIGRvbmUgYW1vbmcgdGhlIGxhc3QgZGltZW5zaW9uIGZvciBhbGwgTVhGUDQgdGVuc29ycy5cblxuQWxsIG90aGVyIHRlbnNvcnMgYXJlIHN0b3JlZCBpbiBCRjE2LiBJdCBpcyByZWNvbW1lbmRlZCB0byB1c2UgQkYxNiBhcyB0aGUgYWN0aXZhdGlvbiBwcmVjaXNpb24gZm9yIHRoZSBtb2RlbC5cblxuIyMgRXRoaWNhbCBDb25zaWRlcmF0aW9uczpcbk5WSURJQSBiZWxpZXZlcyBUcnVzdHdvcnRoeSBBSSBpcyBhIHNoYXJlZCByZXNwb25zaWJpbGl0eSBhbmQgd2UgaGF2ZSBlc3RhYmxpc2hlZCBwb2xpY2llcyBhbmQgcHJhY3RpY2VzIHRvIGVuYWJsZSBkZXZlbG9wbWVudCBmb3IgYSB3aWRlIGFycmF5IG9mIEFJIGFwcGxpY2F0aW9ucy4gIFdoZW4gZG93bmxvYWRlZCBvciB1c2VkIGluIGFjY29yZGFuY2Ugd2l0aCBvdXIgdGVybXMgb2Ygc2VydmljZSwgZGV2ZWxvcGVycyBzaG91bGQgd29yayB3aXRoIHRoZWlyIGludGVybmFsIG1vZGVsIHRlYW0gdG8gZW5zdXJlIHRoaXMgbW9kZWwgbWVldHMgcmVxdWlyZW1lbnRzIGZvciB0aGUgcmVsZXZhbnQgaW5kdXN0cnkgYW5kIHVzZSBjYXNlIGFuZCBhZGRyZXNzZXMgdW5mb3Jlc2VlbiBwcm9kdWN0IG1pc3VzZS4gIFxuXG5QbGVhc2UgcmVwb3J0IHNlY3VyaXR5IHZ1bG5lcmFiaWxpdGllcyBvciBOVklESUEgQUkgQ29uY2VybnMgW2hlcmVdKGh0dHBzOi8vd3d3Lm52aWRpYS5jb20vZW4tdXMvc3VwcG9ydC9zdWJtaXQtc2VjdXJpdHktdnVsbmVyYWJpbGl0eS8pLiIsCiAgICAiZGlzcGxheU5hbWUiOiAiR1BULU9TUy0yMEIiLAogICAgImV4cGxhaW5hYmlsaXR5IjogIiIsCiAgICAiZnJhbWV3b3JrIjogIk90aGVyIiwKICAgICJoYXNQbGF5Z3JvdW5kIjogZmFsc2UsCiAgICAiaGFzU2lnbmVkVmVyc2lvbiI6IHRydWUsCiAgICAiaXNQbGF5Z3JvdW5kRW5hYmxlZCI6IGZhbHNlLAogICAgImlzUHVibGljIjogZmFsc2UsCiAgICAiaXNSZWFkT25seSI6IHRydWUsCiAgICAibGFiZWxzIjogWwogICAgICAgICJOU1BFQ1QtU1c1VS1MQ1lXIiwKICAgICAgICAiU2lnbmVkIE1vZGVscyIsCiAgICAgICAgIm52YWllOm1vZGVsOm52YWllX3N1cHBvcnRlZCIsCiAgICAgICAgIm52aWRpYV9uaW06bW9kZWw6bmltbWNyb19udmlkaWFfbmltIiwKICAgICAgICAicHJvZHVjdE5hbWVzOm5pbS1kZXYiLAogICAgICAgICJwcm9kdWN0TmFtZXM6bnYtYWktZW50ZXJwcmlzZSIKICAgIF0sCiAgICAibGF0ZXN0VmVyc2lvbklkU3RyIjogImhmLWQ2NjZjZjMtbmltIiwKICAgICJsYXRlc3RWZXJzaW9uU2l6ZUluQnl0ZXMiOiAxMzc4OTI2Mzk1MSwKICAgICJsb2dvIjogImh0dHBzOi8vYXNzZXRzLm5nYy5udmlkaWEuY29tL3Byb2R1Y3RzL2FwaS1jYXRhbG9nL2ltYWdlcy9ncHQtb3NzLTIwYi5qcGciLAogICAgIm1vZGVsRm9ybWF0IjogIlNhdmVkTW9kZWwiLAogICAgIm5hbWUiOiAiZ3B0LW9zcy0yMGIiLAogICAgIm9yZ05hbWUiOiAibmltIiwKICAgICJwcmVjaXNpb24iOiAiT1RIRVIiLAogICAgInByaXZhY3kiOiAiIiwKICAgICJwcm9kdWN0TmFtZXMiOiBbCiAgICAgICAgIm5pbS1kZXYiLAogICAgICAgICJudi1haS1lbnRlcnByaXNlIgogICAgXSwKICAgICJwdWJsaWNEYXRhc2V0VXNlZCI6IHt9LAogICAgInB1Ymxpc2hlciI6ICJPcGVuQUkiLAogICAgInNhZmV0eUFuZFNlY3VyaXR5IjogIiIsCiAgICAic2hvcnREZXNjcmlwdGlvbiI6ICJPcGVuQUkgcmVsZWFzZXMgdGhlIGdwdC1vc3MgZmFtaWx5IG9mIG9wZW4td2VpZ2h0IG1vZGVscyBkZXNpZ25lZCBmb3IgcG93ZXJmdWwgcmVhc29uaW5nLCBhZ2VudGljIHRhc2tzLCBhbmQgdmVyc2F0aWxlIGRldmVsb3BlciB1c2UgY2FzZXMuIiwKICAgICJ0ZWFtTmFtZSI6ICJvcGVuYWkiLAogICAgInVwZGF0ZWREYXRlIjogIjIwMjUtMDktMDRUMjA6MTU6MTQuMzcwWiIKfQ== source: URL: https://catalog.ngc.nvidia.com/orgs/nim/teams/openai/containers/gpt-oss-20b optimizationProfiles: - profileId: nim/openai/gpt-oss-20b:hf-d666cf3-nim-tp4 framework: VLLM displayName: GPT-OSS 20B Generic NVIDIA GPUx4 MXFP4 ngcMetadata: 653e98d21f9274306416d736519e1c0442d9dad9d8756ff1134cbededfd43323: model: openai/gpt-oss-20b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: bef4d428df8c3e67ebe56ba2050a0f50216e82c0172407b43c99c1f6befc9fc5 pp: '1' precision: mxfp4 tp: '4' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 4 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 13GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-20b:hf-d666cf3-nim-tp8 framework: VLLM displayName: GPT-OSS 20B Generic NVIDIA GPUx8 MXFP4 ngcMetadata: 66b8ec445352535aa8c640435d6f7b00fb2cabb70f8d39fc371adb00322907df: model: openai/gpt-oss-20b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: bef4d428df8c3e67ebe56ba2050a0f50216e82c0172407b43c99c1f6befc9fc5 pp: '1' precision: mxfp4 tp: '8' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 8 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 13GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-20b:hf-d666cf3-nim framework: VLLM displayName: GPT-OSS 20B Generic NVIDIA GPUx1 MXFP4 ngcMetadata: 66fb3113efd2aae1b0a3bfa2a375de5fe1cc1b557abac4eb271730482a26ae8e: model: openai/gpt-oss-20b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: bef4d428df8c3e67ebe56ba2050a0f50216e82c0172407b43c99c1f6befc9fc5 pp: '1' precision: mxfp4 tp: '1' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 1 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 13GB - key: LLM ENGINE value: VLLM - profileId: nim/openai/gpt-oss-20b:hf-d666cf3-nim-tp2 framework: VLLM displayName: GPT-OSS 20B Generic NVIDIA GPUx2 MXFP4 ngcMetadata: c3035169e189674226b284a07173f495b6ce13f2a06d5ea204f1e505c2fac2be: model: openai/gpt-oss-20b release: 1.12.4 tags: feat_lora: 'false' llm_engine: vllm nim_workspace_hash_v1: bef4d428df8c3e67ebe56ba2050a0f50216e82c0172407b43c99c1f6befc9fc5 pp: '1' precision: mxfp4 tp: '2' modelFormat: vllm spec: - key: PRECISION value: MXFP4 - key: COUNT value: 2 - key: NIM VERSION value: 1.12.4 - key: DOWNLOAD SIZE value: 13GB - key: LLM ENGINE value: VLLM labels: - OpenAI - signed images - NSPECT-LJGD-9W15 - NVIDIA AI Enterprise Supported - NVIDIA NIM config: architectures: - Other modelType: NIM license: NVIDIA AI Foundation Models Community License - name: Gemma 2 displayName: Gemma 2 modelHubID: gemma-2 category: Language type: HF description: Google's open-weight language model family optimized for text generation, question answering, summarization, and reasoning. Improved performance and safety over its predecessor. modelVariants: - variantId: Gemma 2 9B displayName: Gemma 2 9B source: URL: https://huggingface.co/google/gemma-2-9b requireToken: true requireLicense: true licenseAgreements: - label: License Agreement url: https://ai.google.dev/gemma/terms - label: Use Policy url: https://ai.google.dev/gemma/prohibited_use_policy optimizationProfiles: - profileId: google/gemma-2-9b displayName: Gemma 2 9b A10G framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: A10G - key: COUNT value: 1 - profileId: google/gemma-2-9b displayName: Gemma 2 A100 framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: A100 - key: COUNT value: 1 - profileId: google/gemma-2-9b displayName: Gemma 2 9b L40S framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: L40S - key: COUNT value: 1 labels: - google - Gemma - "Text Generation" - "Multilingual support" config: architectures: - Gemma2ForCausalLM modelType: Gemma2 license: gemma - name: Llama 3 SQLCoder displayName: Llama 3 SQLCoder modelHubID: llama-3-sqlcoder-8b category: Code type: HF description: Text-to-SQL model supporting Postgres, Redshift, and Snowflake dialects. Frontier-level accuracy for natural language database querying. modelVariants: - variantId: Llama 3 SQLCoder 8B displayName: Llama 3 SQLCoder 8B source: URL: https://huggingface.co/defog/llama-3-sqlcoder-8b requireToken: false requireLicense: false licenseAgreements: - label: License Agreement url: https://choosealicense.com/licenses/cc-by-sa-4.0/ optimizationProfiles: - profileId: defog/llama-3-sqlcoder-8b displayName: Llama 3 SQLCoder 8B A10G framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: A10G - key: COUNT value: 1 - profileId: defog/llama-3-sqlcoder-8b displayName: Llama 3 SQLCoder 8B A100 framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: A100 - key: COUNT value: 1 - profileId: defog/llama-3-sqlcoder-8b displayName: Llama 3 SQLCoder 8B L40S framework: vllm sha: vllm modelFormat: vllm spec: - key: GPU value: L40S - key: COUNT value: 1 labels: - Llama - "Text To SQL" - "Code Generation" - "Fine Tuned" config: architectures: - LlamaForCausalLM modelType: llama license: Creative Commons Attribution Share Alike 4.0