--- layout: home title: node-llama-cpp titleTemplate: Run AI models locally on your machine hero: name: "node-llama-cpp" text: "Run AI models locally on your machine" tagline: node.js bindings for llama.cpp, and much more actions: - theme: brand text: Get Started link: /guide/ - theme: alt text: API Reference link: /api/functions/getLlama image: src: /logo.jpg alt: node-llama-cpp Logo width: 320 height: 320 features: - icon: 🌟 title: Easy to use details: | Zero-config by default. Works in Node.js, Bun, and Electron. Bootstrap a project with a single command link: /guide/ linkText: Learn more - icon: 🚀 title: Metal, CUDA and Vulkan support details: Adapts to your hardware automatically to run models with maximum performance link: /guide/#gpu-support linkText: Learn more - icon: 📦 title: Native binaries details: Pre-built binaries are provided, with a fallback to building from source without node-gyp or Python link: /guide/building-from-source linkText: Learn more - icon: title: Powerful features details: Force a model to generate output according to a JSON schema, provide a model with functions it can call on demand, and much more link: /guide/grammar#json-schema linkText: Learn more ---