---
warning: DO NOT CHANGE THIS MANUALLY, THIS IS GENERATED BY https://github.com/duckdb/community-extensions repository, check README there
title: databricks
excerpt: |
  DuckDB Community Extensions
  Read and write Databricks tables directly from DuckDB.

extension:
  name: databricks
  description: Read and write Databricks tables directly from DuckDB.
  version: 0.2.0
  language: C++
  build: cmake
  license: MIT
  excluded_platforms: "wasm_mvp;wasm_eh;wasm_threads;windows_amd64_mingw"
  requires_toolchains: "vcpkg"
  maintainers:
    - redox
  vcpkg_commit: 84bab45d415d22042bd0b9081aea57f362da3f35

repo:
  github: altertable-ai/duckdb-databricks
  ref: f4251bf80648e6b8321e99b251fc4ab4457ab35b
  variegata: 272162459a35364c0cb5639b2bc035bb8591d826

docs:
  hello_world: |
    INSTALL databricks FROM community;
    LOAD databricks;

    CREATE SECRET dbx (
        TYPE databricks,
        HOST 'adb-123.azuredatabricks.net',
        WAREHOUSE_ID 'abc123',
        TOKEN 'dapi...'
    );
    ATTACH 'main' AS db (TYPE databricks, SECRET dbx, SCHEMA 'sales');

    SELECT * FROM db.orders;

    INSERT INTO db.orders
    SELECT * FROM read_parquet('orders/*.parquet');
  extended_description: |
    The Databricks extension attaches one Unity Catalog catalog as a DuckDB
    database. Tables are read and written with ordinary DuckDB SQL through the
    SQL Statement Execution API. It does not read Delta files, and it does not
    open a Thrift session. Filters, projections, `LIMIT`, and
    `ORDER BY ... LIMIT` can be pushed down to the warehouse.

    Features include:
    - `ATTACH` support for a Databricks catalog, including secrets for a personal access token or a service principal
    - reads from attached schemas and tables
    - writes with `INSERT`, `COPY`, `CREATE TABLE AS`, `UPDATE`, `DELETE`, and `TRUNCATE`
    - `databricks_query` and `databricks_execute` for Databricks SQL that DuckDB cannot express

extension_star_count: 3
extension_star_count_pretty: 3
extension_download_count: 2083
extension_download_count_pretty: 2.1k
image: '/images/community_extensions/social_preview/preview_community_extension_databricks.png'
layout: community_extension_doc
---
### Compatibility Matrix

This table covers all DuckDB releases that have not reached [end-of-life](https://duckdb.org/release_calendar), including LTS releases, and shows the 2 most recent patch releases of each. Older patch releases are not listed, but the extension may be available for them as well.

<div class="extension_compatibility_table"></div>

| Platform | 1.4.4 | 1.4.5 | 1.5.5 | 1.5.6 | 2.0.0 |
| :--- | :---: | :---: | :---: | :---: | :---: |
| Linux AMD64 | ❌ | ❌ | ❌ | ✅ | ✅ |
| Linux ARM64 | ❌ | ❌ | ❌ | ✅ | ✅ |
| macOS AMD64 | ❌ | ❌ | ❌ | ✅ | ✅ |
| macOS ARM64 | ❌ | ❌ | ❌ | ✅ | ✅ |
| Windows AMD64 | ❌ | ❌ | ❌ | ✅ | ✅ |
| Windows ARM64 | ❌ | ❌ | ❌ | ❌ | ❌ |
| WebAssembly | ❌ | ❌ | ❌ | ❌ | ❌ |

### Installing and Loading
```sql
INSTALL {{ page.extension.name }} FROM community;
LOAD {{ page.extension.name }};
```

{% if page.docs.hello_world %}
### Example
```sql
{{ page.docs.hello_world }}```
{% endif %}

{% if page.docs.extended_description %}
### About {{ page.extension.name }}
{{ page.docs.extended_description }}
{% endif %}
### Added Functions

<div class="extension_functions_table"></div>

|      function_name      | function_type | description | comment | examples |
|-------------------------|---------------|-------------|---------|----------|
| databricks_clear_cache  | table         | NULL        | NULL    |          |
| databricks_execute      | table         | NULL        | NULL    |          |
| databricks_query        | table         | NULL        | NULL    |          |
| databricks_type_mapping | scalar        | NULL        | NULL    |          |

### Overloaded Functions

<div class="extension_functions_table"></div>

This extension does not add any function overloads.

### Added Types

<div class="extension_types_table"></div>

This extension does not add any types.

### Added Settings

<div class="extension_settings_table"></div>

|              name              |                              description                               | input_type | scope  | aliases | typed_value |
|--------------------------------|------------------------------------------------------------------------|------------|--------|---------|-------------|
| dbx_ca_cert                    | PEM bundle to trust, or 'system'                                       | VARCHAR    | GLOBAL | []      | system      |
| dbx_debug_show_queries         | Print each statement text and id                                       | BOOLEAN    | GLOBAL | []      | false       |
| dbx_filter_pushdown            | Push filters into Databricks SQL                                       | BOOLEAN    | GLOBAL | []      | true        |
| dbx_http_retries               | Retries for HTTP 429, 503, and connection errors                       | UBIGINT    | GLOBAL | []      | 5           |
| dbx_http_timeout_ms            | Per-request HTTP timeout in milliseconds                               | UBIGINT    | GLOBAL | []      | 60000       |
| dbx_insert_max_statement_bytes | Maximum SQL text of one INSERT statement, at most 16 MiB               | UBIGINT    | GLOBAL | []      | 12582912    |
| dbx_order_pushdown             | Push ORDER BY ... LIMIT into Databricks SQL                            | BOOLEAN    | GLOBAL | []      | true        |
| dbx_statement_timeout_ms       | Cancel a statement still running after this many milliseconds. 0 waits | UBIGINT    | GLOBAL | []      | 0           |
| temp_directory                 | Set the directory to which temporary files are written.                | VARCHAR    | GLOBAL | []      | post.db.tmp |