# Apache OpenDAL™: *One Layer, All Storage.* [![GitHub Discussions](https://img.shields.io/github/discussions/apache/opendal)](https://github.com/apache/opendal/discussions) [![Discord](https://img.shields.io/discord/1081052318650339399?logo=discord&label=discord)](https://opendal.apache.org/discord) [![DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/apache/opendal) Apache OpenDAL™ (`/ˈoʊ.pən.dæl/`, pronounced "OH-puhn-dal") is an Open Data Access Layer that gives every language a unified way to access object storage, file storage, cloud SaaS, databases, protocols, and key-value services. Apache OpenDAL™ is guided by its vision of **One Layer, All Storage** and its core principles: **Open Community**, **Solid Foundation**, **Fast Access**, **Object Storage First**, and **Extensible Architecture**. Read the explained vision at [OpenDAL Vision](https://opendal.apache.org/vision). OpenDAL Architecture ## At a Glance - Project: Apache OpenDAL™ - Vision: **One Layer, All Storage** - Core package: Rust crate [`opendal`][Rust Core Link] - Main abstraction: `Operator` - Extension points: language bindings, layers, and services - Common layers: retry, timeout, logging, tracing, metrics, throttling, and concurrency control - Access targets: object storage, file systems, cloud SaaS, databases, protocols, and key-value services ## Why OpenDAL Apache OpenDAL™ turns the vision of **One Layer, All Storage** into a practical data access layer for applications, libraries, and data systems. - **Zero-cost core**: built in Rust with composable services and layers, so applications only enable the backends and capabilities they use. - **Production-ready access**: add retry, timeout, logging, tracing, metrics, throttling, and concurrency limits through reusable layers. - **One API, all storage**: access object storage, file systems, cloud SaaS, databases, protocols, and key-value services through the same interface. - **Open and extensible**: add new services, layers, and language bindings while keeping the same unified access model. ## Choose Your Language Start with the binding for your application runtime. Each binding provides access to the same OpenDAL service model while following its language ecosystem. > **Note**: Each binding has its own independent version number, which may differ from the Rust core version. When checking for updates or compatibility, always refer to the specific binding's version rather than the core version. | | | | | | :---: | :---: | :---: | :---: | | Rust logo
**[Rust Core]**
[Package][Rust Core Link] · [Docs][Rust Core Release Docs] · [Dev Docs][Rust Core Dev Docs] | C logo
**[C Binding]**
[Dev Docs][C Binding Dev Docs] | C++ logo
**[Cpp Binding]**
[Dev Docs][Cpp Binding Dev Docs] | D logo
**[D Binding]** | | Dart logo
**[Dart Binding]** | .NET logo
**[Dotnet Binding]** | Go logo
**[Go Binding]**
[Package][Go Binding Link] · [Docs][Go Release Docs] | Haskell logo
**[Haskell Binding]** | | Java logo
**[Java Binding]**
[Package][Java Binding Link] · [Docs][Java Binding Release Docs] · [Dev Docs][Java Binding Dev Docs] | Lua logo
**[Lua Binding]** | Node.js logo
**[Node.js Binding]**
[Package][Node.js Binding Link] · [Dev Docs][Node.js Binding Dev Docs] | OCaml logo
**[OCaml Binding]** | | PHP logo
**[PHP Binding]** | Python logo
**[Python Binding]**
[Package][Python Binding Link] · [Dev Docs][Python Binding Dev Docs] | Ruby logo
**[Ruby Binding]**
[Package][Ruby Binding Link] · [Docs][Ruby Binding Docs] | Swift logo
**[Swift Binding]** | | Zig logo
**[Zig Binding]** | | | | ## Choose Your Layers Add layers when your application needs cross-service behavior such as retries, timeouts, observability, or traffic control. | | | | | | :---: | :---: | :---: | :---: | | Retry icon
**[RetryLayer]**
Retry temporary failures. | Timeout icon
**[TimeoutLayer]**
Bound slow or hanging operations. | Logging icon
**[LoggingLayer]**
Emit structured operation logs. | Tracing icon
**[TracingLayer]**
Trace requests across systems. | | Metrics icon
**[MetricsLayer]**
Export operation metrics. | Prometheus icon
**[PrometheusLayer]**
Expose Prometheus metrics. | OpenTelemetry icon
**[OtelMetricsLayer]**
Export OpenTelemetry metrics. | Traffic control icon
**Traffic Control**
[ThrottleLayer] · [ConcurrentLimitLayer] | | Content type icon
**[MimeGuessLayer]**
Infer `Content-Type` from paths. | Route icon
**[RouteLayer]**
Route operations by path. | Cache icon
**[FoyerLayer]**
Add hybrid cache behavior. | Layers icon
**[All Layers][Layers Docs]**
Explore the full layer list. | Explore all available layers in the [layers documentation][Layers Docs]. ## Choose Your Services Pick the storage services that your application needs. See the full OpenDAL service configuration docs in the [services documentation][Services Docs].
Object Storage File Storage
AWS logo s3 Google Cloud logo gcs Azure logo azblob OpenDAL logo fs Apache Hadoop logo hdfs Apache Hadoop logo hdfs-native
Alibaba Cloud logo oss Huawei Cloud logo obs Tencent Cloud logo cos Apache Hadoop logo webhdfs lakeFS logo lakefs IPFS logo ipfs
Volcengine logo tos Backblaze logo b2 OpenStack logo swift IPFS logo ipmfs Azure logo azfile Azure logo azdls
Upyun logo upyun Vercel logo vercel-blob Alluxio logo alluxio Tencent Cloud logo goosefs Databricks logo dbfs
MongoDB logo gridfs MDN Web Docs logo opfs GitHub logo monoiofs
GitHub logo compfs
Cloud SaaS Standard Protocols
Google Drive logo gdrive Dropbox logo dropbox OneDrive logo onedrive HTTP icon http FTP icon ftp WebDAV icon webdav
Aliyun Drive logo aliyun-drive Hugging Face logo hf GitHub logo github SFTP icon sftp
pCloud logo pcloud Koofr logo koofr Seafile logo seafile
Yandex Disk logo yandex-disk
Databases Key-Value & Embedded
SQLite logo sqlite MySQL logo mysql PostgreSQL logo postgresql OpenDAL logo memory Redis logo redis etcd logo etcd
MongoDB logo mongodb SurrealDB logo surrealdb Cloudflare logo d1 RocksDB logo rocksdb Memcached logo memcached cloudflare-kv
TiKV logo tikv FoundationDB logo foundationdb crates.io logo sled
crates.io logo redb crates.io logo persy GitHub logo dashmap
crates.io logo cacache GitHub logo moka GitHub logo mini-moka
GitHub logo foyer GitHub logo ghac vercel-artifacts
## Examples See [examples](./examples/) for runnable usage examples. ## Documentation - Website: - Vision: - Rust release docs: - Rust dev docs: ## Contribute OpenDAL is an active open-source project. We are always open to people who want to use it or contribute to it. Here are some ways to go. - Start with [Contributing Guide](CONTRIBUTING.md). - Submit [Issues](https://github.com/apache/opendal/issues/new) for bug report or feature requests. - Start [Discussions](https://github.com/apache/opendal/discussions/new?category=q-a) for questions or ideas. - Talk to community directly at [Discord](https://opendal.apache.org/discord). - Report security vulnerabilities to [private mailing list](mailto:private@opendal.apache.org) ## Branding The first and most prominent mentions must use the full form: **Apache OpenDAL™** of the name for any individual usage (webpage, handout, slides, etc.) Depending on the context and writing style, you should use the full form of the name sufficiently often to ensure that readers clearly understand the association of both the OpenDAL project and the OpenDAL software product to the ASF as the parent organization. For more details, see the [Apache Product Name Usage Guide](https://www.apache.org/foundation/marks/guide). ## License and Trademarks Licensed under the Apache License, Version 2.0: Apache OpenDAL, OpenDAL, and Apache are either registered trademarks or trademarks of the Apache Software Foundation. [Rust Core]: core/README.md [Rust Core Link]: https://crates.io/crates/opendal [Rust Core Release Docs]: https://docs.rs/opendal [Rust Core Dev Docs]: https://opendal.apache.org/docs/rust/opendal/ [C Binding]: bindings/c/README.md [C Binding Dev Docs]: https://opendal.apache.org/docs/c/ [Cpp Binding]: bindings/cpp/README.md [Cpp Binding Dev Docs]: https://opendal.apache.org/docs/cpp/ [D Binding]: bindings/d/README.md [Dart Binding]: bindings/dart/README.md [Dotnet Binding]: bindings/dotnet/README.md [Go Binding]: bindings/go/README.md [Go Binding Link]: https://pkg.go.dev/github.com/apache/opendal/bindings/go [Go Release Docs]: https://pkg.go.dev/github.com/apache/opendal/bindings/go [Haskell Binding]: bindings/haskell/README.md [Java Binding]: bindings/java/README.md [Java Binding Link]: https://central.sonatype.com/artifact/org.apache.opendal/opendal-java [Java Binding Release Docs]: https://javadoc.io/doc/org.apache.opendal/opendal-java [Java Binding Dev Docs]: https://opendal.apache.org/docs/java/ [Lua Binding]: bindings/lua/README.md [Node.js Binding]: bindings/nodejs/README.md [Node.js Binding Link]: https://www.npmjs.com/package/opendal [Node.js Binding Dev Docs]: https://opendal.apache.org/docs/nodejs/ [OCaml Binding]: bindings/ocaml/README.md [PHP Binding]: bindings/php/README.md [Python Binding]: bindings/python/README.md [Python Binding Link]: https://pypi.org/project/opendal/ [Python Binding Dev Docs]: https://opendal.apache.org/docs/python/ [Ruby Binding]: bindings/ruby/README.md [Ruby Binding Link]: https://rubygems.org/gems/opendal [Ruby Binding Docs]: https://opendal.apache.org/docs/ruby/ [Swift Binding]: bindings/swift/README.md [Zig Binding]: bindings/zig/README.md [Layers Docs]: https://opendal.apache.org/docs/rust/opendal/layers/ [RetryLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.RetryLayer.html [TimeoutLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.TimeoutLayer.html [LoggingLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.LoggingLayer.html [TracingLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.TracingLayer.html [MetricsLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.MetricsLayer.html [PrometheusLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.PrometheusLayer.html [OtelMetricsLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.OtelMetricsLayer.html [ThrottleLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.ThrottleLayer.html [ConcurrentLimitLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.ConcurrentLimitLayer.html [MimeGuessLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.MimeGuessLayer.html [RouteLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.RouteLayer.html [FoyerLayer]: https://opendal.apache.org/docs/rust/opendal/layers/struct.FoyerLayer.html [Services Docs]: https://opendal.apache.org/docs/rust/opendal/services/