Aqueduct works with your cloud

Aqueduct comes with built-in resources to common cloud infrastructure, so you can manage machine learning in the cloud without having to rip-and-replace every tool you use. Let us know if you'd like to see something else here!

Compute Resources

Airflow

Use Aqueduct's API to deploy workflows onto your Apache Airflow cluster but with deeper visibility.

Conda

Conda gives you strong Python environment isolation, so you can use your favorite libraries.

Databricks

Launch Aqueduct workflows on top of the Databricks' Jobs API for on-demand Spark clusters.

Kubernetes

Launch Aqueduct operators as Kubernetes pods with full control over what resources you use.

AWS Lambda

Use Lambda's serverless functions to run your Aqueduct workflows with no configuration.

Apache Spark

Run Aqueduct workflows on your existing Spark clusters to scale your machine learning.

Coming soon!

Ray

Use Ray to distribute your Python execution from your Aqueduct workflows.

Coming soon!

Google Cloud Functions

Google Cloud's serverless functions allow you to run code with no configuration.

Data 

Resources

AWS Athena

AWS Athena allows you to run scalable SQL queries over data stored in your S3 buckets.

BigQuery

BigQuery is Google Cloud's scalable cloud data warehouse.

Google Cloud Storage

Use Google Cloud Storage for object storage within the GCP ecosystem.

MariaDB

MariaDB is an open-source fork of MySQL with a fully-compatible MySQL API.

MongoDB

MongoDB gives you scalable, flexible document storage in the cloud.

MySQL

MySQL is one of the world's most popular relational databases.

Postgres

Postgres is the world's most popular open-source RDBMS.

Redshift

AWS Redshift is a highly-scalable data warehouse.

AWS S3

AWS S3 is a highly-scalable, extremely flexible object storage system.

Snowflake

Snowflake is a highly-scalable cloud data warehouse that runs across clouds.

SQLite

SQLite is a powerful, in-process relational database.

Coming soon!

DynamoDB

AWS DynamoDB is a low-latency key-value and document database.

Coming soon!

Redis

Redis is an open-source in-memory database and caching layer.

Coming soon!

Delta Lake

The first storage framework that enables you to architect a Lakehouse.