The easiest way to run open LLMs
With Aqueduct v0.3, you can run open-source LLMs with a single Python API call on any cloud infrastructure you use. Now, you can run LLMs without having to worry about data privacy or compliance.
Running Dolly v2 in your cloud
Dolly is the first open-source and commercially viable LLM. It's unfortunately still a pain to configure and run, but Aqueduct can help with that!
April 13, 2023
Read More →
Building the Aqueduct March Madness Workflow
See how we used Aqueduct to build a workflow that predicts the results of the NCAA Men's Basketball Tournament.
March 24, 2023
Read More →
Predicting March Madness with Aqueduct
It's March, and that means it's the NCAA tournament! See how you can build a workflow to predict the NCAA tournament with Aqueduct.
March 17, 2023
Read More →
Untangling the MLOps Knot
MLOps has become increasingly complicated in recent years, but in reality, ML teams have most of the infrastructure they need. Aqueduct helps untangle the knot by integrating with and empowering your cloud.
Vikram Sreekanti
March 2, 2023
Read More →
Understanding the MLOps Knot: Metadata Drift
MLOps has become increasingly complex as machine learning has matured. One of the key reasons is ML teams have to build, extend, and maintain far too much infrastructure. We dive into how and why this happens.
Vikram Sreekanti
February 23, 2023
Read More →
Understanding the MLOps Knot: Infrastructure Proliferation
MLOps has become increasingly complex as machine learning has matured. One of the key reasons is ML teams have to build, extend, and maintain far too much infrastructure. We dive into how and why this happens.
Vikram Sreekanti
February 16, 2023
Read More →
Visualizing ML pipelines with React and elk
This tutorial walks you through how Aqueduct uses React Flow and elk to build interactive visualizations of machine learning pipelines.
Andre Giron
February 10, 2023
Read More →
Unlock machine learning in your cloud: Aqueduct v0.2
Aqueduct v0.2 unlocks machine learning in your cloud. This release takes big steps forward on running ML workloads on existing cloud infrastructure and on providing visibility into what's running.
Vikram Sreekanti
February 1, 2023
Read More →
The MLOps Knot
Machine learning has seen a rapid proliferation of powerful infrastructure. However, the adoption of all these tools has led to a tangled mess of infrastructure leaving most teams without a way to track the code, data, and metadata for their machine learning workloads.
Vikram Sreekanti
January 26, 2023
Read More →
Managing Python Environments in Aqueduct
Managing Python environments is a critical task for workflow orchestration. When done naively, it can lead to incorrect execution or extremely high performance overheads. In this post, we describe how Aqueduct optimizes workflow execution within intelligently managed Conda environments.
Wei Chen
January 19, 2023
Read More →
Enhancing Airflow for machine learning
While Airflow is the default orchestrator for machine learning today, it has some key shortcomings: it doesn't care about data, it's not built for fast iteration, and it exacerbates infrastructure complexity. In this post, we discuss how Aqueduct's Airflow integration enhances how Airflow works for machine learning.
Saurav Chhatrapati
January 12, 2023
Read More →
Stop using Airflow for data science
Airflow has become the default data engineering orchestrator in recent years, and data science teams have inherited it. Unfortunately, Airflow wasn't designed for machine learning workflows — using Airflow for ML results in significant overhead and tech debt.
Vikram Sreekanti
January 5, 2023
Read More →
Predictions are just data
In conversations with over 200 data teams, we've found that the "typical" solution to ML model deployments is wrong. Most people don't need REST endpoints — they just need predictions as data.
Vikram Sreekanti
October 27, 2022
Read More →
Aqueduct v0.1: A simpler way to run data science workflows
We're excited to share Aqueduct v0.1. Aqueduct allows you to easily construct robust data & ML pipelines that work with your cloud infrastructure.
Vikram Sreekanti
October 18, 2022
Read More →
Aqueduct: Taking Data Science to Production
As ML has become widely adopted, the next critical challenge for data teams is in generating value from data science & machine learning. Production data science infrastructure is the missing link that will enable data science and machine learning to succeed, by abstracting away low-level cloud infrastructure. Aqueduct is the world's first production data science platform; it enables data scientists to run models anywhere, publish predictions everywhere, and ensure prediction quality.
Vikram Sreekanti
August 17, 2022
Read More →
MLOps: Right Problem, Wrong Solution
The fundamental problem with MLOps is that it mixes together tools for two very different concerns — (1) ensuring high-quality predictions and (2) deploying & managing cloud infrastructure. As a consequence, this requires data teams to have expertise in both data science and also in low-level cloud infrastructure.
Vikram Sreekanti
August 2, 2022
Read More →
The Real Challenge in (Useful) Machine Learning isn’t Learning
This post discusses research from the UC Berkeley RISE Lab around building scalable prediction infrastructure, and why that wasn't the problem the world needed solved.
Joey Gonzalez
July 21, 2022
Read More →
How Machine Learning Became Useful
This post explores how big data, advances in parallel computing, and new abstractions transformed machine learning and artificial intelligence.
Joey Gonzalez
July 14, 2022
Read More →
Building ML Pipelines with open LLMs
LLMs are incredibly powerful, but enterprises are constrained by the inability to use them with proprietary data. Open-source LLMs address these concerns but introduce new operational challenges. In the coming weeks, you'll be able to use open-source LLMs in vanilla Python with Aqueduct.
Chenggang Wu
April 6, 2022
Read More →
© 2023 Aqueduct, Inc. All rights reserved.