Aqueduct - Taking data science to production | Product Hunt
source link: https://www.producthunt.com/posts/aqueduct
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Aqueduct
Taking data science to production
Hi everyone!
We've been working on making data teams more productive with Aqueduct for over a year, and we're really excited to share what we've been building.
There's a large (and growing!) number of programmers in the world who understand data and can solve business problems but don't want to spend their time wrangling low-level cloud infrastructure to get their work into the cloud. The existing MLOps tools that claim to solve this problem have been built by & for software teams, and they're incredibly complicated.
With Aqueduct, we've built a tool that's designed for data teams and abstracts away the underlying infrastructure. Aqueduct has a simple Python API that allows you to define a workflow as a composition of Python functions. Those workflows can be easily connected to data sources and can be run anywhere from your laptop to a Kubernetes cluster in the cloud. Once a workflow's running, Aqueduct has lightweight hooks to compute metrics and run tests over your pipelines to ensure they're producing high-quality results.
To learn more about what we're building, check out our GitHub repo or join our community Slack:
https://github.com/aqueducthq/aq... https://slack.aqueducthq.com
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK