Dagster Cloud - The data orchestrator that puts developer experience first | Pro...

The data orchestrator that puts developer experience firstAfter three years of development, Dagster 1.0 and Dagster Cloud are now ready for prime time, and we are excited to share Dagster Cloud with all of you at Product Hunt on GA launch day 🚀.

We built Dagster because building data pipelines was too slow and too difficult. They are complex, critical pieces of software, and the tools used to create them didn’t support best engineering practices: Testing was a headache, debugging was time-consuming, and overall the abstractions and mental model were suboptimal. We felt that the missing piece was a new type of orchestrator, designed to put developer experience first. That is why we built Dagster and Dagster Cloud.

Dagster Cloud is the hosted service for Dagster—the open source data orchestration project—, and comes with fully Serverless or Hybrid deployments, native branching, and out-of-the-box CI/CD. They combine to provide a breakthrough engineering workflow.

All this gives you control over your disparate data tools and empowers you to build, test, deploy, run, and iterate on your data pipelines. Teams that have adopted Dagster report having a blast building their data pipelines, and you don’t usually hear that when it comes to working on orchestration.

Dagster Cloud includes some amazing productivity tools for data teams - here are a few standouts:

Branch Deployments: A game-changing feature for data engineers, it allows you to move quickly and confidently from PR to merge. Branch Deployments are lightweight staging environments created with every PR. No more testing on production, no more testing locally without matching your cloud environment.

Hybrid or Serverless options: With Serverless, Dagster hosts the entire orchestration engine. Spin-up is completely effortless. Just write a Python file, and we do the rest: no Dockerfiles, no Kubernetes, no provisioning. With Hybrid, you bring your compute platform and let Dagster host the control plane, which does not see your code or data. This helps maximize flexibility and security while offloading the operational burden.

Dagster’s unified control plane: The ‘single plane of glass’ data teams love to use
Lots of teams struggle to maintain control over their data as the complexity of their data platform scales. With Dagster they can centralize their metadata in one tool with built-in observability, diagnostics, cataloging, and lineage. This helps spot any issues and identify performance improvement opportunities.

Dagster has a thriving community of open source and Cloud users, and a strong commitment by the engineering team to provide direct support to users.

Come to dagster.io to try Dagster. And join our growing community.