1

GitHub - orchest/orchest: Build data pipelines, the easy way 🛠️

 2 years ago
source link: https://github.com/orchest/orchest
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Build data pipelines, the easy way raised_hands

No frameworks. No YAML. Just write Python and R code in Notebooks.

bulb Watch the full narrated video to learn more about building data pipelines in Orchest.

NOTE: Orchest is in beta.

Features

  • Visually construct pipelines through our user-friendly UI
  • Code in Notebooks and scripts (quickstart)
  • Run any subset of a pipelines directly or periodically (jobs)
  • Easily define your dependencies to run on any machine (environments)
  • Spin up services whose lifetime spans across the entire pipeline run (services)
  • Version your projects using git (projects)

When to use Orchest? Read it in the docs.

point_right Get started with our quickstart tutorial, check out pipelines made by your fellow users, or have a look at our video tutorials explaining some of Orchest's core concepts.

Installation

Want to skip the installation and jump right in? Then try out our managed service by clicking:

For instructions on how to deploy a self-hosted version, check out our installation docs.

License

The software in this repository is licensed as follows:

  • All content residing under the "orchest-sdk/" directory of this repository is licensed under the "Apache-2.0" license as defined in "orchest-sdk/LICENSE".
  • Content outside of the above mentioned directory is available under the "AGPL-3.0" license.

Slack Community

Join our Slack to chat about Orchest, ask questions, and share tips.

Contributing

Contributions are more than welcome! Please see our contributor guides for more details.

You could also submit your pipeline to the curated list of examples. Help other users try out your pipeline with one click by adding the following script in the README.md of your repository (NOTE: you need to replace your-repo-url with your repo URL).

[![Open in Orchest](https://github.com/orchest/orchest-examples/raw/main/imgs/open_in_orchest.svg)](https://cloud.orchest.io/?import_url=your-repo-url)

An example badge to import our quickstart repo in Orchest:

Contributors


report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK