3

How to Deploy ETL and ML Pipelines in the Fastest, Cheapest and Most Flexible Wa...

 2 years ago
source link: https://hackernoon.com/how-to-deploy-etl-and-ml-pipelines-in-the-fastest-cheapest-and-most-flexible-way-possible
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

How to Deploy ETL and ML Pipelines in the Fastest, Cheapest and Most Flexible Way Possible

An ideal DataOps solution would address the following problems: The pipeline can be broken down into separate steps each having its own dependencies, language version and etc. The pipeline management, like starting up and shutting down the resources has to be automatic, in order to incur only costs per usage. The platform will build a separate environment with all your dependencies from requirements. You choose what server to use to run your applications, big memory, big CPU, GPU, etc. You can add more pipeline steps, by repeating everything from 1 to 5 if you wish to create more complex pipelines.

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK