Scheduler Libraries

5 Components & Libraries

Sortby

Scheduler Libraries

An orchestration platform for the development, production, and observation of data assets.

With Dagster, you declare—as Python functions—the data assets that you want to build. Dagster then helps you run your functions at the right time and keep your assets up-to-date. Here is an example o…

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Pipeline Consists of various modules: EMR - I used a 3 node cluster with below Instance Types: Finally, pyspark uses python2 as default setup on EMR. To change to python3, setup environment variable…

A programmable, observable and distributed job orchestration system.

Odin is a programmable, observable and distributed job orchestration system which allows for the scheduling, management and unattended background execution of user created tasks on Linux based system…

Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."

Sheets only go so far, with a StarThinker running, the ad operations team can operate on larger data sets, scale solutions across clients fast, and even automate campaign controls. All using a drag a…