Orchestration of Data Pipelines
Build a schedule table
Convert a duration string to number of seconds
Creates a new maestro project
Create a new orchestrator
Create a new pipeline in a pipelines directory
Get the artifacts (return values) of the pipelines in a MaestroSchedul...
Get the flags of pipelines in a MaestroSchedule object
Generate a sequence of run times for a pipeline
Retrieve latest maestro pipeline messages
Retrieve latest maestro pipeline warnings
cli output for generate schedule table
maestro package
Class for an individual maestro pipeline A pipeline is defined as a si...
Class for a list of MaestroPipelines A MaestroPipelineList is created ...
Parse and validate tags then create and populate MaestroPipelineList
Retrieve latest maestro pipeline errors
Get the run sequence of a schedule
Get the schedule from a MaestroSchedule object
Get time slot usage of a schedule
Get the statuses of the pipelines in a MaestroSchedule object
Manually run a pipeline regardless of schedule
Checks whether a DAG is valid (no loops)
Retrieve latest maestro build errors
Class for a schedule of pipelines
Parse a time string
Run a schedule
Visualize the schedule as a DAG
Suggest orchestrator frequency based on a schedule
Framework for creating and orchestrating data pipelines. Organize, orchestrate, and monitor multiple pipelines in a single project. Use tags to decorate functions with scheduling parameters and configuration.
Useful links