Orchestration of Data Pipelines
Runs a single pipeline
maestro
package
Retrieve latest maestro pipeline messages
Parse a time string
Retrieve latest maestro pipeline warnings
Create schedule table entry from a script
Build a schedule table
Check which pipelines are scheduled to run and when next pipelines wil...
Convert a duration string to number of seconds
Creates a new maestro project
Create a new orchestrator
Create a new pipeline in a pipelines directory
Generate a sequence of run times for a pipeline
Retrieve latest maestro build errors
Retrieve latest maestro pipeline errors
cli output for generate schedule table
Run a schedule
Checks the validity of a schedule
Suggest orchestrator frequency based on a schedule
Framework for creating and orchestrating data pipelines. Organize, orchestrate, and monitor multiple pipelines in a single project. Use tags to decorate functions with scheduling parameters and configuration.
Useful links