Dagster

Modern data orchestration platform designed for building maintainable data pipelines. Emphasizes testability, observability, and type safety.

Key Features

• Software-Defined Assets: Data-centric pipeline design
• Type System: Strong typing for data pipelines
• Testing: Local testing and validation
• Observability: Built-in monitoring and debugging
• Scheduling: Flexible execution patterns

My Experience

Built and orchestrated complex ML data pipelines with Dagster, managing data transformations and model training workflows.