Building pipelines with components
This feature is considered in a preview stage and is under active development. It can change significantly, or be removed completely. It is not considered ready for production use.
Creating a project with components
After installing dependencies, you can scaffold a components-ready project. In the example below, we scaffold a project called jaffle-platform:
Adding components to your project
To add components to your project, you can instantiate them from the command line, which will create a new directory inside your components/ folder that contains a component.yaml file.
Adding components to your project with Python
In some cases, you may want to add a component to your project with Python rather than a component.yaml file.
Customizing components
You can customize the behavior of a component beyond what is available in the component.yaml file.
pyproject.toml settings
pyproject.toml contains tool.dagster and tool.dg sections: