Dagster for The Modern Engagement Tool project. The assets are organized into ops, jobs and schedules.
| Folder name | Path | Reference |
|---|---|---|
ops |
{Your Directory}\met-public\met-etl\src\etl_project\services\ops | Dagster ops |
jobs |
{Your Directory}\met-public\met-etl\src\etl_project\services\jobs | Dagster jobs |
schedules |
{Your Directory}\met-public\met-etl\src\etl_project\services\schedules | Dagster schedules |
The development scripts for this application allow customization via an environment file in the root directory called .env. See an example of the environment variables that can be overridden in sample.env.
Running the application
- Modify the environment variables
cd {Your Directory}/met-public/met-etl- Run
docker-compose up -dto start.
This will build the Docker image and pull Postgresql dependency. The dagster dashboard is then available on http://localhost:3000