From 575311edc6a097b73ab4fc0c05c6fde2c7c08492411b8a341bcf76b43fe678fa Mon Sep 17 00:00:00 2001 From: Ben Varick Date: Fri, 7 Nov 2025 08:43:48 -0800 Subject: [PATCH] edited README and env.sample --- README.md | 9 ++++----- env.sample | 11 +++++++++-- 2 files changed, 13 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index f7016f3..acd1cb8 100644 --- a/README.md +++ b/README.md @@ -6,13 +6,12 @@ Dagster setup that scrapes GTFS and GTFS-RT for specified transit agencies and a This reads from the `config/agency_list.csv` file, edit this file to include the transit agencies that you want to scrape, add the relevant IDs from mobilitydatabase.org ## set your environment -### Data directory -edit dagster.yaml to specify the correct data directory under run_launcher. - -Right now it says: `/home/ben/code/gtfs-dagster/data:/opt/dagster/app/data`, change the first part to where you want the data to be stored. ### .env file -copy `env.sample` to `.env` and change the database password and the mobility database refresh token +copy `env.sample` to `.env` and change: +- Postgres database password - make it something random before the first run +- MobilityDatabase.org API token +- Location of data, config, and postgres_data directories (default is in working directory) # Run it `docker compose build` diff --git a/env.sample b/env.sample index 0542d24..e495496 100644 --- a/env.sample +++ b/env.sample @@ -1,6 +1,13 @@ +# Postgres credentials POSTGRES_USER=dagster -POSTGRES_PASSWORD=change-me +POSTGRES_PASSWORD=change-me-to-something-random POSTGRES_DB=dagster -MOBILITY_DB_REFRESH_TOKEN=put-token-from-mobilitydatabase-here +# Storage locations +DATA_DIRECTORY=${PWD}/data +POSTGRES_DIRECTORY=${PWD}/postgres_data +CONFIG_DIRECTORY=${PWD}/config + +# MobilityDatabase.org API token +MOBILITY_DB_REFRESH_TOKEN=get-from-MobilityDatabase.org