Config¶
S3 bucket configuration for raw and processed data storage. Bucket names are read from environment variables at import time, falling back to sensible defaults.
| Environment Variable | Default | Purpose |
|---|---|---|
PROGRID_S3_RAW_BUCKET |
progrid-rawdata |
Bucket for raw ISO files |
PROGRID_S3_PROCESSED_BUCKET |
progrid-processed-data |
Bucket for hive-partitioned processed data |