a72f7721bb
stg_population_geonames → dim_locations → location_opportunity_profile were all 0 rows in prod because the GeoNames extractor was never scheduled. First run will backfill cities1000 to landing zone. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
42 lines
1.2 KiB
TOML
42 lines
1.2 KiB
TOML
# Workflow registry — the supervisor reads this file on every tick.
|
|
# To add a new extractor: add a [section] here and create the Python module.
|
|
#
|
|
# Fields:
|
|
# module — Python module path (must have a main() function)
|
|
# schedule — named preset ("hourly", "daily", "weekly", "monthly")
|
|
# or raw cron expression (e.g. "0 6-23 * * *")
|
|
# entry — optional: function name if not "main" (default: "main")
|
|
# depends_on — optional: list of workflow names that must run first
|
|
# proxy_mode — optional: "round-robin" (default) or "sticky"
|
|
|
|
[overpass]
|
|
module = "padelnomics_extract.overpass"
|
|
schedule = "monthly"
|
|
|
|
[overpass_tennis]
|
|
module = "padelnomics_extract.overpass_tennis"
|
|
schedule = "monthly"
|
|
|
|
[eurostat]
|
|
module = "padelnomics_extract.eurostat"
|
|
schedule = "monthly"
|
|
|
|
[geonames]
|
|
module = "padelnomics_extract.geonames"
|
|
schedule = "monthly"
|
|
|
|
[playtomic_tenants]
|
|
module = "padelnomics_extract.playtomic_tenants"
|
|
schedule = "daily"
|
|
|
|
[playtomic_availability]
|
|
module = "padelnomics_extract.playtomic_availability"
|
|
schedule = "daily"
|
|
depends_on = ["playtomic_tenants"]
|
|
|
|
[playtomic_recheck]
|
|
module = "padelnomics_extract.playtomic_availability"
|
|
entry = "main_recheck"
|
|
schedule = "0,30 6-23 * * *"
|
|
depends_on = ["playtomic_availability"]
|