feat(extract): replace OpenWeatherMap with Open-Meteo weather extractor
Replaced the OWM extractor (8 locations, API key required, 14,600-call backfill over 30+ days) with Open-Meteo (12 locations, no API key, ERA5 reanalysis, full backfill in 12 API calls ~30 seconds). - Rename extract/openweathermap → extract/openmeteo (git mv) - Rewrite api.py: fetch_archive (ERA5, date-range) + fetch_recent (forecast, past_days=10 to cover ERA5 lag); 9 daily variables incl. et0 and VPD - Rewrite execute.py: _split_and_write() unzips parallel arrays into per-day flat JSON; no cursor / rate limiting / call cap needed - Update pipelines.py: --package openmeteo, timeout 120s (was 1200s) - Update fct_weather_daily.sql: flat Open-Meteo field names (temperature_2m_* etc.), remove pressure_afternoon_hpa, add et0_mm + vpd_max_kpa + is_high_vpd - Remove OPENWEATHERMAP_API_KEY from CLAUDE.md env vars table Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -41,12 +41,12 @@ PIPELINES = {
|
||||
"timeout_seconds": 1800,
|
||||
},
|
||||
"extract_weather": {
|
||||
"command": ["uv", "run", "--package", "openweathermap", "extract_weather"],
|
||||
"timeout_seconds": 300,
|
||||
"command": ["uv", "run", "--package", "openmeteo", "extract_weather"],
|
||||
"timeout_seconds": 120,
|
||||
},
|
||||
"extract_weather_backfill": {
|
||||
"command": ["uv", "run", "--package", "openweathermap", "extract_weather_backfill"],
|
||||
"timeout_seconds": 1200,
|
||||
"command": ["uv", "run", "--package", "openmeteo", "extract_weather_backfill"],
|
||||
"timeout_seconds": 120,
|
||||
},
|
||||
"extract_all": {
|
||||
"command": ["meta", "extract", "extract_cot", "extract_prices", "extract_ice_all", "extract_weather"],
|
||||
|
||||
Reference in New Issue
Block a user