padelnomics

deemanone/padelnomics

Fork 0

Commit Graph

Author	SHA1	Message	Date
Deeman	b73386b9b6	fix: correct export_serving invocation in all docs `-m padelnomics.export_serving` doesn't resolve because src/ is not installed as a package in the workspace. Use the direct script path. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-02-25 16:06:31 +01:00
Deeman	405efcfd19	docs: update docs and PROJECT.md for dual score pipeline Task 8: documentation updates for the dual market score feature. - CHANGELOG.md: comprehensive [Unreleased] entries for all additions (Marktpotenzial-Score, tennis courts, dim_locations, GeoNames expansion, DuckDB spatial, SOPS secrets, methodology page updates) - docs/data-sources-inventory.md: add tennis courts Overpass row, update GeoNames entry (cities1000, username=padelnomics, higher score) - transform/sqlmesh_padelnomics/CLAUDE.md: add dim_locations to conformed dimensions table, update source integration map with new pipeline branch, document ST_Distance_Sphere bounding-box pattern - PROJECT.md: add dual score to In Progress, add Gemeinde pSEO + top-50 ranking page to Next Up, add data backlog items (sports_centre, NUTS-3, opportunity map), add Decisions Log entry Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-02-24 17:12:22 +01:00
Deeman	ebba46f700	refactor: align transform layer with template methodology Three deviations from the quart_saas_boilerplate methodology corrected: 1. Fix dim_cities LIKE join (data quality bug) - Old: FROM eurostat_cities LEFT JOIN venue_counts LIKE '%country_code%' → cartesian product (2.6M rows vs ~5500 expected) - New: FROM venue_cities (dim_venues) as primary table, Eurostat for enrichment only. grain (country_code, city_slug). - Also fixes REGEXP_REPLACE to LOWER() before regex so uppercase city names aren't stripped to '-' 2. Rename fct_venue_capacity → dim_venue_capacity - Static venue attributes with no time key are a dimension, not a fact - No SQL logic changes; update fct_daily_availability reference 3. Add fct_availability_slot at event grain - New: grain (snapshot_date, tenant_id, resource_id, slot_start_time) - Recheck dedup logic moves here from fct_daily_availability - fct_daily_availability now reads fct_availability_slot (cleaner DAG) Downstream fixes: - city_market_profile, planner_defaults grain → (country_code, city_slug) - pseo_city_costs_de, pseo_city_pricing add city_key composite natural key (country_slug \|\| '-' \|\| city_slug) to avoid URL collisions across countries - planner_defaults join in pseo_city_costs_de uses both country_code + city_slug - Templates updated: natural_key city_slug → city_key Added transform/sqlmesh_padelnomics/CLAUDE.md documenting data modeling rules, conformed dimension map, and source integration architecture. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-02-23 21:17:04 +01:00

Author

SHA1

Message

Date

Deeman

b73386b9b6

fix: correct export_serving invocation in all docs

`-m padelnomics.export_serving` doesn't resolve because src/ is not
installed as a package in the workspace. Use the direct script path.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-25 16:06:31 +01:00

Deeman

405efcfd19

docs: update docs and PROJECT.md for dual score pipeline

Task 8: documentation updates for the dual market score feature.

- CHANGELOG.md: comprehensive [Unreleased] entries for all additions
  (Marktpotenzial-Score, tennis courts, dim_locations, GeoNames expansion,
  DuckDB spatial, SOPS secrets, methodology page updates)
- docs/data-sources-inventory.md: add tennis courts Overpass row, update
  GeoNames entry (cities1000, username=padelnomics, higher score)
- transform/sqlmesh_padelnomics/CLAUDE.md: add dim_locations to conformed
  dimensions table, update source integration map with new pipeline branch,
  document ST_Distance_Sphere bounding-box pattern
- PROJECT.md: add dual score to In Progress, add Gemeinde pSEO + top-50
  ranking page to Next Up, add data backlog items (sports_centre, NUTS-3,
  opportunity map), add Decisions Log entry

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-24 17:12:22 +01:00

Deeman

ebba46f700

refactor: align transform layer with template methodology

Three deviations from the quart_saas_boilerplate methodology corrected:

1. Fix dim_cities LIKE join (data quality bug)
   - Old: FROM eurostat_cities LEFT JOIN venue_counts LIKE '%country_code%'
     → cartesian product (2.6M rows vs ~5500 expected)
   - New: FROM venue_cities (dim_venues) as primary table, Eurostat for
     enrichment only. grain (country_code, city_slug).
   - Also fixes REGEXP_REPLACE to LOWER() before regex so uppercase city
     names aren't stripped to '-'

2. Rename fct_venue_capacity → dim_venue_capacity
   - Static venue attributes with no time key are a dimension, not a fact
   - No SQL logic changes; update fct_daily_availability reference

3. Add fct_availability_slot at event grain
   - New: grain (snapshot_date, tenant_id, resource_id, slot_start_time)
   - Recheck dedup logic moves here from fct_daily_availability
   - fct_daily_availability now reads fct_availability_slot (cleaner DAG)

Downstream fixes:
- city_market_profile, planner_defaults grain → (country_code, city_slug)
- pseo_city_costs_de, pseo_city_pricing add city_key composite natural key
  (country_slug || '-' || city_slug) to avoid URL collisions across countries
- planner_defaults join in pseo_city_costs_de uses both country_code + city_slug
- Templates updated: natural_key city_slug → city_key

Added transform/sqlmesh_padelnomics/CLAUDE.md documenting data modeling rules,
conformed dimension map, and source integration architecture.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 21:17:04 +01:00

3 Commits