deemanone/beanflows
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

vision: update current state to reflect ICE overhaul + dashboard work shipped

Browse Source 
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Deeman
2026-02-21 23:00:03 +01:00
parent fb8c6cdb3d
commit 6d18a4a7c2
1 changed files with 14 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

23
vision.md
View File

@@ -95,18 +95,23 @@ We move fast, ship incrementally, and prioritize value over vanity metrics.
- USDA PSD Online extraction + full SQLMesh pipeline (raw→staging→cleaned→serving) - USDA PSD Online extraction + full SQLMesh pipeline (raw→staging→cleaned→serving)
- CFTC COT disaggregated futures: weekly positioning, COT index, managed money net - CFTC COT disaggregated futures: weekly positioning, COT index, managed money net
- KC=F Coffee C futures prices: daily OHLCV, 20d/50d SMA, 52-week range (1971–present) - KC=F Coffee C futures prices: daily OHLCV, 20d/50d SMA, 52-week range (1971–present)
- ICE certified warehouse stocks: extractor ready, awaiting URL confirmation - ICE certified warehouse stocks: daily rolling + aging report + historical by-port (Nov 1996–present)
- Web app (Quart + HTMX): dashboard with supply/demand + COT + price + ICE charts — API-based URL discovery (no env var needed), XLS + CSV parsing, full SQLMesh pipeline
- REST API with key auth + rate limiting: /metrics, /positioning, /prices, /stocks — Dashboard: daily stocks chart, aging stacked bar, 30-year by-port stacked area
— API endpoints: /stocks, /stocks/aging, /stocks/by-port
- Web app (Quart + HTMX): dashboard with supply/demand + COT + price + all ICE charts
- Origin Intelligence page: HATEOAS country comparison, click-to-update via HTMX
- REST API with key auth + rate limiting
- Paddle billing (Starter/Pro plans), magic-link auth, admin panel - Paddle billing (Starter/Pro plans), magic-link auth, admin panel
- /methodology page with full data source documentation - /methodology page with full data source documentation
- Automated supervisor: all extractors + webhook alerting on failure - Automated supervisor: all extractors (extract_all meta-pipeline) + webhook alerting
- 23 passing tests, GitLab CI pipeline - 23 passing tests, GitLab CI pipeline
### What's Missing ### What's Missing (Phase 1 remainder)
- ICE stocks URL confirmed and backfill running (URL needs manual discovery at theice.com/report-center) - Python SDK (`pip install beanflows`)
- Python SDK - Deploy to Hetzner production
- Public API documentation - Cloudflare R2 raw data backup
- Example Jupyter notebooks
## Roadmap ## Roadmap
@@ -117,7 +122,7 @@ We move fast, ship incrementally, and prioritize value over vanity metrics.
- ✅ USDA PSD Online (production, stocks, consumption) - ✅ USDA PSD Online (production, stocks, consumption)
- ✅ CFTC COT data (trader positioning, COT index) - ✅ CFTC COT data (trader positioning, COT index)
- ✅ KC=F Coffee futures prices (daily OHLCV, moving averages) - ✅ KC=F Coffee futures prices (daily OHLCV, moving averages)
- ✅ ICE warehouse stocks (extractor built, seed models deployed) - ✅ ICE warehouse stocks (daily + aging + historical by-port, full pipeline + API + dashboard)
- ⬜ ICO (International Coffee Organization) — future - ⬜ ICO (International Coffee Organization) — future
**Features:** **Features:**