Deeman
ca308a7275
delete todos
2025-10-12 21:05:21 +02:00
Deeman
55bb84f0fa
implement cli/infra update cicd
2025-10-12 21:00:41 +02:00
Deeman
790e802edd
updates
2025-10-12 14:26:55 +02:00
Deeman
77dd277ebf
updates
2025-10-12 14:26:37 +02:00
Deeman
ac9b23af17
Add CLAUDE.md documentation for AI-assisted development
...
Comprehensive guide covering project architecture, SQLMesh workflow,
data layer conventions, and development commands for the Materia
commodity analytics platform.
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-10-12 13:21:13 +02:00
Deeman
025dda16c6
update dedupe logic -> much faster now
2025-10-07 22:32:45 +02:00
Deeman
da89c2bf6e
update staging pipeline
2025-10-07 22:20:48 +02:00
Deeman
0a409acbea
update path
2025-09-10 18:56:32 +02:00
Deeman
85704a4bf1
Change layer naming
2025-09-10 18:46:18 +02:00
Deeman
f5f2dbc7a5
refactor
2025-08-25 20:50:25 +02:00
Hendrik Dreesmann
a2ffc96aa3
Merge branch 'CEC' into 'master'
...
Update file Commodity Exchange Codes.xls
See merge request deemanone/materia!6
2025-08-01 20:03:27 +02:00
Simon Dmsn
5588be152b
Update 3 files
...
- /notebooks/03_Extraction.ipynb
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata_1_filter_silver_layer.sql
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata_2_filter_gold_layer.sql
2025-08-01 14:52:55 +00:00
Simon Dmsn
1c87488cc7
Update 4 files
...
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata.sql
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata_1_filter_silver_layer.sql
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata_2_filter_gold_layer.sql
- /transform/sqlmesh_materia/models/staging/stg_psd_alldata_0.sql
2025-08-01 14:45:34 +00:00
Simon Dmsn
82b27e7c55
Update 2 files
...
- /transform/sqlmesh_materia/seeds/commodity_exchange_codes.csv
- /transform/sqlmesh_materia/seeds/psd_codes_exchange_codes_merge.csv
2025-08-01 14:41:48 +00:00
Simon Dmsn
9d7cc4e1fb
Update file commodity_exchange_codes.csv
2025-08-01 14:26:19 +00:00
Simon Dmsn
4ad4386ccc
Update 2 files
...
- /transform/sqlmesh_materia/models/staging/Commodity Exchange Codes.xls
- /transform/sqlmesh_materia/seeds/commodity_exchange_codes.csv
2025-08-01 14:24:26 +00:00
Simon Dmsn
918b0071b1
Update file Commodity Exchange Codes.xls
2025-08-01 14:22:01 +00:00
Deeman
91f8968990
remove comment
2025-07-31 19:48:18 +02:00
Deeman
641f794d61
fix seeds; update models
2025-07-27 22:49:37 +02:00
Deeman
c0d8f60d1c
add reference data
2025-07-27 18:28:30 +02:00
Deeman
ff283b62ff
exclude dbs
...
'
2025-07-27 15:41:34 +02:00
Deeman
8b5d05b3c2
raw ingest model
2025-07-27 15:40:41 +02:00
Deeman
f5c73e32c5
testing sqlmesh
2025-07-27 00:18:14 +02:00
Deeman
9baa0d185c
testing sqlmesh
2025-07-27 00:18:03 +02:00
Deeman
f0de8a505b
update projects to packages
2025-07-26 22:32:47 +02:00
Deeman
0bbbd25b68
update projects to packages
2025-07-26 22:32:37 +02:00
Deeman
00fffb2089
more simplification
2025-07-26 22:19:33 +02:00
Deeman
1c3455a906
more simplification
2025-07-26 22:18:47 +02:00
Deeman
4fd1b96114
simplify using etags
2025-07-26 22:08:35 +02:00
Deeman
bd65ddcac8
adding incremental load abilities
2025-07-26 21:10:02 +02:00
Deeman
0a60bf8746
finish historical extraction
2025-07-13 23:20:55 +02:00
Deeman
b8ad73202c
finish historical extraction
2025-07-13 23:20:50 +02:00
Deeman
70bd8a52db
async is requesting stuff too fast
2025-07-13 18:08:25 +02:00
Deeman
8143c6ed8e
async is requesting stuff too fast
2025-07-13 18:08:19 +02:00
Deeman
c3c281fcd8
update structure
2025-07-08 22:41:59 +02:00
Deeman
0ef57f3e06
updates
2025-07-08 21:06:06 +02:00
Deeman
5368c1e521
changes
...
'
2025-06-11 11:49:20 +02:00
Hendrik Dreesmann
e339d1b9ff
Merge branch 'freshbranche' into 'master'
...
third versuch
See merge request deemanone/materia!5
2025-06-11 11:31:41 +02:00
Simon
0a993579a7
third versuch
2025-06-11 10:25:50 +01:00
Deeman
472730e088
remove weird file
2025-05-08 18:08:01 +02:00
Deeman
10d9424ff1
uncomment code
2025-05-08 18:02:45 +02:00
Deeman
d84e39fd9f
add dlt script
2025-05-01 17:40:10 +02:00
Deeman
265250864c
add dlt script to extract data from fas.usda.gov
2025-04-30 22:35:31 +02:00
Deeman
d60bf0ea3f
dlt add
2025-04-30 19:04:19 +02:00
Hendrik Dreesmann
55ccf2320c
Merge branch 'PSD' into 'master'
...
Psd
See merge request deemanone/materia!3
2025-04-30 18:56:39 +02:00
Simon Dmsn
bff78f1e72
Psd
2025-04-30 18:56:39 +02:00
Hendrik Dreesmann
cb3fe7399b
Merge branch 'Symen11-master-patch-c584' into 'master'
...
Create file 02_API.ipynb
See merge request deemanone/materia!2
2025-04-02 14:37:38 +02:00
Simon Dmsn
8410fd68d8
Create file 02_API.ipynb
2025-04-02 14:37:38 +02:00
bd80a53e4c
add prototype ui
2025-04-01 20:26:45 +02:00
6cbaff6a50
chat notes
2025-04-01 18:33:40 +02:00
