~/cv/arch
/
géry · toulouse · cto
← Back to CV
LANG
FR
EN
Kocliko
MerciYanis
Le Comptoir Des Pharmacies
VIEW
Compare
Side by side
Data Pipeline
2024→
Web Application
2024→
➜ ~/cv/arch/kocliko-data
IoT pipeline rebuild: 6h → 40min
Millions of data points per day, 9× lower latency.
6h
BEFORE
40min
AFTER
9×
SPEEDUP
IoT Providers
Cronjob Linux
Orchestration
App Django
Pull, Calc & Store · 6h
PostgreSQL
Data & Résultats
IoT Providers
Airflow Pull
Tasks d'ingestion
MongoDB
Stockage brut
IoT MQTT
Scaleway MQTT
Serverless + Queue
Mongo TS
Temps réel
Backups
Hot & Cold
Airflow Calc
40min · KPIs
PostgreSQL
Résultats
AVANT · Monolithic · 6h runtime
APRÈS · Real-time ingest · 40min batch
⇔
✕
Sequential ETL, no parallelism
✕
Fragile Linux cronjob, no retry
✕
High AWS cost, no hot/cold split
✓
Parallel Airflow Pull + Scaleway MQTT
✓
Hot (TimeSeries) / cold (raw) split
✓
AWS → Scaleway · modular Terraform
Source / Client
Broker / LB / CDN
Hot path / PaaS
Cold / Archive
Orchestration
Monolith / Legacy
Database / Store
Observability