DATA ENGINEERING
Data Engineering. Truck Logistics Data Pipeline.
This full ETL pipeline is part of a Capstone Project for the DATA TALKS - Data Engineering Zoomcamp.
GitHub Repository
Features and Technologies:
| Features | Technologies |
|---|---|
| Containerization | Docker |
| Infrastructure as Code | Terraform |
| Data Pipeline Orchestration | Mage orchestrator |
| Data Transformation | DBT (Data Build Tool) |
| Cloud Computing | GCP (Google Cloud Platform) |
| Data Lake | Google Cloud Storage |
| Data Warehousing | Google BigQuery |
| Data Visualization | Looker Studio |