Tools for DevOps and MLOps. Materials and projects. New technologies and infrastructure review.
-
Updated
Dec 31, 2023 - HCL
Tools for DevOps and MLOps. Materials and projects. New technologies and infrastructure review.
Smallest Analytical Platform Ever!
A data engineering portfolio project using AWS cloud services to analyze correlations between Malaysian retail performance and fuel prices. Features Terraform IaC, ETL/ELT with AWS S3, Glue, SQL analytics via Athena coupled with data transformation via dbt, and workflow orchestration with Kestra.
Serverless Data Pipeline with Terraform, AWS and Python
Blockchain data pipeline using Airflow, Kubernetes, Redshift, and Grafana
Personal, cloud based (AWS), data lake for experimenting with cloud services.
Infrastructure as a Code module to mange Authentication for Data Engineering Platform
Add a description, image, and links to the dataengineering topic page so that developers can more easily learn about it.
To associate your repository with the dataengineering topic, visit your repo's landing page and select "manage topics."