m
muneeb_detech

Muneeb Ahmad

@muneeb_detech

Data Engineer

Paquistão
Inglês, Urdu
Algumas informações são exibidas no idioma inglês.
Sobre mim
Data Engineer specializing in building end-to-end, self-hosted data lakehouses on Kubernetes using open-source technologies. I designed and operated a full production-grade data platform implementing Bronze/Silver/Gold medallion architecture processing ~5 million rows across 5 cities. My stack: Apache Spark (batch), Apache Flink (streaming), Trino (federated SQL), dbt-Trino, Apache Iceberg, MinIO, Google BigQuery, Dagster, GitHub Actions, Grafana, and Apache Superset. I help businesses build scalable ETL pipelines, data lakehouses, dbt transformation models, and BI dashboards.... Saiba mais

Habilidades

m
muneeb_detech
Muneeb Ahmad
offline • 
Tempo médio de resposta: 1 hora

Conheça meus serviços

Armazenagem de dados
I will build a production grade apache spark etl data pipeline
A partir deUS$ 500 /projetoMais detalhes

Portfólio

Experiência profissional

GitHub

Data Engineer

GitHub • Freelance

Aug 2025 - Present • 10 mos

Designed and deployed a fully self-hosted, open-source data lakehouse on Kubernetes (k3s) implementing Bronze/Silver/Gold medallion architecture processing ~4.87M rows across 5 cities. - Built Spark + PyDeequ pipelines for Bronze/Silver ingestion, cleansing, and data quality - Developed dbt-trino Gold layer models: Data Vault, Star Schema, OBT, and Data Marts - Dual storage: MinIO/Iceberg (self-hosted) and Google BigQuery (cloud) - Orchestrated end-to-end pipelines with Dagster across two independent Docker code locations - Implemented CI/CD with GitHub Actions + Mage AI for automated builds and k3s deployments - Built observability stack: Prometheus, Grafana, Loki, and Marquez data lineage - Developed 8 BI dashboards in Apache Superset and configured n8n for Slack/email alerting - Managed full Kubernetes infrastructure: Helm deployments, resource tuning, and monitoring