I will build a databricks pyspark etl pipeline

Algumas informações são exibidas no idioma inglês.

Paquistão

Eu falo Inglês, Urdu

Python and Data Engineer Web Scraping ETL Pipelines SQL AI Video Genrator

CS student at FUUAST Karachi, specializing in Python, SQL & Data Engineering I help businesses with: ✅ Web Scraping & Data Extraction ✅ ETL Pipelines (Extract, Transform, Load) ✅ Data Cleaning & Anal...
Sobre este Serviço

Have raw data stuck in CSV files, APIs or messy tables? I'll turn it into clean, analytics-ready tables using Databricks, PySpark and Delta Lake with the Medallion (Bronze, Silver, Gold) architecture.


What you get:

Bronze layer: raw data ingested safely, nothing lost

Silver layer: cleaned, deduplicated and standardized data

Gold layer: business-ready tables for reports and dashboards

Well-commented PySpark and SQL notebooks

Data quality checks (nulls, duplicates, wrong formats)

Simple documentation so your team can maintain it


My proof: I built an end-to-end Databricks project that processed over 51,000 records through all three Medallion layers. I'm a micro1 Certified Data Engineer with Cloud Data Engineer training (Python, SQL, AWS, Snowflake, Spark).


Note: the pipeline runs in YOUR Databricks workspace so you own your data. A free Databricks account is enough for small projects.


Message me before ordering with your data source and goal, and I'll recommend the right package.

Idioma:

Inglês

Experiência técnica:

dbt (Data Build Tool)

•

Apache Airflow

Especialidade:

Pipelines de dados

•

Desenvolvimento de ETL

Setor:

Criptomoedas e Blockchain

•

Data analytics

Meu portfólio

Outros serviços de Engenharia de Dados que eu ofereço