Ver categorias
Explorar
Fiverr Pro
Português
$
USD
Satish P
@satish_sp
Data Engineer
Índia
Inglês
Sobre mim
I am a Data Engineer with 5+ years of experience designing and developing scalable data pipelines, ETL frameworks, and data lake architectures across AWS and Azure cloud platforms. I have strong expertise in Python, PySpark, SQL, Apache Spark, Databricks, Snowflake, and Apache Airflow.
Habilidades
Satish P
offline •
Conheça meus serviços
Programação e Tecnologia
I will build and automate etl pipelines using airflow pyspark and AWS
Portfólio
Experiência profissional
Data Engineer
Qualcomm • Período integral
Aug 2025 - Present • 9 mos
Designed scalable data pipelines ingesting semiconductor wafer probe test data from Automated Test Equipment (ATE) into AWS S3 data lake. Built PySpark and Databricks based ETL pipelines processing millions of wafer test records daily. Implemented S3 data lake architecture managing raw, processed, and curated manufacturing datasets. Developed ingestion frameworks for high volume CSV and Parquet wafer test files from manufacturing systems. Built and managed Apache Airflow DAGs orchestrating ingestion, transformation, and loading workflows. Implemented PySpark transformations generating wafer level and die level yield analytics datasets.
Data Engineer
United Airlines • Período integral
Oct 2023 - Jul 2025 • 1 yr 9 mos
Designed ETL pipelines migrating pilot records from SQL Server to AWS Redshift for FAA PRD compliance. Automated ingestion and transformation using Python, AWS Glue, Lambda, and PySpark. Developed Apache Airflow DAGs with proactive monitoring using AWS SNS. Deployed data pipelines across development, staging, and production environments. Implemented data validation frameworks ensuring regulatory data accuracy and collaborating with DevOps teams to automate infrastructure.
