p
premchand_2000

Premchand

@premchand_2000

Data Engineer

Índia
Inglês, Telugu, Hindi
Algumas informações são exibidas no idioma inglês.
Sobre mim
Results-driven Azure Data Engineer with 4 years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based ETL solutions using Microsoft Azure technologies. Skilled in Azure Data Factory, Azure Databricks, Pyspark, SQL, Azure SQL Database, and Delta Lake for processing large scale structured and unstructured data. Experienced in building end-to-end data integration solutions, optimizing data workflows, and implementing data transformation logic for analytics and reporting.... Saiba mais

Habilidades

p
premchand_2000
Premchand
offline • 
Tempo médio de resposta: 1 hora

Conheça meus serviços

Limpeza de Dados
I will build snowflake data pipelines, sql queries, and dbt models

Portfólio

Experiência profissional

Wipro_Hydraulics

Azure Data Engineer

Wipro Hydraulics

Jan 2022 - Sep 2026 • 4 yrs 8 mos

Led the implementation of metadata-driven ETL/ELT pipelines using Microsoft to ingest and process data from multiple source systems into Azure Data Lake Storage Gen2, Azure SQL, and Blob Storage. • Developed and optimized PySpark and Spark SQL workflows in Azure Databricks for large-scale structured and unstructured data processing. • Built end-to-end data integration pipelines in ADF using Linked Services, Datasets, Pipelines, Triggers, and parameterized workflows for automated processing. • Implemented incremental load strategies along with SCD Type 1 and Type 2 logic in Microsoft to support historical data tracking and reporting. • Contributed to implementing Medallion Architecture (Bronze, Silver, Gold layers) using Delta Lake and Parquet formats for scalable and analytics-ready data platforms. • Designed and optimized complex SQL queries, Spark transformations, partitioning, and caching techniques to improve ETL and reporting performance. • Implemented monitoring, logging, alerting, and error-handling mechanisms using Azure Monitor and Log Analytics to ensure data reliability and operational efficiency. • Collaborated with business stakeholders, QA teams, and cross-functional teams to gather requirements, resolve production issues, and deliver data-driven insights.