
Harsh A
Data Engineer
Habilidades

Conheça meus serviços

Experiência profissional
Data Engineer
Cognizant • Período integral
Sep 2023 - Present • 3 yrs 2 mos
• Built and deployed PySpark ETL pipelines on Azure Databricks, transforming multi-source datasets via filtering and joining operations, reducing manual intervention by 80% with reliable delivery to designated target systems. • Designed and implemented 100+ Ataccama DQ rules to identify and flag invalid records across datasets with 1M+ records, improving data quality from 70% to 95% and ensuring enterprise-grade reliability for life sciences data. • Accelerated business decision-making by implementing Medallion Architecture (Bronze→ Silver→ Gold) on Azure Databricks, delivering BI-ready governed data across 100+ tables for reliable stakeholder consumption. • Eliminated multi-week reporting delays by designing Power BI dashboards with daily refreshed insights, enabling self-serve, real-time visibility for stakeholders across integrated target platforms.