
Anuj S
Senior Data Engineer
Habilidades

Conheça meus serviços

Experiência profissional
Senior Data Engineer
IAG
May 2023 - Present • 3 yrs
• Implemented the seamless integration of the Guidewire Cloud Claims system into foundational and derived data products, ensuring zero downtime and uninterrupted business reporting, supported by a comprehensive end-to-end testing framework addressing schema evolution, data completeness, and validation of critical data flows. • Migrated GitHub repositories from Enterprise to GitHub Cloud, mitigating security and workflow risks while enabling teammates to adopt the migration approach for additional repositories. • Employed prompt engineering best practices to deliver high-quality AI-assisted code, tests, and documentation, while contributing to the uplift of team capability in generative AI workflows. • Re-engineered a complex, BAU-intensive PySpark pipeline during its migration to Google Cloud, simplifying Airflow orchestration and ETL design to reduce operational overhead by over 80% and cut compute time and costs by 40%, while delivering a scalable API-based data product to the Natural Hazards Commission (NZ Government). • Owned stakeholder-facing UAT and release readiness, collaborating with external partners to validate data accuracy, performance, and production readiness prior to formal sign-off.
Data Engineer Consultant
Vodafone
Feb 2022 - May 2023 • 1 yr 3 mos
• Cloud Data Infrastructure Engineering: Collaborated as a lead consultant to architect and deploy a modern data stack for Network Performance Management. Engineered end-to-end infrastructure utilizing Azure Data Factory (ADF), Snowflake, dbt, and Azure DevOps for robust version control and deployment. • Infrastructure Cost Optimization: Performance-tuned Azure Data Factory pipelines and optimized Snowflake warehouse configurations, resulting in a 60% reduction in compute expenditure. • Stakeholder Analytics & BI: Translated complex business requirements into technical specifications, delivering actionable insights through high-performance Tableau dashboards and automated reporting.
Data Analyst
Microsoft • Período integral
Oct 2020 - Mar 2022 • 1 yr 5 mos
• Contributed to large-scale Azure fraud protection initiatives within Microsoft’s Cloud + AI Commerce Protection organisation, helping safeguard the Azure business from cyber and financial fraud. • Developed Python-based machine learning models and enriched fraud signals using external data sources, while analysing legacy fraud cases with SQL Server to improve detection coverage and reduce time to detect fraud for global teams. • Built real-time analytics tools and performance dashboards using Azure Analysis Services, enabling investigative teams worldwide to track emerging fraud trends and measure agent effectiveness against global and on-site KPIs.