Sai

@saibdp

I will fix or optimize your broken ETL data pipeline in Azure, Fabric,Databricks

Canadá
Inglês, Telugu, Hindi
Algumas informações são exibidas no idioma inglês.
Sobre mim
I help businesses fix broken, slow, or unreliable data pipelines using Azure, Microsoft Fabric, Databricks, SQL, Python, and PySpark. My focus is making your ETL/ELT workflows run correctly, faster, and with less manual effort. I can help troubleshoot failed jobs, optimize SQL or PySpark logic, build small data pipelines, clean messy data, and prepare reliable datasets for reporting. If your data process is failing, slow, or hard to maintain, I can help identify the issue and provide a practical fix.... Saiba mais

Habilidades

s
saibdp
Sai
offline • 

Conheça meus serviços

ETLs de dados
I will fix your azure, fabric, or databricks data pipeline

Experiência profissional

Azure Data Engineer

Contractor

Oct 2023 - Present2 yrs 9 mos

 Designed and implemented scalable ETL/ELT pipelines using Azure Data Factory to integrate, transform, and orchestrate data from multiple heterogeneous sources, improving data accessibility, reliability, and analytics readiness  Managed and optimized cloud-based relational databases by developing complex SQL queries, stored procedures, indexing strategies, and performance-tuned scripts to support business intelligence, operational reporting, and analytical workloads  Developed and maintained enterprise-scale storage solutions using Azure Data Lake Storage (ADLS), enabling secure, scalable, and cost-efficient storage and retrieval of structured, semi-structured, and unstructured datasets  Integrated and optimized Snowflake data warehouse solutions, implementing schema design, workload optimization, clustering, secure data sharing, and query tuning for high-performance analytics and reporting  Designed and implemented dimensional data models including star and snowflake schemas, ensuring data consistency, governance, integrity, and optimized reporting performance across analytical platforms  Developed reusable Python-based automation frameworks for data ingestion, transformation, validation, orchestration, and monitoring, reducing manual effort and improving operational efficiency  Conducted advanced performance tuning and optimization of data pipelines, SQL workloads, and storage systems using partitioning, caching, indexing, and query optimization techniques to improve scalability and execution time  Implemented robust data quality and governance frameworks including validation rules, exception handling, auditing, lineage tracking, and metadata management using Microsoft Purview to ensure data accuracy, consistency, and compliance  Built modern analytics and Lakehouse solutions using Microsoft Fabric, integrating data engineering, warehousing, governance, and reporting workloads within a unified ecosystem

Oracle

Data Engineer

Oracle

Jun 2020 - Aug 20222 yrs 2 mos

 Designed and implemented robust ETL processes using tools like Apache Spark, Apache Airflow, or Talend, ensuring efficient data extraction, transformation, and loading for analytics  Managed and optimized databases (e.g., PostgreSQL, MySQL, or MongoDB), improving query performance by through indexing and schema design  Utilized cloud platforms (Azure) to deploy data solutions, leveraging services like Azure Data Factory for scalable data storage and processing  Developed and maintained data models to support business intelligence initiatives, ensuring accurate representation of data relationships and hierarchies  Implemented data validation and cleansing processes to enhance data accuracy and integrity, reducing data-related errors  Worked closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights through effective data solutions  Conducted performance tuning of data pipelines and queries, resulting in significant improvements in processing time and resource utilization  Automated routine data management tasks using scripting languages (e.g., Python, Bash), leading to a reduction in manual effort and improved operational efficiency  Utilized Git for version control, ensuring collaborative development and maintaining code integrity across projects

Business Analyst

NXTGEN

Jun 2018 - May 20201 yr 11 mos

 Collaborated with stakeholders to gather, document, and analyze business requirements, ensuring alignment with organizational goals and project objectives  Evaluated existing business processes, identified inefficiencies, and proposed data-driven solutions to enhance workflow and operational effectiveness  Acted as a bridge between business teams and technical teams, ensuring clear communication, managing expectations, and facilitating seamless project execution  Analyzed business data, generated insights, and created detailed reports using visualization tools to support decision-making and strategic planning  Prepared functional specifications, business requirement documents (BRDs), and use cases to ensure a comprehensive understanding of project needs  Assisted in testing solutions, validated functionalities against business requirements, and ensured successful implementation by gathering stakeholder feedback  Worked closely with project managers to define timelines, track project progress, mitigate risks, and ensure timely delivery of business solutions  Conducted research on industry trends, competitor strategies, and emerging technologies to provide recommendations that drove business growth and innovation