z
zoha_sheikh0112

Zoha S

@zoha_sheikh0112

Senior ETL Data Engineer

Alemanha
Urdu, Alemão, Inglês
Algumas informações são exibidas no idioma inglês.
Sobre mim
I am a Senior ETL and Data Engineer with expertise in building IBM DataStage pipelines, SQL, and Snowflake transformations. I have extensive experience in data engineering, from developing PySpark deduplication pipelines for LLMs at Fraunhofer IAIS to building REST APIs and backend systems using Python, PHP, and Laravel.... Saiba mais

Habilidades

z
zoha_sheikh0112
Zoha S
offline • 
Tempo médio de resposta: 1 hora

Conheça meus serviços

Consultas SQL e NoSQL
I will build sql queries, reports, and database scripts for your business data

Experiência profissional

JUKABO

Senior ETL Developer, Germany

JUKABO • Período integral

Jun 2024 - Present • 2 yrs 5 mos

Job responsibilities include: 1. Built and optimized IBM DataStage pipelines, including new stages from SQL business specifications and SCD2-historized load paths 2. Developed Python scripts for data checks, automation, and pipeline support 3. Worked with Kafka workflows: staging loads into the production ODS, then dropping or exchange-partitioning staging data after the retention window 4. Supported Automic/UC4 production rollout after acceptance, plus regression and acceptance testing 5. Created, verified, and administered Cognos reports, including SQL analysis on DB2 6. Handled tickets, access control, and monthly Cognos license grant and revoke runs 7. Built dbt models and transformations on Snowflake 8. Trained and evaluated generative AI models, including on-premise experiments 9. Automated recurring work with XML/Excel (VBA) tooling

Fraunhofer-Gesellschaft

Student Research Assistant

Fraunhofer-Gesellschaft • Meio período

Jun 2022 - Jun 2024 • 2 yrs

Job responsibilities include: 1. Worked with data engineering pipeline and employed various deduplication algorithms (including Minhash/Minhash Spark, ExactHash, SimHash, Scalable Bloom Filter, and Suffix Array) to optimize performance for large text corpora, particularly in enhancing OpenGPT-X LLMs 2. Engaged with enterprise application knowledge graph generation and crafting SPARQL queries to extract valuable insights and data 3. Utilized OpenAI API for diverse prompt types and their verbalization to enhance conversational interfaces 4. Conducted some research on the removal of duplicate subgraphs within knowledge graphs to maintain diversity, with a focus on improving input quality for LLMs 5. Evaluated Large Language Models (LLMs) using Ragas and Giskard frameworks 6. Experimented with synthetic test data generation in order to make the evaluation of LLMs more robust and reduce the developer time 7. Development language is Python

JUKABO

Werkstudent

JUKABO • Meio período

Nov 2021 - May 2022 • 6 mos

Job responsibilities include: 1. Developed reports using IBM Cognos Analytics and Power BI 2. Jobs were developed in Talend, and data organization was managed using the Snowflake cloud data warehouse