Basim Ahmed

Data and Cloud Engineer

Dataroots • Período integral

Aug 2024 - Present • 1 yr 9 mos

Design, build, and maintain scalable data pipelines to ingest, process, and transform data from multiple sources Implement advanced analytics solutions, including fraud detection, by analyzing large datasets to identify anomalies and suspicious patterns Develop and publish Python packages to automate workflows, improve efficiency, and reduce manual effort Establish Python governance standards to ensure code quality, maintainability, and adherence to best practices Set up and manage CI/CD pipelines using GitHub Actions and Azure DevOps for automated testing, packaging, and deployment Leverage Databricks for data engineering, analytics, and machine learning workflows to improve scalability and collaboration Orchestrate workflows using Apache Airflow to optimize scheduling and monitoring of critical data processes Perform code reviews and provide mentorship to uphold high coding standards and promote team collaboration

Senior Data Engineer

Alexander Thamm [at] GmbH • Período integral

May 2022 - Mar 2023 • 10 mos

As a Senior Data Engineer, I worked on large-scale enterprise data platforms for global clients, focusing on cloud-native, secure, and scalable data solutions. Project: Vorwerk * Gathered business and technical requirements and designed end-to-end data pipelines for streaming IoT data using AWS S3 and Databricks * Designed and implemented a Medallion architecture to ensure clean, reliable, and scalable data processing * Built robust data pipelines using PySpark, Structured Streaming, and Databricks Autoloader * Developed and maintained CI/CD pipelines with GitLab for automated deployment and testing * Implemented data validation, quality checks, and automated testing to ensure pipeline reliability * Set up monitoring and alerting using AWS CloudWatch and Grafana * Optimized and maintained existing AWS-based data pipelines for performance and cost efficiency Project: BMW * Led development of an end-to-end data path for both batch and streaming data systems * Designed secure ETL pipelines with advanced data health checks and validation frameworks * Implemented a digital twin framework to monitor and manage control element statuses for proactive maintenance * Built complex preprocessing and transformation pipelines to convert raw data into actionable insights * Automated data provisioning and orchestration to support analytics and visualization teams * Worked extensively with Palantir Foundry to optimize enterprise data management and analytics workflows This role strengthened my expertise in cloud data engineering, large-scale ETL systems, streaming architectures, and enterprise-grade data platforms.

Data Engineer

Mobilab Solutions GmbH • Período integral

May 2022 - Mar 2023 • 10 mos

Responsibilities of the role involved: • Building ETL/ELT data pipelines. • Analyze, manipulate, transform and process large and complex datasets. • Migrate existing ADF/DataBricks pipelines to Synapse. • Analysing and improving pre-built pipeline logic. • Analyse the data and apply data science where required.Responsibilities of the role involved: • Building ETL/ELT data pipelines. • Analyze, manipulate, transform and process large and complex datasets. • Migrate existing ADF/DataBricks pipelines to Synapse. • Analysing and improving pre-built pipeline logic. • Analyse the data and apply data science where required.