m
manish7lucky

Manish D.

@manish7lucky

Data Enginner and Python Developer

Índia
Inglês, Hindi, Bengali
Algumas informações são exibidas no idioma inglês.
Sobre mim
Data Engineer building automated, production-grade pipelines from ingestion to analytics-ready warehouses. Built: a 1B+ row batch pipeline (Airflow, S3, Snowpipe, dbt) and a real-time streaming pipeline (Kafka, PySpark, Databricks, Delta Lake) with anomaly detection. Stack: Python, SQL, Airflow, dbt, PostgreSQL, Snowflake, AWS, Docker, Kafka. I can build ETL pipelines, automate reporting/spreadsheet syncs, set up Airflow orchestration, design dbt models, or fix a broken pipeline. Currently pursuing BS Data Science at IIT Madras. Clean code, clear scope, no surprises.... Saiba mais

Habilidades

m
manish7lucky
Manish D.
offline • 

Conheça meus serviços

ETLs de dados
I will build a python etl pipeline for your data
A partir deUS$ 10 /projetoMais detalhes

Portfólio

Experiência profissional

Personal_portfolio project

Nyc Taxi Data Pipeline

Personal portfolio project • Autônomo

Jul 2026 - Present • 3 mos

end to end production style data pipeline that reduces ingestion speed by 40%